2023-10-16T19:14:36.236 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T19:14:36.237 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --verbose --name rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061 -- /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/orig.config.yaml 2023-10-16T19:14:36.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:14:36.367 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061 branch: rishabh-2023oct13 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: null first_in_suite: false job_id: '7430061' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-qa2 sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-qa2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2zusky+XBRcCSZzHYHFmLoRFcxSn8E5NGKEAsqcPkd3RWzrXWZ/UENhfaQ/IVdYDBN0rdhcEliONWfbnIvHb4= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyv10wTIhXE0Wp2+/pnLwD0VllAIiMrvMNwpE9DceocyJdBs8b6tCs+fOlHkaKfpGuV2PeuurBhsdCKBoq0bqY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_18:49:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T19:14:36.368 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa; will attempt to use it 2023-10-16T19:14:36.368 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks 2023-10-16T19:14:36.369 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T19:14:36.370 INFO:teuthology.task.internal:Checking packages... 2023-10-16T19:14:36.393 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T19:14:36.393 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T19:14:36.394 INFO:teuthology.packaging:ref: None 2023-10-16T19:14:36.394 INFO:teuthology.packaging:tag: None 2023-10-16T19:14:36.394 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T19:14:36.395 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:14:36.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T19:14:36.540 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T19:14:36.540 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T19:14:36.547 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T19:14:36.547 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T19:14:36.574 INFO:teuthology.task.internal:Saving configuration 2023-10-16T19:14:36.589 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T19:14:36.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:14:36.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:09:37.669957', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2zusky+XBRcCSZzHYHFmLoRFcxSn8E5NGKEAsqcPkd3RWzrXWZ/UENhfaQ/IVdYDBN0rdhcEliONWfbnIvHb4='} 2023-10-16T19:14:36.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:09:37.667930', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyv10wTIhXE0Wp2+/pnLwD0VllAIiMrvMNwpE9DceocyJdBs8b6tCs+fOlHkaKfpGuV2PeuurBhsdCKBoq0bqY='} 2023-10-16T19:14:36.644 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T19:14:36.650 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-16T19:14:36.650 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-16T19:14:36.651 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T19:14:36.721 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faeb1308a60>, signals=[15]) 2023-10-16T19:14:36.723 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T19:14:36.729 INFO:teuthology.task.internal:Opening connections... 2023-10-16T19:14:36.729 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T19:14:36.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:14:36.832 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T19:14:36.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:14:36.917 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T19:14:36.924 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-16T19:14:36.942 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-16T19:14:36.942 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-16T19:14:37.000 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-10-16T19:14:37.000 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2023-10-16T19:14:37.001 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-10-16T19:14:37.001 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-10-16T19:14:37.001 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2023-10-16T19:14:37.001 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2023-10-16T19:14:37.002 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T19:14:37.002 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-16T19:14:37.002 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2023-10-16T19:14:37.002 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T19:14:37.002 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-10-16T19:14:37.003 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:14:37.003 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T19:14:37.003 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T19:14:37.004 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-16T19:14:37.110 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-10-16T19:14:37.128 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-10-16T19:14:37.128 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-10-16T19:14:37.185 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-10-16T19:14:37.185 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2023-10-16T19:14:37.185 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-10-16T19:14:37.185 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-10-16T19:14:37.186 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2023-10-16T19:14:37.186 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2023-10-16T19:14:37.186 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T19:14:37.186 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-10-16T19:14:37.187 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2023-10-16T19:14:37.187 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T19:14:37.187 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-10-16T19:14:37.187 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:14:37.187 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T19:14:37.188 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T19:14:37.188 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-10-16T19:14:37.215 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T19:14:37.224 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T19:14:37.229 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T19:14:37.230 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:14:37.233 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:14:37.249 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T19:14:37.256 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T19:14:37.256 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:14:37.290 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:14:37.413 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T19:14:37.469 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T19:14:37.483 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T19:14:37.484 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-16T19:14:37.485 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:14:37.486 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:14:37.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:14:37.503 DEBUG:teuthology.task.kernel:sha1 for mon.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:14:37.503 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-16T19:14:37.503 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2023-10-16T19:14:37.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:14:37.505 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:14:37.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-16T19:14:37.505 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-10-16T19:14:37.560 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-361.el9.x86_64 2023-10-16T19:14:37.560 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:14:37.561 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-16T19:14:37.561 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:14:37.565 INFO:teuthology.orchestra.run.smithi057.stdout:5.14.0-361.el9.x86_64 2023-10-16T19:14:37.565 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:14:37.565 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-16T19:14:37.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:14:37.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum upgrade -y linux-firmware 2023-10-16T19:14:37.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum upgrade -y linux-firmware 2023-10-16T19:14:40.012 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - AppStream 9.7 MB/s | 6.3 MB 00:00 2023-10-16T19:14:40.159 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.3 MB 00:00 2023-10-16T19:14:41.395 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2023-10-16T19:14:41.509 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2023-10-16T19:14:43.769 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 7.9 MB 00:02 2023-10-16T19:14:45.401 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-10-16T19:14:46.928 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 18 MB 00:02 2023-10-16T19:14:48.567 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 18 MB 00:02 2023-10-16T19:14:52.629 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 5.7 MB 00:02 2023-10-16T19:14:53.510 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.7 MB 00:01 2023-10-16T19:14:54.580 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 14 kB 00:00 2023-10-16T19:14:55.052 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 14 kB 00:00 2023-10-16T19:14:56.864 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 11 MB/s | 19 MB 00:01 2023-10-16T19:14:58.942 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 19 MB 00:04 2023-10-16T19:15:01.295 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-10-16T19:15:03.430 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2023-10-16T19:15:03.437 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2023-10-16T19:15:03.437 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2023-10-16T19:15:03.437 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2023-10-16T19:15:03.437 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2023-10-16T19:15:03.437 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-16T19:15:03.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:15:03.438 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2023-10-16T19:15:03.438 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2023-10-16T19:15:03.438 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 1 Package 2023-10-16T19:15:03.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:15:03.439 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 326 M 2023-10-16T19:15:03.439 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2023-10-16T19:15:03.605 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-10-16T19:15:05.853 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-10-16T19:15:05.866 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-10-16T19:15:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-10-16T19:15:05.866 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-10-16T19:15:05.867 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-10-16T19:15:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-16T19:15:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:15:05.867 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-10-16T19:15:05.867 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-10-16T19:15:05.868 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 1 Package 2023-10-16T19:15:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:15:05.868 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 326 M 2023-10-16T19:15:05.868 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-10-16T19:15:15.055 INFO:teuthology.orchestra.run.smithi057.stdout:linux-firmware-20230926-140.el9.noarch.rpm 35 MB/s | 326 MB 00:09 2023-10-16T19:15:15.056 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:15:15.057 INFO:teuthology.orchestra.run.smithi057.stdout:Total 35 MB/s | 326 MB 00:09 2023-10-16T19:15:15.057 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-10-16T19:15:15.161 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-10-16T19:15:15.161 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-10-16T19:15:17.317 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-10-16T19:15:17.317 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-10-16T19:15:18.954 INFO:teuthology.orchestra.run.smithi110.stdout:linux-firmware-20230926-140.el9.noarch.rpm 21 MB/s | 326 MB 00:15 2023-10-16T19:15:18.955 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:15:18.955 INFO:teuthology.orchestra.run.smithi110.stdout:Total 21 MB/s | 326 MB 00:15 2023-10-16T19:15:18.956 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2023-10-16T19:15:19.060 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2023-10-16T19:15:19.061 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2023-10-16T19:15:21.237 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2023-10-16T19:15:21.237 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2023-10-16T19:15:23.152 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-10-16T19:15:23.406 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T19:15:23.572 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T19:15:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T19:15:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T19:15:24.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T19:15:24.772 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:15:24.772 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-10-16T19:15:24.772 INFO:teuthology.orchestra.run.smithi057.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-16T19:15:24.772 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:15:24.773 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-10-16T19:15:25.050 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-16T19:15:25.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:15:25.263 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-16T19:15:25.263 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-16T19:15:25.266 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-10-16T19:15:27.104 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2023-10-16T19:15:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T19:15:27.618 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T19:15:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T19:15:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T19:15:28.806 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T19:15:28.807 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:15:28.807 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2023-10-16T19:15:28.807 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-16T19:15:28.807 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:15:28.807 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2023-10-16T19:15:29.088 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-16T19:15:29.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T19:15:29.234 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-16T19:15:29.235 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-16T19:15:29.237 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2023-10-16T19:15:46.690 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16 19:15:46 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-16T19:15:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2023-10-16 19:15:46-- 2023-10-16T19:15:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 17s 2023-10-16T19:15:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 306M in 17s (17.8 MB/s) 2023-10-16T19:15:46.692 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-16T19:15:46.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-16T19:15:48.537 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying... ######################################## 2023-10-16T19:15:48.611 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing... ######################################## 2023-10-16T19:15:48.690 INFO:teuthology.orchestra.run.smithi110.stdout:Updating / installing... 2023-10-16T19:15:55.768 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-16T19:16:01.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16 19:16:01 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-16T19:16:01.291 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2023-10-16 19:16:01-- 2023-10-16T19:16:01.291 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 36s 2023-10-16T19:16:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 306M in 36s (8.59 MB/s) 2023-10-16T19:16:01.340 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-16T19:16:01.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-16T19:16:03.285 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying... ######################################## 2023-10-16T19:16:03.343 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing... ######################################## 2023-10-16T19:16:03.427 INFO:teuthology.orchestra.run.smithi057.stdout:Updating / installing... 2023-10-16T19:16:10.817 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-16T19:16:11.029 INFO:teuthology.orchestra.run.smithi110.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-16T19:16:24.447 INFO:teuthology.orchestra.run.smithi057.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-16T19:16:32.190 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-16T19:16:32.191 DEBUG:teuthology.orchestra.run.smithi110:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-16T19:16:32.262 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.262 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.263 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-16T19:16:32.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-16T19:16:32.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-16T19:16:32.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-16T19:16:32.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-16T19:16:32.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-16T19:16:32.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-16T19:16:32.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-16T19:16:32.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-16T19:16:32.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-16T19:16:32.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-16T19:16:32.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-16T19:16:32.266 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-16T19:16:32.266 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-16T19:16:32.266 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-16T19:16:32.266 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-16T19:16:32.266 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-16T19:16:32.267 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-16T19:16:32.267 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-16T19:16:32.267 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-16T19:16:32.267 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-16T19:16:32.267 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-16T19:16:32.268 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-16T19:16:32.268 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-16T19:16:32.268 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-16T19:16:32.268 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-16T19:16:32.269 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-16T19:16:32.269 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-16T19:16:32.269 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-16T19:16:32.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-16T19:16:32.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-16T19:16:32.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-16T19:16:32.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-16T19:16:32.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-16T19:16:32.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-16T19:16:32.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-16T19:16:32.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-16T19:16:32.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-16T19:16:32.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-16T19:16:32.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-16T19:16:32.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-16T19:16:32.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-16T19:16:32.274 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-16T19:16:32.274 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-16T19:16:32.274 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-16T19:16:32.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-16T19:16:32.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-16T19:16:32.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-16T19:16:32.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-16T19:16:32.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-16T19:16:32.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-16T19:16:32.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-16T19:16:32.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-16T19:16:32.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-16T19:16:32.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-16T19:16:32.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-16T19:16:32.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-16T19:16:32.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-16T19:16:32.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-16T19:16:32.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-16T19:16:32.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-16T19:16:32.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-16T19:16:32.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-16T19:16:32.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-16T19:16:32.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-16T19:16:32.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-16T19:16:32.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-16T19:16:32.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-16T19:16:32.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-16T19:16:32.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-16T19:16:32.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-16T19:16:32.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-16T19:16:32.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-16T19:16:32.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-16T19:16:32.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-16T19:16:32.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-16T19:16:32.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-16T19:16:32.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-16T19:16:32.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-16T19:16:32.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-16T19:16:32.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-16T19:16:32.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-16T19:16:32.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-16T19:16:32.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-16T19:16:32.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-16T19:16:32.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-16T19:16:32.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-16T19:16:32.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-16T19:16:32.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-16T19:16:32.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-16T19:16:32.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-16T19:16:32.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-16T19:16:32.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-16T19:16:32.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-16T19:16:32.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-16T19:16:32.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-16T19:16:32.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-16T19:16:32.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-16T19:16:32.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-16T19:16:32.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-16T19:16:32.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-16T19:16:32.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-16T19:16:32.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-16T19:16:32.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-16T19:16:32.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-16T19:16:32.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-16T19:16:32.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-16T19:16:32.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-16T19:16:32.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-16T19:16:32.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-16T19:16:32.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-16T19:16:32.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-16T19:16:32.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-16T19:16:32.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-16T19:16:32.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-16T19:16:32.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-16T19:16:32.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-16T19:16:32.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-16T19:16:32.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-16T19:16:32.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-16T19:16:32.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-16T19:16:32.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-16T19:16:32.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-16T19:16:32.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-16T19:16:32.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-16T19:16:32.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-16T19:16:32.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-16T19:16:32.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-16T19:16:32.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-16T19:16:32.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-16T19:16:32.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-16T19:16:32.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-16T19:16:32.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-16T19:16:32.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-16T19:16:32.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-16T19:16:32.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-16T19:16:32.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-16T19:16:32.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-16T19:16:32.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-16T19:16:32.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-16T19:16:32.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-16T19:16:32.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-16T19:16:32.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-16T19:16:32.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-16T19:16:32.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-16T19:16:32.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-16T19:16:32.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-16T19:16:32.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-16T19:16:32.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-16T19:16:32.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-16T19:16:32.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-16T19:16:32.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-16T19:16:32.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-16T19:16:32.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-16T19:16:32.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-16T19:16:32.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-16T19:16:32.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-16T19:16:32.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-16T19:16:32.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-16T19:16:32.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-16T19:16:32.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-16T19:16:32.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-16T19:16:32.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-16T19:16:32.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-16T19:16:32.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-16T19:16:32.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-16T19:16:32.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-16T19:16:32.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-16T19:16:32.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-16T19:16:32.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-16T19:16:32.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-16T19:16:32.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-16T19:16:32.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-16T19:16:32.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-16T19:16:32.311 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-16T19:16:32.311 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-16T19:16:32.311 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-16T19:16:32.312 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-16T19:16:32.312 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-16T19:16:32.312 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-16T19:16:32.312 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-16T19:16:32.312 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-16T19:16:32.312 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-16T19:16:32.313 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-16T19:16:32.313 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-16T19:16:32.313 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-16T19:16:32.313 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-16T19:16:32.313 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-16T19:16:32.314 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-16T19:16:32.314 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-16T19:16:32.314 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-16T19:16:32.314 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-16T19:16:32.315 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-16T19:16:32.315 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-16T19:16:32.315 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-16T19:16:32.315 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-16T19:16:32.315 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-16T19:16:32.316 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-16T19:16:32.316 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-16T19:16:32.316 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-16T19:16:32.316 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-16T19:16:32.316 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-16T19:16:32.317 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-16T19:16:32.317 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-16T19:16:32.317 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-16T19:16:32.317 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-16T19:16:32.318 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-16T19:16:32.318 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-16T19:16:32.318 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-16T19:16:32.318 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-16T19:16:32.319 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-16T19:16:32.319 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-16T19:16:32.319 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-16T19:16:32.319 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-16T19:16:32.320 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-16T19:16:32.320 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-16T19:16:32.320 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-16T19:16:32.320 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-16T19:16:32.320 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-16T19:16:32.320 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-16T19:16:32.321 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-16T19:16:32.321 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-16T19:16:32.321 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-16T19:16:32.321 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-16T19:16:32.321 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-16T19:16:32.322 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-16T19:16:32.322 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-16T19:16:32.322 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-16T19:16:32.322 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-16T19:16:32.322 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-16T19:16:32.323 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-16T19:16:32.323 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-16T19:16:32.323 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-16T19:16:32.323 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-16T19:16:32.323 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-16T19:16:32.324 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-16T19:16:32.324 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-16T19:16:32.324 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-16T19:16:32.324 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-16T19:16:32.324 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-16T19:16:32.325 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-16T19:16:32.325 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-16T19:16:32.325 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-16T19:16:32.325 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-16T19:16:32.325 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-16T19:16:32.326 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-16T19:16:32.326 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-16T19:16:32.326 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-16T19:16:32.327 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-16T19:16:32.327 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-16T19:16:32.327 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-16T19:16:32.327 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-16T19:16:32.327 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-16T19:16:32.328 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-16T19:16:32.328 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-16T19:16:32.328 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-16T19:16:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-16T19:16:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-16T19:16:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-16T19:16:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-16T19:16:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-16T19:16:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-16T19:16:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-16T19:16:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-16T19:16:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-16T19:16:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-16T19:16:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-16T19:16:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-16T19:16:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-16T19:16:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-16T19:16:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-16T19:16:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-16T19:16:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-16T19:16:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-16T19:16:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-16T19:16:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-16T19:16:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-16T19:16:32.334 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-16T19:16:32.334 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-16T19:16:32.334 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-16T19:16:32.335 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-16T19:16:32.335 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-16T19:16:32.335 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-16T19:16:32.336 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-16T19:16:32.336 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-16T19:16:32.336 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-16T19:16:32.336 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-16T19:16:32.337 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-16T19:16:32.337 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-16T19:16:32.337 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-16T19:16:32.337 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-16T19:16:32.338 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-16T19:16:32.338 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-16T19:16:32.338 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-16T19:16:32.338 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-16T19:16:32.339 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-16T19:16:32.339 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-16T19:16:32.339 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-16T19:16:32.339 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-16T19:16:32.339 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-16T19:16:32.340 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-16T19:16:32.340 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-16T19:16:32.340 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-16T19:16:32.340 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-16T19:16:32.340 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-16T19:16:32.340 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-16T19:16:32.341 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-16T19:16:32.341 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-16T19:16:32.341 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-16T19:16:32.341 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-16T19:16:32.341 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-16T19:16:32.342 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-16T19:16:32.342 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-16T19:16:32.342 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-16T19:16:32.342 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-16T19:16:32.342 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-16T19:16:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-16T19:16:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-16T19:16:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-16T19:16:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-16T19:16:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-16T19:16:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-16T19:16:32.344 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-16T19:16:32.344 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-16T19:16:32.344 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-16T19:16:32.344 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-16T19:16:32.344 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-16T19:16:32.345 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-16T19:16:32.345 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-16T19:16:32.345 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-16T19:16:32.345 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-16T19:16:32.345 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-16T19:16:32.346 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-16T19:16:32.346 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-16T19:16:32.346 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-16T19:16:32.346 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-16T19:16:32.346 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-16T19:16:32.346 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-16T19:16:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-16T19:16:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-16T19:16:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-16T19:16:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-16T19:16:32.347 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-16T19:16:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-16T19:16:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-16T19:16:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-16T19:16:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-16T19:16:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-16T19:16:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-16T19:16:32.349 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-16T19:16:32.349 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-16T19:16:32.349 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-16T19:16:32.349 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-16T19:16:32.349 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-16T19:16:32.350 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-16T19:16:32.350 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-16T19:16:32.350 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-16T19:16:32.350 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-16T19:16:32.350 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-16T19:16:32.351 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-16T19:16:32.351 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-16T19:16:32.351 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-16T19:16:32.351 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-16T19:16:32.351 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-16T19:16:32.352 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-16T19:16:32.352 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-16T19:16:32.352 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-16T19:16:32.352 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-16T19:16:32.352 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-16T19:16:32.353 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-16T19:16:32.353 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-16T19:16:32.353 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-16T19:16:32.353 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-16T19:16:32.353 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-16T19:16:32.354 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-16T19:16:32.354 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-16T19:16:32.354 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-16T19:16:32.354 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-16T19:16:32.354 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-16T19:16:32.355 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-16T19:16:32.355 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-16T19:16:32.355 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-16T19:16:32.355 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-16T19:16:32.355 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-16T19:16:32.355 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-16T19:16:32.356 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-16T19:16:32.356 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-16T19:16:32.356 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-16T19:16:32.356 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-16T19:16:32.356 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-16T19:16:32.357 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-16T19:16:32.357 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-16T19:16:32.357 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-16T19:16:32.357 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-16T19:16:32.357 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-16T19:16:32.358 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-16T19:16:32.358 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-16T19:16:32.358 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-16T19:16:32.358 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-16T19:16:32.358 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-16T19:16:32.359 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-16T19:16:32.359 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-16T19:16:32.359 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-16T19:16:32.359 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-16T19:16:32.359 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-16T19:16:32.360 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-16T19:16:32.360 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-16T19:16:32.360 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-16T19:16:32.360 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-16T19:16:32.360 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-16T19:16:32.360 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-16T19:16:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-16T19:16:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-16T19:16:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-16T19:16:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-16T19:16:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-16T19:16:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-16T19:16:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-16T19:16:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-16T19:16:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-16T19:16:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-16T19:16:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-16T19:16:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-16T19:16:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-16T19:16:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-16T19:16:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-16T19:16:32.364 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-16T19:16:32.364 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-16T19:16:32.364 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-16T19:16:32.364 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-16T19:16:32.364 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-16T19:16:32.364 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-16T19:16:32.365 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-16T19:16:32.365 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-16T19:16:32.365 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-16T19:16:32.365 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-16T19:16:32.365 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-16T19:16:32.365 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-16T19:16:32.366 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-16T19:16:32.366 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-16T19:16:32.366 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-16T19:16:32.366 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-16T19:16:32.366 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-16T19:16:32.367 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-16T19:16:32.367 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-16T19:16:32.367 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-16T19:16:32.367 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-16T19:16:32.367 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-16T19:16:32.368 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-16T19:16:32.368 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-16T19:16:32.368 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-16T19:16:32.368 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-16T19:16:32.368 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-16T19:16:32.368 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-16T19:16:32.369 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-16T19:16:32.369 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-16T19:16:32.369 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-16T19:16:32.369 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-16T19:16:32.369 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-16T19:16:32.370 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-16T19:16:32.370 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-16T19:16:32.370 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-16T19:16:32.370 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-16T19:16:32.370 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-16T19:16:32.370 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-16T19:16:32.371 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-16T19:16:32.371 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-16T19:16:32.371 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-16T19:16:32.371 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-16T19:16:32.371 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-16T19:16:32.372 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-16T19:16:32.372 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-16T19:16:32.372 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-16T19:16:32.372 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-16T19:16:32.372 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-16T19:16:32.372 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-16T19:16:32.373 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-16T19:16:32.373 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-16T19:16:32.373 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-16T19:16:32.373 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-16T19:16:32.373 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-16T19:16:32.374 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-16T19:16:32.374 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-16T19:16:32.374 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-16T19:16:32.374 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-16T19:16:32.374 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-16T19:16:32.375 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-16T19:16:32.375 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-16T19:16:32.375 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-16T19:16:32.375 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-16T19:16:32.375 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-16T19:16:32.375 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-16T19:16:32.376 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-16T19:16:32.376 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-16T19:16:32.376 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-16T19:16:32.376 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-16T19:16:32.376 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-16T19:16:32.377 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-16T19:16:32.377 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-16T19:16:32.377 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-16T19:16:32.377 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-16T19:16:32.377 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-16T19:16:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-16T19:16:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-16T19:16:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-16T19:16:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-16T19:16:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-16T19:16:32.378 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-16T19:16:32.379 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-16T19:16:32.379 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-16T19:16:32.379 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-16T19:16:32.379 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-16T19:16:32.379 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-16T19:16:32.380 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-16T19:16:32.380 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-16T19:16:32.380 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-16T19:16:32.380 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-16T19:16:32.380 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-16T19:16:32.381 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-16T19:16:32.381 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-16T19:16:32.381 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-16T19:16:32.381 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-16T19:16:32.381 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-16T19:16:32.382 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-16T19:16:32.382 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-16T19:16:32.382 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-16T19:16:32.382 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-16T19:16:32.382 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-16T19:16:32.383 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-16T19:16:32.383 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-16T19:16:32.383 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-16T19:16:32.383 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-16T19:16:32.383 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-16T19:16:32.384 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-16T19:16:32.384 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-16T19:16:32.384 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-16T19:16:32.384 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-16T19:16:32.384 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-16T19:16:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-16T19:16:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-16T19:16:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-16T19:16:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-16T19:16:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-16T19:16:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-16T19:16:32.386 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-16T19:16:32.386 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-16T19:16:32.386 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-16T19:16:32.386 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-16T19:16:32.386 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-16T19:16:32.387 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-16T19:16:32.387 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-16T19:16:32.387 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-16T19:16:32.387 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-16T19:16:32.387 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-16T19:16:32.388 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-16T19:16:32.388 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-16T19:16:32.388 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-16T19:16:32.388 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-16T19:16:32.388 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-16T19:16:32.388 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-16T19:16:32.389 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-16T19:16:32.389 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-16T19:16:32.389 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-16T19:16:32.389 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-16T19:16:32.389 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-16T19:16:32.390 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-16T19:16:32.390 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-16T19:16:32.390 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-16T19:16:32.390 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-16T19:16:32.390 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-16T19:16:32.391 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-16T19:16:32.391 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-16T19:16:32.391 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-16T19:16:32.391 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-16T19:16:32.391 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-16T19:16:32.391 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-16T19:16:32.392 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-16T19:16:32.392 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-16T19:16:32.392 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-16T19:16:32.392 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-16T19:16:32.392 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-16T19:16:32.393 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-16T19:16:32.393 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-16T19:16:32.393 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-16T19:16:32.393 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-16T19:16:32.393 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-16T19:16:32.394 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-16T19:16:32.394 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-16T19:16:32.394 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-16T19:16:32.394 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-16T19:16:32.394 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-16T19:16:32.395 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-16T19:16:32.395 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-16T19:16:32.395 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-16T19:16:32.395 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-16T19:16:32.395 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-16T19:16:32.395 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-16T19:16:32.396 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-16T19:16:32.396 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-16T19:16:32.396 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-16T19:16:32.396 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-16T19:16:32.396 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-16T19:16:32.396 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-16T19:16:32.397 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-16T19:16:32.397 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-16T19:16:32.397 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-16T19:16:32.397 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-16T19:16:32.397 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-16T19:16:32.397 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-16T19:16:32.398 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-16T19:16:32.398 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-16T19:16:32.398 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-16T19:16:32.398 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-16T19:16:32.398 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-16T19:16:32.399 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-16T19:16:32.399 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-16T19:16:32.399 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-16T19:16:32.399 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-16T19:16:32.399 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-16T19:16:32.400 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-16T19:16:32.400 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-16T19:16:32.400 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-16T19:16:32.400 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-16T19:16:32.400 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-16T19:16:32.400 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-16T19:16:32.401 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-16T19:16:32.401 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-16T19:16:32.401 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-16T19:16:32.401 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-16T19:16:32.401 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-16T19:16:32.402 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-16T19:16:32.402 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-16T19:16:32.402 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-16T19:16:32.402 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-16T19:16:32.402 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-16T19:16:32.403 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-16T19:16:32.403 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-16T19:16:32.403 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-16T19:16:32.403 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-16T19:16:32.403 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-16T19:16:32.403 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-16T19:16:32.404 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-16T19:16:32.404 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-16T19:16:32.404 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-16T19:16:32.404 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-16T19:16:32.404 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-16T19:16:32.404 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-16T19:16:32.405 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-16T19:16:32.405 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-16T19:16:32.405 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-16T19:16:32.405 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-16T19:16:32.405 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-16T19:16:32.406 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-16T19:16:32.406 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-16T19:16:32.406 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-16T19:16:32.406 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-16T19:16:32.406 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-16T19:16:32.406 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-16T19:16:32.407 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-16T19:16:32.407 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-16T19:16:32.407 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-16T19:16:32.407 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-16T19:16:32.407 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-16T19:16:32.408 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-16T19:16:32.408 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-16T19:16:32.408 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-16T19:16:32.408 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-16T19:16:32.408 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-16T19:16:32.408 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-16T19:16:32.409 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-16T19:16:32.409 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-16T19:16:32.409 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-16T19:16:32.409 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-16T19:16:32.409 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-16T19:16:32.410 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-16T19:16:32.410 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-16T19:16:32.410 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-16T19:16:32.410 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-16T19:16:32.410 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-16T19:16:32.411 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-16T19:16:32.411 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-16T19:16:32.411 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-16T19:16:32.411 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-16T19:16:32.411 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-16T19:16:32.411 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-16T19:16:32.412 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-16T19:16:32.412 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-16T19:16:32.412 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-16T19:16:32.412 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-16T19:16:32.412 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-16T19:16:32.413 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-16T19:16:32.413 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-16T19:16:32.413 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-16T19:16:32.413 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-16T19:16:32.413 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-16T19:16:32.414 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-16T19:16:32.414 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-16T19:16:32.414 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-16T19:16:32.414 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-16T19:16:32.414 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-16T19:16:32.415 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-16T19:16:32.415 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-16T19:16:32.415 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-16T19:16:32.415 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-16T19:16:32.415 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-16T19:16:32.416 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-16T19:16:32.416 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-16T19:16:32.416 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-16T19:16:32.416 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-16T19:16:32.416 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-16T19:16:32.417 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-16T19:16:32.417 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-16T19:16:32.417 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-16T19:16:32.417 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-16T19:16:32.417 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-16T19:16:32.417 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-16T19:16:32.418 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-16T19:16:32.418 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-16T19:16:32.418 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-16T19:16:32.418 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-16T19:16:32.418 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-16T19:16:32.419 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-16T19:16:32.419 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-16T19:16:32.419 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-16T19:16:32.419 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-16T19:16:32.419 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-16T19:16:32.420 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-16T19:16:32.420 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-16T19:16:32.420 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-16T19:16:32.420 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-16T19:16:32.420 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-16T19:16:32.420 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-16T19:16:32.421 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-16T19:16:32.421 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-16T19:16:32.421 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-16T19:16:32.421 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-16T19:16:32.421 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-16T19:16:32.422 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-16T19:16:32.422 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-16T19:16:32.422 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-16T19:16:32.422 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-16T19:16:32.422 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-16T19:16:32.423 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-16T19:16:32.423 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-16T19:16:32.423 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-16T19:16:32.423 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-16T19:16:32.423 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-16T19:16:32.423 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-16T19:16:32.424 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-16T19:16:32.424 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-16T19:16:32.424 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-16T19:16:32.424 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-16T19:16:32.424 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-16T19:16:32.425 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-16T19:16:32.425 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-16T19:16:32.425 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-16T19:16:32.425 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-16T19:16:32.425 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-16T19:16:32.426 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-16T19:16:32.426 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-16T19:16:32.426 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-16T19:16:32.426 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-16T19:16:32.426 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-16T19:16:32.427 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-16T19:16:32.427 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-16T19:16:32.427 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-16T19:16:32.427 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-16T19:16:32.427 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-16T19:16:32.427 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-16T19:16:32.428 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-16T19:16:32.428 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-16T19:16:32.428 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-16T19:16:32.428 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-16T19:16:32.428 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-16T19:16:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-16T19:16:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-16T19:16:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-16T19:16:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-16T19:16:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-16T19:16:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-16T19:16:32.430 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-16T19:16:32.430 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-16T19:16:32.430 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-16T19:16:32.430 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-16T19:16:32.430 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-16T19:16:32.431 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-16T19:16:32.431 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-16T19:16:32.431 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-16T19:16:32.431 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-16T19:16:32.431 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-16T19:16:32.432 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-16T19:16:32.432 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-16T19:16:32.432 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-16T19:16:32.432 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-16T19:16:32.432 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-16T19:16:32.433 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-16T19:16:32.433 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-16T19:16:32.433 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-16T19:16:32.433 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-16T19:16:32.433 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-16T19:16:32.434 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-16T19:16:32.434 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-16T19:16:32.434 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-16T19:16:32.434 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-16T19:16:32.434 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-16T19:16:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-16T19:16:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-16T19:16:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-16T19:16:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-16T19:16:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-16T19:16:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-16T19:16:32.436 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-16T19:16:32.436 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-16T19:16:32.436 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-16T19:16:32.436 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-16T19:16:32.436 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-16T19:16:32.437 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-16T19:16:32.437 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-16T19:16:32.437 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-16T19:16:32.437 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-16T19:16:32.437 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-16T19:16:32.438 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-16T19:16:32.438 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-16T19:16:32.438 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-16T19:16:32.438 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-16T19:16:32.438 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-16T19:16:32.438 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-16T19:16:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-16T19:16:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-16T19:16:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-16T19:16:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-16T19:16:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-16T19:16:32.440 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-16T19:16:32.440 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-16T19:16:32.440 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-16T19:16:32.440 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-16T19:16:32.440 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-16T19:16:32.441 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-16T19:16:32.441 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-16T19:16:32.441 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-16T19:16:32.441 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-16T19:16:32.441 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-16T19:16:32.441 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-16T19:16:32.442 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-16T19:16:32.442 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-16T19:16:32.442 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-16T19:16:32.442 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-16T19:16:32.442 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-16T19:16:32.443 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-16T19:16:32.443 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-16T19:16:32.443 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-16T19:16:32.443 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-16T19:16:32.443 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-16T19:16:32.443 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-16T19:16:32.444 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-16T19:16:32.444 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-16T19:16:32.444 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-16T19:16:32.444 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-16T19:16:32.444 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-16T19:16:32.445 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-16T19:16:32.445 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-16T19:16:32.445 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-16T19:16:32.445 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-16T19:16:32.445 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-16T19:16:32.445 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-16T19:16:32.446 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-16T19:16:32.446 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-16T19:16:32.446 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-16T19:16:32.446 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-16T19:16:32.446 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-16T19:16:32.447 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-16T19:16:32.447 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-16T19:16:32.447 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-16T19:16:32.447 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-16T19:16:32.447 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-16T19:16:32.448 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-16T19:16:32.448 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-16T19:16:32.448 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-16T19:16:32.448 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-16T19:16:32.448 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-16T19:16:32.448 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-16T19:16:32.449 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-16T19:16:32.449 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-16T19:16:32.449 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-16T19:16:32.449 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-16T19:16:32.449 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-16T19:16:32.450 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-16T19:16:32.450 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-16T19:16:32.450 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-16T19:16:32.450 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-16T19:16:32.450 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-16T19:16:32.450 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-16T19:16:32.451 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-16T19:16:32.451 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-16T19:16:32.451 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-16T19:16:32.451 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-16T19:16:32.451 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-16T19:16:32.452 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-16T19:16:32.452 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-16T19:16:32.452 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-16T19:16:32.452 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-16T19:16:32.452 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-16T19:16:32.452 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-16T19:16:32.453 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-16T19:16:32.453 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-16T19:16:32.453 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-16T19:16:32.453 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-16T19:16:32.453 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-16T19:16:32.454 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-16T19:16:32.454 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-16T19:16:32.454 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-16T19:16:32.454 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-16T19:16:32.454 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-16T19:16:32.455 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-16T19:16:32.455 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-16T19:16:32.455 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-16T19:16:32.455 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-16T19:16:32.455 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-16T19:16:32.455 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-16T19:16:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-16T19:16:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-16T19:16:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-16T19:16:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-16T19:16:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-16T19:16:32.457 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-16T19:16:32.457 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-16T19:16:32.457 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-16T19:16:32.457 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-16T19:16:32.457 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-16T19:16:32.458 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-16T19:16:32.458 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-16T19:16:32.458 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-16T19:16:32.458 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-16T19:16:32.458 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-16T19:16:32.458 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-16T19:16:32.459 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-16T19:16:32.459 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-16T19:16:32.459 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-16T19:16:32.459 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-16T19:16:32.459 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-16T19:16:32.460 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-16T19:16:32.460 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-16T19:16:32.460 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-16T19:16:32.460 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-16T19:16:32.460 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-16T19:16:32.460 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-16T19:16:32.461 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-16T19:16:32.461 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-16T19:16:32.461 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-16T19:16:32.461 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-16T19:16:32.461 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-16T19:16:32.461 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-16T19:16:32.462 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-16T19:16:32.462 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-16T19:16:32.462 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-16T19:16:32.462 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-16T19:16:32.462 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-16T19:16:32.463 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-16T19:16:32.463 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-16T19:16:32.463 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-16T19:16:32.463 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-16T19:16:32.463 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-16T19:16:32.464 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-16T19:16:32.464 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-16T19:16:32.464 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-16T19:16:32.464 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-16T19:16:32.464 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-16T19:16:32.465 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-16T19:16:32.465 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-16T19:16:32.465 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-16T19:16:32.465 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-16T19:16:32.465 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-16T19:16:32.465 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-16T19:16:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-16T19:16:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-16T19:16:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-16T19:16:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-16T19:16:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-16T19:16:32.466 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-16T19:16:32.467 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-16T19:16:32.467 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-16T19:16:32.467 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-16T19:16:32.467 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-16T19:16:32.467 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-16T19:16:32.467 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-16T19:16:32.468 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-16T19:16:32.468 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-16T19:16:32.468 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-16T19:16:32.468 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-16T19:16:32.468 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-16T19:16:32.468 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-16T19:16:32.469 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-16T19:16:32.470 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-16T19:16:32.470 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-16T19:16:32.470 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-16T19:16:32.470 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-16T19:16:32.470 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-16T19:16:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-16T19:16:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-16T19:16:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-16T19:16:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-16T19:16:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-16T19:16:32.471 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-16T19:16:32.472 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-16T19:16:32.472 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-16T19:16:32.472 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-16T19:16:32.472 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-16T19:16:32.472 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-16T19:16:32.472 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-16T19:16:32.473 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-16T19:16:32.473 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-16T19:16:32.473 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-16T19:16:32.473 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-16T19:16:32.473 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-16T19:16:32.473 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-16T19:16:32.474 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-16T19:16:32.474 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-16T19:16:32.474 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-16T19:16:32.474 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-16T19:16:32.474 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-16T19:16:32.475 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-16T19:16:32.475 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-16T19:16:32.475 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-16T19:16:32.475 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-16T19:16:32.475 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-16T19:16:32.475 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-16T19:16:32.476 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-16T19:16:32.476 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-16T19:16:32.476 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-16T19:16:32.476 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-16T19:16:32.476 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-16T19:16:32.476 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-16T19:16:32.477 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-16T19:16:32.477 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-16T19:16:32.477 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-16T19:16:32.477 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-16T19:16:32.477 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-16T19:16:32.477 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-16T19:16:32.478 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-16T19:16:32.478 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-16T19:16:32.478 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-16T19:16:32.478 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-16T19:16:32.478 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-16T19:16:32.479 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-16T19:16:32.479 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-16T19:16:32.479 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-16T19:16:32.479 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-16T19:16:32.479 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-16T19:16:32.479 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-16T19:16:32.481 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-16T19:16:32.482 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-16T19:16:32.482 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-16T19:16:32.482 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-16T19:16:32.482 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-16T19:16:32.482 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-16T19:16:32.483 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-16T19:16:32.483 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-16T19:16:32.483 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-16T19:16:32.483 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-16T19:16:32.483 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-16T19:16:32.484 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-16T19:16:32.484 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-16T19:16:32.484 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-16T19:16:32.484 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-16T19:16:32.484 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-16T19:16:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-16T19:16:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-16T19:16:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-16T19:16:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-16T19:16:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-16T19:16:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-16T19:16:32.486 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-16T19:16:32.486 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-16T19:16:32.486 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-16T19:16:32.486 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-16T19:16:32.486 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-16T19:16:32.487 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-16T19:16:32.487 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-16T19:16:32.487 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-16T19:16:32.487 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-16T19:16:32.487 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-16T19:16:32.487 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-16T19:16:32.488 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-16T19:16:32.488 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-16T19:16:32.488 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-16T19:16:32.488 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-16T19:16:32.488 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-16T19:16:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-16T19:16:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-16T19:16:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-16T19:16:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-16T19:16:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-16T19:16:32.490 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-16T19:16:32.490 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-16T19:16:32.490 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-16T19:16:32.490 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-16T19:16:32.490 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-16T19:16:32.491 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-16T19:16:32.491 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-16T19:16:32.491 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-16T19:16:32.491 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-16T19:16:32.491 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-16T19:16:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-16T19:16:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-16T19:16:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-16T19:16:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-16T19:16:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-16T19:16:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-16T19:16:32.493 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-16T19:16:32.493 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-16T19:16:32.493 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-16T19:16:32.493 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-16T19:16:32.493 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-16T19:16:32.494 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-16T19:16:32.494 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-16T19:16:32.494 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-16T19:16:32.494 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-16T19:16:32.494 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-16T19:16:32.495 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-16T19:16:32.495 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-16T19:16:32.495 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-16T19:16:32.495 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-16T19:16:32.495 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-16T19:16:32.495 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-16T19:16:32.496 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-16T19:16:32.496 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-16T19:16:32.496 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-16T19:16:32.496 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-16T19:16:32.496 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-16T19:16:32.497 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-16T19:16:32.497 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-16T19:16:32.497 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-16T19:16:32.497 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-16T19:16:32.497 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-16T19:16:32.497 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-16T19:16:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-16T19:16:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-16T19:16:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-16T19:16:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-16T19:16:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-16T19:16:32.499 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-16T19:16:32.499 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-16T19:16:32.499 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-16T19:16:32.499 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-16T19:16:32.499 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-16T19:16:32.499 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-16T19:16:32.500 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-16T19:16:32.500 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-16T19:16:32.500 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-16T19:16:32.500 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-16T19:16:32.500 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-16T19:16:32.501 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-16T19:16:32.501 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-16T19:16:32.501 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-16T19:16:32.501 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-16T19:16:32.501 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-16T19:16:32.501 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-16T19:16:32.502 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-16T19:16:32.502 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-16T19:16:32.502 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-16T19:16:32.502 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-16T19:16:32.502 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-16T19:16:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-16T19:16:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-16T19:16:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-16T19:16:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-16T19:16:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-16T19:16:32.504 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-16T19:16:32.504 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-16T19:16:32.504 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-16T19:16:32.504 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-16T19:16:32.504 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-16T19:16:32.504 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-16T19:16:32.505 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-16T19:16:32.505 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-16T19:16:32.505 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-16T19:16:32.505 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-16T19:16:32.505 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-16T19:16:32.506 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-16T19:16:32.506 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-16T19:16:32.506 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-16T19:16:32.506 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-16T19:16:32.506 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-16T19:16:32.507 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-16T19:16:32.507 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-16T19:16:32.507 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-16T19:16:32.507 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-16T19:16:32.507 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-16T19:16:32.507 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-16T19:16:32.508 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-16T19:16:32.508 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-16T19:16:32.508 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-16T19:16:32.508 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-16T19:16:32.508 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-16T19:16:32.509 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-16T19:16:32.509 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-16T19:16:32.509 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-16T19:16:32.509 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-16T19:16:32.509 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-16T19:16:32.509 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-16T19:16:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-16T19:16:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-16T19:16:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-16T19:16:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-16T19:16:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-16T19:16:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-16T19:16:32.511 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-16T19:16:32.511 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-16T19:16:32.511 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-16T19:16:32.511 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-16T19:16:32.512 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-16T19:16:32.512 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-16T19:16:32.512 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-16T19:16:32.512 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-16T19:16:32.512 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-16T19:16:32.512 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-16T19:16:32.513 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-16T19:16:32.513 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-16T19:16:32.513 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-16T19:16:32.513 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-16T19:16:32.513 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-16T19:16:32.514 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-16T19:16:32.514 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-16T19:16:32.514 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-16T19:16:32.514 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-16T19:16:32.514 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-16T19:16:32.515 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-16T19:16:32.515 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-16T19:16:32.515 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-16T19:16:32.515 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-16T19:16:32.515 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-16T19:16:32.515 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-16T19:16:32.516 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-16T19:16:32.516 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-16T19:16:32.516 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-16T19:16:32.516 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-16T19:16:32.516 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-16T19:16:32.517 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-16T19:16:32.517 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-16T19:16:32.517 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-16T19:16:32.517 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-16T19:16:32.517 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-16T19:16:32.518 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-16T19:16:32.518 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-16T19:16:32.518 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-16T19:16:32.518 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-16T19:16:32.518 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-16T19:16:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-16T19:16:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-16T19:16:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-16T19:16:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-16T19:16:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-16T19:16:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-16T19:16:32.520 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-16T19:16:32.520 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-16T19:16:32.520 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-16T19:16:32.520 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-16T19:16:32.520 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-16T19:16:32.520 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-16T19:16:32.521 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-16T19:16:32.521 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-16T19:16:32.521 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-16T19:16:32.521 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-16T19:16:32.521 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-16T19:16:32.522 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-16T19:16:32.522 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-16T19:16:32.522 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-16T19:16:32.522 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-16T19:16:32.522 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-16T19:16:32.522 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-16T19:16:32.523 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-16T19:16:32.523 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-16T19:16:32.523 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-16T19:16:32.523 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-16T19:16:32.523 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-16T19:16:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-16T19:16:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-16T19:16:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-16T19:16:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-16T19:16:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-16T19:16:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-16T19:16:32.525 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-16T19:16:32.525 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-16T19:16:32.525 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-16T19:16:32.525 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-16T19:16:32.525 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-16T19:16:32.526 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-16T19:16:32.526 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-16T19:16:32.526 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-16T19:16:32.526 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-16T19:16:32.526 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-16T19:16:32.526 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-16T19:16:32.527 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-16T19:16:32.527 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-16T19:16:32.527 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-16T19:16:32.527 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-16T19:16:32.527 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-16T19:16:32.528 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-16T19:16:32.528 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-16T19:16:32.528 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-16T19:16:32.528 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-16T19:16:32.528 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-16T19:16:32.528 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-16T19:16:32.529 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-16T19:16:32.529 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-16T19:16:32.529 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-16T19:16:32.529 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-16T19:16:32.529 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-16T19:16:32.530 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-16T19:16:32.530 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-16T19:16:32.530 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-16T19:16:32.530 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-16T19:16:32.530 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-16T19:16:32.531 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-16T19:16:32.531 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-16T19:16:32.531 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-16T19:16:32.531 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-16T19:16:32.531 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-16T19:16:32.531 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-16T19:16:32.532 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-16T19:16:32.532 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-16T19:16:32.532 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-16T19:16:32.532 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-16T19:16:32.532 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-16T19:16:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-16T19:16:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-16T19:16:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-16T19:16:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-16T19:16:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-16T19:16:32.533 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-16T19:16:32.534 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-16T19:16:32.534 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-16T19:16:32.534 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-16T19:16:32.534 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-16T19:16:32.534 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-16T19:16:32.535 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-16T19:16:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-16T19:16:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-16T19:16:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-16T19:16:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-16T19:16:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-16T19:16:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-16T19:16:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-16T19:16:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-16T19:16:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-16T19:16:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-16T19:16:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-16T19:16:32.538 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-16T19:16:32.538 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-16T19:16:32.538 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-16T19:16:32.538 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-16T19:16:32.538 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-16T19:16:32.539 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-16T19:16:32.540 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-16T19:16:32.540 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-16T19:16:32.540 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-16T19:16:32.540 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-16T19:16:32.540 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-16T19:16:32.540 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-16T19:16:32.541 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-16T19:16:32.541 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-16T19:16:32.541 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-16T19:16:32.541 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-16T19:16:32.541 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-16T19:16:32.541 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-16T19:16:32.542 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-16T19:16:32.542 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-16T19:16:32.542 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-16T19:16:32.542 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-16T19:16:32.542 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-16T19:16:32.543 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-16T19:16:32.543 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-16T19:16:32.543 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-16T19:16:32.543 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-16T19:16:32.543 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-16T19:16:32.543 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-16T19:16:32.544 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-16T19:16:32.544 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-16T19:16:32.544 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-16T19:16:32.544 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-16T19:16:32.544 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-16T19:16:32.544 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-16T19:16:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-16T19:16:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-16T19:16:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-16T19:16:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-16T19:16:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-16T19:16:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-16T19:16:32.546 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-16T19:16:32.546 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-16T19:16:32.546 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-16T19:16:32.546 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-16T19:16:32.546 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-16T19:16:32.547 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-16T19:16:32.547 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-16T19:16:32.547 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-16T19:16:32.547 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-16T19:16:32.547 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-16T19:16:32.547 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-16T19:16:32.548 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-16T19:16:32.548 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-16T19:16:32.548 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-16T19:16:32.548 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-16T19:16:32.548 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-16T19:16:32.549 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-16T19:16:32.549 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-16T19:16:32.549 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-16T19:16:32.549 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-16T19:16:32.549 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-16T19:16:32.549 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-16T19:16:32.550 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-16T19:16:32.550 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-16T19:16:32.550 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-16T19:16:32.550 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-16T19:16:32.550 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-16T19:16:32.551 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-16T19:16:32.551 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-16T19:16:32.551 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-16T19:16:32.551 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-16T19:16:32.551 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-16T19:16:32.551 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-16T19:16:32.552 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-16T19:16:32.552 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-16T19:16:32.552 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-16T19:16:32.552 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-16T19:16:32.552 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-16T19:16:32.553 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-16T19:16:32.553 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-16T19:16:32.553 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-16T19:16:32.553 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-16T19:16:32.553 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-16T19:16:32.553 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-16T19:16:32.554 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-16T19:16:32.554 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-16T19:16:32.554 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-16T19:16:32.554 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-16T19:16:32.554 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-16T19:16:32.555 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-16T19:16:32.555 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-16T19:16:32.555 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-16T19:16:32.555 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-16T19:16:32.555 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-16T19:16:32.555 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-16T19:16:32.556 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-16T19:16:32.556 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-16T19:16:32.556 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-16T19:16:32.556 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-16T19:16:32.556 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-16T19:16:32.557 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-16T19:16:32.557 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-16T19:16:32.557 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-16T19:16:32.557 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-16T19:16:32.557 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-16T19:16:32.557 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-16T19:16:32.558 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-16T19:16:32.558 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-16T19:16:32.558 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-16T19:16:32.558 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-16T19:16:32.558 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-16T19:16:32.558 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-16T19:16:32.559 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-16T19:16:32.559 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-16T19:16:32.559 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-16T19:16:32.559 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-16T19:16:32.559 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-16T19:16:32.560 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-16T19:16:32.560 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-16T19:16:32.560 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-16T19:16:32.560 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-16T19:16:32.560 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-16T19:16:32.560 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-16T19:16:32.561 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-16T19:16:32.561 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-16T19:16:32.561 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-16T19:16:32.561 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-16T19:16:32.561 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-16T19:16:32.562 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-16T19:16:32.562 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-16T19:16:32.562 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-16T19:16:32.562 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-16T19:16:32.562 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-16T19:16:32.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-16T19:16:32.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-16T19:16:32.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-16T19:16:32.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-16T19:16:32.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-16T19:16:32.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-16T19:16:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-16T19:16:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-16T19:16:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-16T19:16:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-16T19:16:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-16T19:16:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-16T19:16:32.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-16T19:16:32.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-16T19:16:32.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-16T19:16:32.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-16T19:16:32.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-16T19:16:32.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-16T19:16:32.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-16T19:16:32.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-16T19:16:32.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-16T19:16:32.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-16T19:16:32.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-16T19:16:32.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-16T19:16:32.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-16T19:16:32.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-16T19:16:32.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-16T19:16:32.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-16T19:16:32.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-16T19:16:32.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-16T19:16:32.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-16T19:16:32.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-16T19:16:32.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-16T19:16:32.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-16T19:16:32.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-16T19:16:32.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-16T19:16:32.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-16T19:16:32.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-16T19:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-16T19:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-16T19:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-16T19:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-16T19:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-16T19:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-16T19:16:32.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-16T19:16:32.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-16T19:16:32.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-16T19:16:32.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-16T19:16:32.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-16T19:16:32.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-16T19:16:32.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-16T19:16:32.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-16T19:16:32.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-16T19:16:32.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-16T19:16:32.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-16T19:16:32.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-16T19:16:32.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-16T19:16:32.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-16T19:16:32.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-16T19:16:32.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-16T19:16:32.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-16T19:16:32.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-16T19:16:32.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-16T19:16:32.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-16T19:16:32.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-16T19:16:32.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-16T19:16:32.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-16T19:16:32.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-16T19:16:32.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-16T19:16:32.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-16T19:16:32.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-16T19:16:32.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-16T19:16:32.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-16T19:16:32.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-16T19:16:32.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-16T19:16:32.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-16T19:16:32.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-16T19:16:32.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-16T19:16:32.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-16T19:16:32.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-16T19:16:32.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-16T19:16:32.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-16T19:16:32.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-16T19:16:32.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-16T19:16:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-16T19:16:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-16T19:16:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-16T19:16:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-16T19:16:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-16T19:16:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-16T19:16:32.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-16T19:16:32.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-16T19:16:32.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-16T19:16:32.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-16T19:16:32.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-16T19:16:32.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-16T19:16:32.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-16T19:16:32.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-16T19:16:32.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-16T19:16:32.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-16T19:16:32.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-16T19:16:32.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-16T19:16:32.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-16T19:16:32.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-16T19:16:32.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-16T19:16:32.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-16T19:16:32.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-16T19:16:32.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-16T19:16:32.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-16T19:16:32.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-16T19:16:32.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-16T19:16:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-16T19:16:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-16T19:16:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-16T19:16:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-16T19:16:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-16T19:16:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-16T19:16:32.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-16T19:16:32.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-16T19:16:32.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-16T19:16:32.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-16T19:16:32.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-16T19:16:32.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-16T19:16:32.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-16T19:16:32.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-16T19:16:32.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-16T19:16:32.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-16T19:16:32.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-16T19:16:32.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-16T19:16:32.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-16T19:16:32.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-16T19:16:32.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-16T19:16:32.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-16T19:16:32.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-16T19:16:32.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-16T19:16:32.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-16T19:16:32.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-16T19:16:32.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-16T19:16:32.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-16T19:16:32.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-16T19:16:32.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-16T19:16:32.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-16T19:16:32.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-16T19:16:32.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-16T19:16:32.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-16T19:16:32.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-16T19:16:32.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-16T19:16:32.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-16T19:16:32.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-16T19:16:32.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-16T19:16:32.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-16T19:16:32.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-16T19:16:32.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-16T19:16:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-16T19:16:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-16T19:16:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-16T19:16:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-16T19:16:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-16T19:16:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-16T19:16:32.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-16T19:16:32.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-16T19:16:32.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-16T19:16:32.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-16T19:16:32.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-16T19:16:32.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-16T19:16:32.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-16T19:16:32.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-16T19:16:32.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-16T19:16:32.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-16T19:16:32.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-16T19:16:32.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-16T19:16:32.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-16T19:16:32.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-16T19:16:32.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-16T19:16:32.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-16T19:16:32.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-16T19:16:32.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-16T19:16:32.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-16T19:16:32.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-16T19:16:32.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-16T19:16:32.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-16T19:16:32.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-16T19:16:32.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-16T19:16:32.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-16T19:16:32.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-16T19:16:32.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-16T19:16:32.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-16T19:16:32.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-16T19:16:32.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-16T19:16:32.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-16T19:16:32.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-16T19:16:32.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-16T19:16:32.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-16T19:16:32.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-16T19:16:32.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-16T19:16:32.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-16T19:16:32.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-16T19:16:32.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-16T19:16:32.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-16T19:16:32.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-16T19:16:32.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-16T19:16:32.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-16T19:16:32.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-16T19:16:32.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-16T19:16:32.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-16T19:16:32.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-16T19:16:32.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-16T19:16:32.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-16T19:16:32.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-16T19:16:32.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-16T19:16:32.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-16T19:16:32.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-16T19:16:32.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-16T19:16:32.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-16T19:16:32.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-16T19:16:32.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-16T19:16:32.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-16T19:16:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-16T19:16:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-16T19:16:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-16T19:16:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-16T19:16:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-16T19:16:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-16T19:16:32.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-16T19:16:32.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-16T19:16:32.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-16T19:16:32.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-16T19:16:32.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-16T19:16:32.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-16T19:16:32.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-16T19:16:32.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-16T19:16:32.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-16T19:16:32.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-16T19:16:32.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-16T19:16:32.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-16T19:16:32.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-16T19:16:32.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-16T19:16:32.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-16T19:16:32.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-16T19:16:32.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-16T19:16:32.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-16T19:16:32.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-16T19:16:32.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-16T19:16:32.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-16T19:16:32.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-16T19:16:32.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-16T19:16:32.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-16T19:16:32.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-16T19:16:32.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-16T19:16:32.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-16T19:16:32.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-16T19:16:32.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-16T19:16:32.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-16T19:16:32.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-16T19:16:32.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-16T19:16:32.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-16T19:16:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-16T19:16:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-16T19:16:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-16T19:16:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-16T19:16:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-16T19:16:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-16T19:16:32.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-16T19:16:32.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-16T19:16:32.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-16T19:16:32.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-16T19:16:32.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-16T19:16:32.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-16T19:16:32.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-16T19:16:32.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-16T19:16:32.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-16T19:16:32.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-16T19:16:32.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-16T19:16:32.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-16T19:16:32.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-16T19:16:32.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-16T19:16:32.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-16T19:16:32.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-16T19:16:32.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-16T19:16:32.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-16T19:16:32.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-16T19:16:32.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-16T19:16:32.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-16T19:16:32.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-16T19:16:32.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-16T19:16:32.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-16T19:16:32.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-16T19:16:32.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-16T19:16:32.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-16T19:16:32.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-16T19:16:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-16T19:16:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-16T19:16:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-16T19:16:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-16T19:16:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-16T19:16:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-16T19:16:32.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-16T19:16:32.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-16T19:16:32.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-16T19:16:32.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-16T19:16:32.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-16T19:16:32.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-16T19:16:32.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-16T19:16:32.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-16T19:16:32.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-16T19:16:32.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-16T19:16:32.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-16T19:16:32.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-16T19:16:32.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-16T19:16:32.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-16T19:16:32.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-16T19:16:32.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-16T19:16:32.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-16T19:16:32.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-16T19:16:32.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-16T19:16:32.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-16T19:16:32.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-16T19:16:32.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-16T19:16:32.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-16T19:16:32.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-16T19:16:32.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-16T19:16:32.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-16T19:16:32.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-16T19:16:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-16T19:16:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-16T19:16:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-16T19:16:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-16T19:16:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-16T19:16:32.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-16T19:16:32.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-16T19:16:32.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-16T19:16:32.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-16T19:16:32.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-16T19:16:32.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-16T19:16:32.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-16T19:16:32.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-16T19:16:32.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-16T19:16:32.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-16T19:16:32.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-16T19:16:32.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-16T19:16:32.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-16T19:16:32.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-16T19:16:32.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-16T19:16:32.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-16T19:16:32.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-16T19:16:32.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-16T19:16:32.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-16T19:16:32.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-16T19:16:32.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-16T19:16:32.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-16T19:16:32.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-16T19:16:32.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-16T19:16:32.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-16T19:16:32.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-16T19:16:32.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-16T19:16:32.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-16T19:16:32.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-16T19:16:32.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-16T19:16:32.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-16T19:16:32.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-16T19:16:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-16T19:16:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-16T19:16:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-16T19:16:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-16T19:16:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-16T19:16:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-16T19:16:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-16T19:16:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-16T19:16:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-16T19:16:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-16T19:16:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-16T19:16:32.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-16T19:16:32.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-16T19:16:32.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-16T19:16:32.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-16T19:16:32.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-16T19:16:32.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-16T19:16:32.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-16T19:16:32.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-16T19:16:32.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-16T19:16:32.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-16T19:16:32.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-16T19:16:32.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-16T19:16:32.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-16T19:16:32.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-16T19:16:32.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-16T19:16:32.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-16T19:16:32.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-16T19:16:32.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-16T19:16:32.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-16T19:16:32.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-16T19:16:32.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-16T19:16:32.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-16T19:16:32.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-16T19:16:32.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-16T19:16:32.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-16T19:16:32.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-16T19:16:32.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-16T19:16:32.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-16T19:16:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-16T19:16:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-16T19:16:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-16T19:16:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-16T19:16:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-16T19:16:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-16T19:16:32.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-16T19:16:32.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-16T19:16:32.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-16T19:16:32.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-16T19:16:32.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-16T19:16:32.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-16T19:16:32.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-16T19:16:32.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-16T19:16:32.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-16T19:16:32.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-16T19:16:32.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-16T19:16:32.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-16T19:16:32.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-16T19:16:32.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-16T19:16:32.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-16T19:16:32.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-16T19:16:32.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-16T19:16:32.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-16T19:16:32.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-16T19:16:32.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-16T19:16:32.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-16T19:16:32.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-16T19:16:32.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-16T19:16:32.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-16T19:16:32.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-16T19:16:32.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-16T19:16:32.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-16T19:16:32.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-16T19:16:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-16T19:16:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-16T19:16:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-16T19:16:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-16T19:16:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-16T19:16:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-16T19:16:32.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-16T19:16:32.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-16T19:16:32.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-16T19:16:32.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-16T19:16:32.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-16T19:16:32.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-16T19:16:32.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-16T19:16:32.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-16T19:16:32.645 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.646 DEBUG:teuthology.orchestra.run.smithi110:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-16T19:16:32.669 INFO:teuthology.orchestra.run.smithi110.stdout:postinstall scriptlet (using /bin/sh): 2023-10-16T19:16:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-16T19:16:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:32.671 INFO:teuthology.orchestra.run.smithi110.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:32.671 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2023-10-16T19:16:32.671 INFO:teuthology.orchestra.run.smithi110.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-16T19:16:32.671 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-16T19:16:32.671 INFO:teuthology.orchestra.run.smithi110.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-16T19:16:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-16T19:16:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2023-10-16T19:16:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-16T19:16:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-16T19:16:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.673 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2023-10-16T19:16:32.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2023-10-16T19:16:32.750 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2023-10-16T19:16:32.750 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2023-10-16T19:16:32.750 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2023-10-16T19:16:32.750 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2023-10-16T19:16:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2023-10-16T19:16:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-16T19:16:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2023-10-16T19:16:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2023-10-16T19:16:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2023-10-16T19:16:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-16T19:16:32.752 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-16T19:16:32.752 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-16T19:16:32.752 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-16T19:16:32.752 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2023-10-16T19:16:32.752 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2023-10-16T19:16:32.753 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-16T19:16:32.753 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2023-10-16T19:16:32.753 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2023-10-16T19:16:32.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:16:32.753 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-16T19:16:32.753 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-16T19:16:32.754 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-16T19:16:32.754 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2023-10-16T19:16:32.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:16:32.754 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2023-10-16T19:16:32.755 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-16T19:16:32.756 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 6.6.0-rc5-g47672119149b 2023-10-16T19:16:32.756 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-16T19:16:33.372 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2023-10-16T19:16:34.773 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-16T19:16:34.806 INFO:teuthology.orchestra.run.smithi110.stderr:done 2023-10-16T19:16:34.808 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-10-16T19:16:34.823 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.IQYEx1e0Sr 2023-10-16T19:16:34.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IQYEx1e0Sr 2023-10-16T19:16:34.904 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.IQYEx1e0Sr 2023-10-16T19:16:35.046 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.IQYEx1e0Sr is 6KB 2023-10-16T19:16:35.094 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.IQYEx1e0Sr 2023-10-16T19:16:35.109 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2023-10-16T19:16:35.178 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-16T19:16:35.178 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-16T19:16:35.179 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-16T19:16:35.180 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-16T19:16:35.181 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-16T19:16:35.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2023-10-16T19:16:46.441 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-16T19:16:46.441 DEBUG:teuthology.orchestra.run.smithi057:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-16T19:16:46.507 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.507 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.507 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-16T19:16:46.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-16T19:16:46.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-16T19:16:46.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-16T19:16:46.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-16T19:16:46.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-16T19:16:46.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-16T19:16:46.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-16T19:16:46.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-16T19:16:46.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-16T19:16:46.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-16T19:16:46.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-16T19:16:46.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-16T19:16:46.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-16T19:16:46.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-16T19:16:46.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-16T19:16:46.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-16T19:16:46.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-16T19:16:46.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-16T19:16:46.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-16T19:16:46.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-16T19:16:46.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-16T19:16:46.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-16T19:16:46.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-16T19:16:46.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-16T19:16:46.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-16T19:16:46.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-16T19:16:46.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-16T19:16:46.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-16T19:16:46.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-16T19:16:46.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-16T19:16:46.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-16T19:16:46.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-16T19:16:46.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-16T19:16:46.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-16T19:16:46.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-16T19:16:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-16T19:16:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-16T19:16:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-16T19:16:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-16T19:16:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-16T19:16:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-16T19:16:46.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-16T19:16:46.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-16T19:16:46.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-16T19:16:46.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-16T19:16:46.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-16T19:16:46.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-16T19:16:46.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-16T19:16:46.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-16T19:16:46.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-16T19:16:46.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-16T19:16:46.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-16T19:16:46.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-16T19:16:46.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-16T19:16:46.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-16T19:16:46.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-16T19:16:46.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-16T19:16:46.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-16T19:16:46.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-16T19:16:46.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-16T19:16:46.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-16T19:16:46.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-16T19:16:46.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-16T19:16:46.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-16T19:16:46.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-16T19:16:46.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-16T19:16:46.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-16T19:16:46.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-16T19:16:46.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-16T19:16:46.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-16T19:16:46.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-16T19:16:46.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-16T19:16:46.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-16T19:16:46.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-16T19:16:46.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-16T19:16:46.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-16T19:16:46.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-16T19:16:46.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-16T19:16:46.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-16T19:16:46.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-16T19:16:46.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-16T19:16:46.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-16T19:16:46.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-16T19:16:46.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-16T19:16:46.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-16T19:16:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-16T19:16:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-16T19:16:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-16T19:16:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-16T19:16:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-16T19:16:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-16T19:16:46.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-16T19:16:46.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-16T19:16:46.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-16T19:16:46.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-16T19:16:46.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-16T19:16:46.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-16T19:16:46.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-16T19:16:46.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-16T19:16:46.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-16T19:16:46.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-16T19:16:46.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-16T19:16:46.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-16T19:16:46.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-16T19:16:46.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-16T19:16:46.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-16T19:16:46.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-16T19:16:46.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-16T19:16:46.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-16T19:16:46.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-16T19:16:46.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-16T19:16:46.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-16T19:16:46.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-16T19:16:46.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-16T19:16:46.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-16T19:16:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-16T19:16:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-16T19:16:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-16T19:16:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-16T19:16:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-16T19:16:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-16T19:16:46.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-16T19:16:46.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-16T19:16:46.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-16T19:16:46.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-16T19:16:46.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-16T19:16:46.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-16T19:16:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-16T19:16:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-16T19:16:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-16T19:16:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-16T19:16:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-16T19:16:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-16T19:16:46.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-16T19:16:46.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-16T19:16:46.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-16T19:16:46.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-16T19:16:46.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-16T19:16:46.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-16T19:16:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-16T19:16:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-16T19:16:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-16T19:16:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-16T19:16:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-16T19:16:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-16T19:16:46.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-16T19:16:46.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-16T19:16:46.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-16T19:16:46.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-16T19:16:46.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-16T19:16:46.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-16T19:16:46.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-16T19:16:46.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-16T19:16:46.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-16T19:16:46.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-16T19:16:46.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-16T19:16:46.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-16T19:16:46.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-16T19:16:46.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-16T19:16:46.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-16T19:16:46.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-16T19:16:46.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-16T19:16:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-16T19:16:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-16T19:16:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-16T19:16:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-16T19:16:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-16T19:16:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-16T19:16:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-16T19:16:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-16T19:16:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-16T19:16:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-16T19:16:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-16T19:16:46.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-16T19:16:46.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-16T19:16:46.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-16T19:16:46.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-16T19:16:46.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-16T19:16:46.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-16T19:16:46.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-16T19:16:46.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-16T19:16:46.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-16T19:16:46.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-16T19:16:46.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-16T19:16:46.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-16T19:16:46.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-16T19:16:46.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-16T19:16:46.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-16T19:16:46.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-16T19:16:46.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-16T19:16:46.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-16T19:16:46.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-16T19:16:46.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-16T19:16:46.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-16T19:16:46.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-16T19:16:46.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-16T19:16:46.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-16T19:16:46.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-16T19:16:46.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-16T19:16:46.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-16T19:16:46.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-16T19:16:46.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-16T19:16:46.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-16T19:16:46.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-16T19:16:46.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-16T19:16:46.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-16T19:16:46.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-16T19:16:46.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-16T19:16:46.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-16T19:16:46.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-16T19:16:46.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-16T19:16:46.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-16T19:16:46.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-16T19:16:46.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-16T19:16:46.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-16T19:16:46.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-16T19:16:46.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-16T19:16:46.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-16T19:16:46.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-16T19:16:46.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-16T19:16:46.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-16T19:16:46.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-16T19:16:46.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-16T19:16:46.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-16T19:16:46.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-16T19:16:46.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-16T19:16:46.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-16T19:16:46.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-16T19:16:46.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-16T19:16:46.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-16T19:16:46.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-16T19:16:46.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-16T19:16:46.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-16T19:16:46.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-16T19:16:46.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-16T19:16:46.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-16T19:16:46.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-16T19:16:46.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-16T19:16:46.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-16T19:16:46.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-16T19:16:46.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-16T19:16:46.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-16T19:16:46.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-16T19:16:46.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-16T19:16:46.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-16T19:16:46.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-16T19:16:46.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-16T19:16:46.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-16T19:16:46.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-16T19:16:46.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-16T19:16:46.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-16T19:16:46.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-16T19:16:46.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-16T19:16:46.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-16T19:16:46.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-16T19:16:46.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-16T19:16:46.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-16T19:16:46.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-16T19:16:46.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-16T19:16:46.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-16T19:16:46.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-16T19:16:46.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-16T19:16:46.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-16T19:16:46.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-16T19:16:46.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-16T19:16:46.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-16T19:16:46.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-16T19:16:46.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-16T19:16:46.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-16T19:16:46.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-16T19:16:46.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-16T19:16:46.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-16T19:16:46.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-16T19:16:46.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-16T19:16:46.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-16T19:16:46.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-16T19:16:46.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-16T19:16:46.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-16T19:16:46.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-16T19:16:46.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-16T19:16:46.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-16T19:16:46.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-16T19:16:46.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-16T19:16:46.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-16T19:16:46.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-16T19:16:46.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-16T19:16:46.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-16T19:16:46.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-16T19:16:46.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-16T19:16:46.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-16T19:16:46.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-16T19:16:46.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-16T19:16:46.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-16T19:16:46.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-16T19:16:46.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-16T19:16:46.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-16T19:16:46.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-16T19:16:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-16T19:16:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-16T19:16:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-16T19:16:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-16T19:16:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-16T19:16:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-16T19:16:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-16T19:16:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-16T19:16:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-16T19:16:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-16T19:16:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-16T19:16:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-16T19:16:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-16T19:16:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-16T19:16:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-16T19:16:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-16T19:16:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-16T19:16:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-16T19:16:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-16T19:16:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-16T19:16:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-16T19:16:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-16T19:16:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-16T19:16:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-16T19:16:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-16T19:16:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-16T19:16:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-16T19:16:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-16T19:16:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-16T19:16:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-16T19:16:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-16T19:16:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-16T19:16:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-16T19:16:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-16T19:16:46.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-16T19:16:46.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-16T19:16:46.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-16T19:16:46.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-16T19:16:46.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-16T19:16:46.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-16T19:16:46.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-16T19:16:46.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-16T19:16:46.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-16T19:16:46.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-16T19:16:46.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-16T19:16:46.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-16T19:16:46.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-16T19:16:46.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-16T19:16:46.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-16T19:16:46.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-16T19:16:46.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-16T19:16:46.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-16T19:16:46.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-16T19:16:46.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-16T19:16:46.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-16T19:16:46.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-16T19:16:46.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-16T19:16:46.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-16T19:16:46.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-16T19:16:46.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-16T19:16:46.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-16T19:16:46.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-16T19:16:46.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-16T19:16:46.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-16T19:16:46.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-16T19:16:46.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-16T19:16:46.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-16T19:16:46.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-16T19:16:46.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-16T19:16:46.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-16T19:16:46.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-16T19:16:46.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-16T19:16:46.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-16T19:16:46.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-16T19:16:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-16T19:16:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-16T19:16:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-16T19:16:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-16T19:16:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-16T19:16:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-16T19:16:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-16T19:16:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-16T19:16:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-16T19:16:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-16T19:16:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-16T19:16:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-16T19:16:46.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-16T19:16:46.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-16T19:16:46.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-16T19:16:46.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-16T19:16:46.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-16T19:16:46.578 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-16T19:16:46.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-16T19:16:46.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-16T19:16:46.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-16T19:16:46.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-16T19:16:46.579 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-16T19:16:46.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-16T19:16:46.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-16T19:16:46.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-16T19:16:46.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-16T19:16:46.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-16T19:16:46.580 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-16T19:16:46.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-16T19:16:46.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-16T19:16:46.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-16T19:16:46.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-16T19:16:46.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-16T19:16:46.581 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-16T19:16:46.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-16T19:16:46.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-16T19:16:46.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-16T19:16:46.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-16T19:16:46.582 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-16T19:16:46.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-16T19:16:46.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-16T19:16:46.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-16T19:16:46.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-16T19:16:46.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-16T19:16:46.583 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-16T19:16:46.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-16T19:16:46.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-16T19:16:46.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-16T19:16:46.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-16T19:16:46.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-16T19:16:46.584 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-16T19:16:46.585 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-16T19:16:46.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-16T19:16:46.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-16T19:16:46.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-16T19:16:46.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-16T19:16:46.586 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-16T19:16:46.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-16T19:16:46.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-16T19:16:46.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-16T19:16:46.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-16T19:16:46.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-16T19:16:46.587 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-16T19:16:46.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-16T19:16:46.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-16T19:16:46.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-16T19:16:46.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-16T19:16:46.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-16T19:16:46.588 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-16T19:16:46.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-16T19:16:46.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-16T19:16:46.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-16T19:16:46.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-16T19:16:46.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-16T19:16:46.589 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-16T19:16:46.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-16T19:16:46.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-16T19:16:46.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-16T19:16:46.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-16T19:16:46.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-16T19:16:46.590 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-16T19:16:46.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-16T19:16:46.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-16T19:16:46.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-16T19:16:46.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-16T19:16:46.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-16T19:16:46.591 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-16T19:16:46.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-16T19:16:46.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-16T19:16:46.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-16T19:16:46.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-16T19:16:46.592 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-16T19:16:46.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-16T19:16:46.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-16T19:16:46.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-16T19:16:46.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-16T19:16:46.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-16T19:16:46.593 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-16T19:16:46.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-16T19:16:46.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-16T19:16:46.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-16T19:16:46.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-16T19:16:46.594 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-16T19:16:46.595 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-16T19:16:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-16T19:16:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-16T19:16:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-16T19:16:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-16T19:16:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-16T19:16:46.596 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-16T19:16:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-16T19:16:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-16T19:16:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-16T19:16:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-16T19:16:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-16T19:16:46.597 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-16T19:16:46.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-16T19:16:46.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-16T19:16:46.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-16T19:16:46.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-16T19:16:46.598 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-16T19:16:46.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-16T19:16:46.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-16T19:16:46.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-16T19:16:46.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-16T19:16:46.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-16T19:16:46.599 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-16T19:16:46.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-16T19:16:46.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-16T19:16:46.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-16T19:16:46.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-16T19:16:46.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-16T19:16:46.600 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-16T19:16:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-16T19:16:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-16T19:16:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-16T19:16:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-16T19:16:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-16T19:16:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-16T19:16:46.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-16T19:16:46.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-16T19:16:46.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-16T19:16:46.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-16T19:16:46.602 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-16T19:16:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-16T19:16:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-16T19:16:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-16T19:16:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-16T19:16:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-16T19:16:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-16T19:16:46.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-16T19:16:46.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-16T19:16:46.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-16T19:16:46.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-16T19:16:46.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-16T19:16:46.604 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-16T19:16:46.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-16T19:16:46.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-16T19:16:46.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-16T19:16:46.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-16T19:16:46.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-16T19:16:46.605 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-16T19:16:46.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-16T19:16:46.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-16T19:16:46.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-16T19:16:46.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-16T19:16:46.606 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-16T19:16:46.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-16T19:16:46.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-16T19:16:46.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-16T19:16:46.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-16T19:16:46.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-16T19:16:46.607 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-16T19:16:46.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-16T19:16:46.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-16T19:16:46.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-16T19:16:46.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-16T19:16:46.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-16T19:16:46.608 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-16T19:16:46.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-16T19:16:46.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-16T19:16:46.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-16T19:16:46.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-16T19:16:46.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-16T19:16:46.609 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-16T19:16:46.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-16T19:16:46.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-16T19:16:46.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-16T19:16:46.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-16T19:16:46.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-16T19:16:46.610 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-16T19:16:46.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-16T19:16:46.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-16T19:16:46.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-16T19:16:46.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-16T19:16:46.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-16T19:16:46.611 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-16T19:16:46.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-16T19:16:46.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-16T19:16:46.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-16T19:16:46.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-16T19:16:46.612 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-16T19:16:46.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-16T19:16:46.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-16T19:16:46.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-16T19:16:46.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-16T19:16:46.613 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-16T19:16:46.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-16T19:16:46.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-16T19:16:46.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-16T19:16:46.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-16T19:16:46.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-16T19:16:46.614 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-16T19:16:46.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-16T19:16:46.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-16T19:16:46.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-16T19:16:46.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-16T19:16:46.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-16T19:16:46.615 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-16T19:16:46.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-16T19:16:46.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-16T19:16:46.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-16T19:16:46.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-16T19:16:46.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-16T19:16:46.616 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-16T19:16:46.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-16T19:16:46.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-16T19:16:46.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-16T19:16:46.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-16T19:16:46.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-16T19:16:46.617 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-16T19:16:46.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-16T19:16:46.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-16T19:16:46.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-16T19:16:46.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-16T19:16:46.618 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-16T19:16:46.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-16T19:16:46.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-16T19:16:46.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-16T19:16:46.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-16T19:16:46.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-16T19:16:46.619 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-16T19:16:46.620 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-16T19:16:46.620 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-16T19:16:46.620 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-16T19:16:46.620 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-16T19:16:46.621 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-16T19:16:46.621 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-16T19:16:46.621 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-16T19:16:46.621 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-16T19:16:46.621 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-16T19:16:46.621 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-16T19:16:46.622 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-16T19:16:46.622 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-16T19:16:46.622 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-16T19:16:46.622 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-16T19:16:46.622 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-16T19:16:46.623 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-16T19:16:46.623 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-16T19:16:46.623 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-16T19:16:46.623 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-16T19:16:46.623 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-16T19:16:46.624 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-16T19:16:46.624 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-16T19:16:46.624 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-16T19:16:46.624 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-16T19:16:46.624 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-16T19:16:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-16T19:16:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-16T19:16:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-16T19:16:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-16T19:16:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-16T19:16:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-16T19:16:46.626 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-16T19:16:46.626 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-16T19:16:46.626 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-16T19:16:46.626 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-16T19:16:46.626 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-16T19:16:46.627 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-16T19:16:46.627 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-16T19:16:46.627 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-16T19:16:46.627 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-16T19:16:46.627 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-16T19:16:46.628 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-16T19:16:46.628 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-16T19:16:46.628 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-16T19:16:46.628 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-16T19:16:46.628 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-16T19:16:46.628 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-16T19:16:46.629 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-16T19:16:46.629 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-16T19:16:46.629 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-16T19:16:46.629 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-16T19:16:46.629 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-16T19:16:46.630 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-16T19:16:46.630 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-16T19:16:46.630 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-16T19:16:46.630 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-16T19:16:46.630 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-16T19:16:46.631 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-16T19:16:46.632 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-16T19:16:46.632 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-16T19:16:46.632 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-16T19:16:46.632 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-16T19:16:46.632 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-16T19:16:46.632 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-16T19:16:46.633 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-16T19:16:46.633 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-16T19:16:46.633 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-16T19:16:46.633 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-16T19:16:46.633 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-16T19:16:46.633 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-16T19:16:46.634 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-16T19:16:46.634 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-16T19:16:46.634 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-16T19:16:46.634 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-16T19:16:46.634 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-16T19:16:46.635 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-16T19:16:46.635 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-16T19:16:46.635 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-16T19:16:46.635 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-16T19:16:46.635 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-16T19:16:46.635 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-16T19:16:46.636 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-16T19:16:46.636 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-16T19:16:46.636 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-16T19:16:46.636 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-16T19:16:46.636 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-16T19:16:46.637 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-16T19:16:46.637 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-16T19:16:46.637 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-16T19:16:46.637 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-16T19:16:46.637 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-16T19:16:46.637 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-16T19:16:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-16T19:16:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-16T19:16:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-16T19:16:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-16T19:16:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-16T19:16:46.639 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-16T19:16:46.639 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-16T19:16:46.639 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-16T19:16:46.639 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-16T19:16:46.639 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-16T19:16:46.640 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-16T19:16:46.640 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-16T19:16:46.640 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-16T19:16:46.640 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-16T19:16:46.640 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-16T19:16:46.640 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-16T19:16:46.641 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-16T19:16:46.641 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-16T19:16:46.641 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-16T19:16:46.641 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-16T19:16:46.641 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-16T19:16:46.642 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-16T19:16:46.642 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-16T19:16:46.642 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-16T19:16:46.642 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-16T19:16:46.642 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-16T19:16:46.642 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-16T19:16:46.643 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-16T19:16:46.643 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-16T19:16:46.643 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-16T19:16:46.643 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-16T19:16:46.643 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-16T19:16:46.644 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-16T19:16:46.644 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-16T19:16:46.644 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-16T19:16:46.644 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-16T19:16:46.644 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-16T19:16:46.644 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-16T19:16:46.645 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-16T19:16:46.645 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-16T19:16:46.645 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-16T19:16:46.645 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-16T19:16:46.645 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-16T19:16:46.646 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-16T19:16:46.646 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-16T19:16:46.646 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-16T19:16:46.646 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-16T19:16:46.646 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-16T19:16:46.646 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-16T19:16:46.647 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-16T19:16:46.647 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-16T19:16:46.647 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-16T19:16:46.647 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-16T19:16:46.647 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-16T19:16:46.648 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-16T19:16:46.648 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-16T19:16:46.648 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-16T19:16:46.648 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-16T19:16:46.648 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-16T19:16:46.649 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-16T19:16:46.649 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-16T19:16:46.649 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-16T19:16:46.649 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-16T19:16:46.649 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-16T19:16:46.649 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-16T19:16:46.650 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-16T19:16:46.650 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-16T19:16:46.650 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-16T19:16:46.650 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-16T19:16:46.650 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-16T19:16:46.651 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-16T19:16:46.651 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-16T19:16:46.651 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-16T19:16:46.651 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-16T19:16:46.651 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-16T19:16:46.651 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-16T19:16:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-16T19:16:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-16T19:16:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-16T19:16:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-16T19:16:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-16T19:16:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-16T19:16:46.653 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-16T19:16:46.653 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-16T19:16:46.653 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-16T19:16:46.653 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-16T19:16:46.653 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-16T19:16:46.653 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-16T19:16:46.654 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-16T19:16:46.654 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-16T19:16:46.654 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-16T19:16:46.654 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-16T19:16:46.654 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-16T19:16:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-16T19:16:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-16T19:16:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-16T19:16:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-16T19:16:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-16T19:16:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-16T19:16:46.656 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-16T19:16:46.656 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-16T19:16:46.656 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-16T19:16:46.656 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-16T19:16:46.656 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-16T19:16:46.656 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-16T19:16:46.657 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-16T19:16:46.657 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-16T19:16:46.657 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-16T19:16:46.657 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-16T19:16:46.657 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-16T19:16:46.658 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-16T19:16:46.658 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-16T19:16:46.658 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-16T19:16:46.658 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-16T19:16:46.658 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-16T19:16:46.658 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-16T19:16:46.659 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-16T19:16:46.659 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-16T19:16:46.659 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-16T19:16:46.659 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-16T19:16:46.659 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-16T19:16:46.660 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-16T19:16:46.660 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-16T19:16:46.660 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-16T19:16:46.660 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-16T19:16:46.660 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-16T19:16:46.660 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-16T19:16:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-16T19:16:46.662 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-16T19:16:46.662 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-16T19:16:46.662 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-16T19:16:46.662 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-16T19:16:46.662 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-16T19:16:46.663 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-16T19:16:46.663 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-16T19:16:46.663 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-16T19:16:46.663 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-16T19:16:46.663 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-16T19:16:46.663 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-16T19:16:46.664 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-16T19:16:46.664 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-16T19:16:46.664 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-16T19:16:46.664 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-16T19:16:46.664 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-16T19:16:46.665 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-16T19:16:46.665 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-16T19:16:46.665 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-16T19:16:46.665 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-16T19:16:46.665 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-16T19:16:46.665 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-16T19:16:46.666 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-16T19:16:46.666 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-16T19:16:46.666 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-16T19:16:46.666 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-16T19:16:46.666 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-16T19:16:46.667 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-16T19:16:46.667 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-16T19:16:46.667 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-16T19:16:46.667 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-16T19:16:46.667 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-16T19:16:46.668 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-16T19:16:46.668 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-16T19:16:46.668 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-16T19:16:46.668 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-16T19:16:46.668 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-16T19:16:46.669 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-16T19:16:46.669 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-16T19:16:46.669 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-16T19:16:46.669 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-16T19:16:46.669 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-16T19:16:46.670 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-16T19:16:46.670 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-16T19:16:46.670 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-16T19:16:46.670 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-16T19:16:46.670 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-16T19:16:46.671 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-16T19:16:46.671 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-16T19:16:46.671 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-16T19:16:46.671 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-16T19:16:46.671 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-16T19:16:46.671 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-16T19:16:46.672 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-16T19:16:46.672 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-16T19:16:46.672 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-16T19:16:46.672 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-16T19:16:46.672 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-16T19:16:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-16T19:16:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-16T19:16:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-16T19:16:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-16T19:16:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-16T19:16:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-16T19:16:46.674 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-16T19:16:46.674 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-16T19:16:46.674 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-16T19:16:46.674 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-16T19:16:46.674 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-16T19:16:46.675 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-16T19:16:46.675 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-16T19:16:46.675 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-16T19:16:46.675 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-16T19:16:46.675 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-16T19:16:46.676 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-16T19:16:46.676 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-16T19:16:46.676 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-16T19:16:46.676 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-16T19:16:46.676 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-16T19:16:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-16T19:16:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-16T19:16:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-16T19:16:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-16T19:16:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-16T19:16:46.678 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-16T19:16:46.678 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-16T19:16:46.678 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-16T19:16:46.678 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-16T19:16:46.678 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-16T19:16:46.679 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-16T19:16:46.679 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-16T19:16:46.679 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-16T19:16:46.679 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-16T19:16:46.679 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-16T19:16:46.680 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-16T19:16:46.680 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-16T19:16:46.680 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-16T19:16:46.680 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-16T19:16:46.680 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-16T19:16:46.681 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-16T19:16:46.681 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-16T19:16:46.681 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-16T19:16:46.681 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-16T19:16:46.681 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-16T19:16:46.681 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-16T19:16:46.682 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-16T19:16:46.682 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-16T19:16:46.682 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-16T19:16:46.682 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-16T19:16:46.682 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-16T19:16:46.683 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-16T19:16:46.683 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-16T19:16:46.683 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-16T19:16:46.683 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-16T19:16:46.683 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-16T19:16:46.683 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-16T19:16:46.684 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-16T19:16:46.684 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-16T19:16:46.684 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-16T19:16:46.684 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-16T19:16:46.684 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-16T19:16:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-16T19:16:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-16T19:16:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-16T19:16:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-16T19:16:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-16T19:16:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-16T19:16:46.686 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-16T19:16:46.686 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-16T19:16:46.686 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-16T19:16:46.686 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-16T19:16:46.686 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-16T19:16:46.687 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-16T19:16:46.687 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-16T19:16:46.687 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-16T19:16:46.687 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-16T19:16:46.687 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-16T19:16:46.688 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-16T19:16:46.688 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-16T19:16:46.688 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-16T19:16:46.688 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-16T19:16:46.688 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-16T19:16:46.689 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-16T19:16:46.689 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-16T19:16:46.689 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-16T19:16:46.689 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-16T19:16:46.689 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-16T19:16:46.689 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-16T19:16:46.690 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-16T19:16:46.690 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-16T19:16:46.690 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-16T19:16:46.690 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-16T19:16:46.690 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-16T19:16:46.691 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-16T19:16:46.691 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-16T19:16:46.691 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-16T19:16:46.691 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-16T19:16:46.691 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-16T19:16:46.691 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-16T19:16:46.692 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-16T19:16:46.692 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-16T19:16:46.692 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-16T19:16:46.692 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-16T19:16:46.692 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-16T19:16:46.692 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-16T19:16:46.693 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-16T19:16:46.693 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-16T19:16:46.693 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-16T19:16:46.693 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-16T19:16:46.693 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-16T19:16:46.694 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-16T19:16:46.694 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-16T19:16:46.694 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-16T19:16:46.694 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-16T19:16:46.694 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-16T19:16:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-16T19:16:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-16T19:16:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-16T19:16:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-16T19:16:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-16T19:16:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-16T19:16:46.696 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-16T19:16:46.696 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-16T19:16:46.696 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-16T19:16:46.696 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-16T19:16:46.696 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-16T19:16:46.696 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-16T19:16:46.697 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-16T19:16:46.697 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-16T19:16:46.697 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-16T19:16:46.697 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-16T19:16:46.697 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-16T19:16:46.697 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-16T19:16:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-16T19:16:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-16T19:16:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-16T19:16:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-16T19:16:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-16T19:16:46.699 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-16T19:16:46.700 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-16T19:16:46.700 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-16T19:16:46.700 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-16T19:16:46.700 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-16T19:16:46.700 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-16T19:16:46.701 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-16T19:16:46.701 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-16T19:16:46.701 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-16T19:16:46.701 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-16T19:16:46.701 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-16T19:16:46.701 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-16T19:16:46.702 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-16T19:16:46.702 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-16T19:16:46.702 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-16T19:16:46.702 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-16T19:16:46.702 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-16T19:16:46.703 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-16T19:16:46.703 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-16T19:16:46.703 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-16T19:16:46.703 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-16T19:16:46.703 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-16T19:16:46.704 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-16T19:16:46.704 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-16T19:16:46.704 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-16T19:16:46.704 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-16T19:16:46.704 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-16T19:16:46.704 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-16T19:16:46.705 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-16T19:16:46.705 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-16T19:16:46.705 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-16T19:16:46.705 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-16T19:16:46.705 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-16T19:16:46.706 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-16T19:16:46.706 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-16T19:16:46.706 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-16T19:16:46.706 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-16T19:16:46.706 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-16T19:16:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-16T19:16:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-16T19:16:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-16T19:16:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-16T19:16:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-16T19:16:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-16T19:16:46.708 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-16T19:16:46.708 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-16T19:16:46.708 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-16T19:16:46.708 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-16T19:16:46.708 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-16T19:16:46.709 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-16T19:16:46.709 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-16T19:16:46.709 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-16T19:16:46.709 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-16T19:16:46.709 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-16T19:16:46.710 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-16T19:16:46.710 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-16T19:16:46.710 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-16T19:16:46.710 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-16T19:16:46.710 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-16T19:16:46.711 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-16T19:16:46.711 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-16T19:16:46.711 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-16T19:16:46.711 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-16T19:16:46.711 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-16T19:16:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-16T19:16:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-16T19:16:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-16T19:16:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-16T19:16:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-16T19:16:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-16T19:16:46.713 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-16T19:16:46.713 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-16T19:16:46.713 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-16T19:16:46.713 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-16T19:16:46.713 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-16T19:16:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-16T19:16:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-16T19:16:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-16T19:16:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-16T19:16:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-16T19:16:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-16T19:16:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-16T19:16:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-16T19:16:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-16T19:16:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-16T19:16:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-16T19:16:46.716 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-16T19:16:46.716 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-16T19:16:46.716 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-16T19:16:46.716 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-16T19:16:46.716 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-16T19:16:46.717 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-16T19:16:46.717 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-16T19:16:46.717 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-16T19:16:46.717 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-16T19:16:46.717 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-16T19:16:46.717 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-16T19:16:46.718 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-16T19:16:46.718 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-16T19:16:46.718 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-16T19:16:46.718 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-16T19:16:46.718 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-16T19:16:46.719 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-16T19:16:46.719 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-16T19:16:46.719 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-16T19:16:46.719 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-16T19:16:46.719 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-16T19:16:46.719 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-16T19:16:46.720 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-16T19:16:46.720 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-16T19:16:46.720 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-16T19:16:46.720 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-16T19:16:46.720 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-16T19:16:46.721 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-16T19:16:46.721 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-16T19:16:46.721 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-16T19:16:46.721 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-16T19:16:46.721 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-16T19:16:46.721 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-16T19:16:46.722 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-16T19:16:46.722 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-16T19:16:46.722 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-16T19:16:46.722 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-16T19:16:46.722 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-16T19:16:46.723 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-16T19:16:46.723 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-16T19:16:46.723 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-16T19:16:46.723 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-16T19:16:46.723 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-16T19:16:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-16T19:16:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-16T19:16:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-16T19:16:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-16T19:16:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-16T19:16:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-16T19:16:46.725 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-16T19:16:46.725 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-16T19:16:46.725 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-16T19:16:46.725 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-16T19:16:46.725 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-16T19:16:46.725 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-16T19:16:46.726 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-16T19:16:46.726 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-16T19:16:46.726 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-16T19:16:46.726 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-16T19:16:46.726 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-16T19:16:46.727 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-16T19:16:46.727 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-16T19:16:46.727 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-16T19:16:46.727 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-16T19:16:46.727 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-16T19:16:46.728 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-16T19:16:46.728 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-16T19:16:46.728 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-16T19:16:46.728 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-16T19:16:46.729 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-16T19:16:46.729 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-16T19:16:46.729 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-16T19:16:46.729 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-16T19:16:46.729 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-16T19:16:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-16T19:16:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-16T19:16:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-16T19:16:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-16T19:16:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-16T19:16:46.731 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-16T19:16:46.731 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-16T19:16:46.731 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-16T19:16:46.731 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-16T19:16:46.731 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-16T19:16:46.732 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-16T19:16:46.732 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-16T19:16:46.732 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-16T19:16:46.732 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-16T19:16:46.732 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-16T19:16:46.733 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-16T19:16:46.733 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-16T19:16:46.733 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-16T19:16:46.733 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-16T19:16:46.733 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-16T19:16:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-16T19:16:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-16T19:16:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-16T19:16:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-16T19:16:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-16T19:16:46.735 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-16T19:16:46.735 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-16T19:16:46.735 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-16T19:16:46.735 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-16T19:16:46.735 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-16T19:16:46.736 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-16T19:16:46.736 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-16T19:16:46.736 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-16T19:16:46.736 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-16T19:16:46.736 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-16T19:16:46.737 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-16T19:16:46.737 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-16T19:16:46.737 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-16T19:16:46.737 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-16T19:16:46.737 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-16T19:16:46.738 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-16T19:16:46.738 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-16T19:16:46.738 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-16T19:16:46.738 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-16T19:16:46.738 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-16T19:16:46.739 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-16T19:16:46.739 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-16T19:16:46.739 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-16T19:16:46.739 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-16T19:16:46.739 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-16T19:16:46.740 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-16T19:16:46.740 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-16T19:16:46.740 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-16T19:16:46.740 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-16T19:16:46.740 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-16T19:16:46.740 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-16T19:16:46.741 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-16T19:16:46.741 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-16T19:16:46.741 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-16T19:16:46.741 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-16T19:16:46.741 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-16T19:16:46.741 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-16T19:16:46.742 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-16T19:16:46.742 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-16T19:16:46.742 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-16T19:16:46.742 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-16T19:16:46.742 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-16T19:16:46.743 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-16T19:16:46.743 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-16T19:16:46.743 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-16T19:16:46.743 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-16T19:16:46.743 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-16T19:16:46.743 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-16T19:16:46.744 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-16T19:16:46.744 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-16T19:16:46.744 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-16T19:16:46.744 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-16T19:16:46.744 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-16T19:16:46.744 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-16T19:16:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-16T19:16:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-16T19:16:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-16T19:16:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-16T19:16:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-16T19:16:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-16T19:16:46.746 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-16T19:16:46.746 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-16T19:16:46.746 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-16T19:16:46.746 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-16T19:16:46.746 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-16T19:16:46.747 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-16T19:16:46.747 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-16T19:16:46.747 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-16T19:16:46.747 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-16T19:16:46.747 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-16T19:16:46.747 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-16T19:16:46.748 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-16T19:16:46.748 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-16T19:16:46.748 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-16T19:16:46.748 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-16T19:16:46.748 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-16T19:16:46.749 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-16T19:16:46.749 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-16T19:16:46.749 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-16T19:16:46.749 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-16T19:16:46.749 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-16T19:16:46.750 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-16T19:16:46.750 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-16T19:16:46.750 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-16T19:16:46.750 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-16T19:16:46.750 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-16T19:16:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-16T19:16:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-16T19:16:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-16T19:16:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-16T19:16:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-16T19:16:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-16T19:16:46.752 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-16T19:16:46.752 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-16T19:16:46.752 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-16T19:16:46.752 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-16T19:16:46.752 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-16T19:16:46.752 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-16T19:16:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-16T19:16:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-16T19:16:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-16T19:16:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-16T19:16:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-16T19:16:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-16T19:16:46.754 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-16T19:16:46.754 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-16T19:16:46.754 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-16T19:16:46.754 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-16T19:16:46.754 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-16T19:16:46.755 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-16T19:16:46.755 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-16T19:16:46.755 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-16T19:16:46.755 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-16T19:16:46.755 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-16T19:16:46.755 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-16T19:16:46.756 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-16T19:16:46.756 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-16T19:16:46.756 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-16T19:16:46.756 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-16T19:16:46.756 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-16T19:16:46.756 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-16T19:16:46.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-16T19:16:46.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-16T19:16:46.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-16T19:16:46.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-16T19:16:46.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-16T19:16:46.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-16T19:16:46.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-16T19:16:46.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-16T19:16:46.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-16T19:16:46.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-16T19:16:46.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-16T19:16:46.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-16T19:16:46.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-16T19:16:46.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-16T19:16:46.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-16T19:16:46.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-16T19:16:46.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-16T19:16:46.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-16T19:16:46.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-16T19:16:46.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-16T19:16:46.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-16T19:16:46.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-16T19:16:46.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-16T19:16:46.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-16T19:16:46.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-16T19:16:46.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-16T19:16:46.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-16T19:16:46.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-16T19:16:46.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-16T19:16:46.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-16T19:16:46.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-16T19:16:46.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-16T19:16:46.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-16T19:16:46.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-16T19:16:46.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-16T19:16:46.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-16T19:16:46.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-16T19:16:46.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-16T19:16:46.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-16T19:16:46.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-16T19:16:46.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-16T19:16:46.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-16T19:16:46.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-16T19:16:46.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-16T19:16:46.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-16T19:16:46.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-16T19:16:46.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-16T19:16:46.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-16T19:16:46.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-16T19:16:46.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-16T19:16:46.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-16T19:16:46.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-16T19:16:46.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-16T19:16:46.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-16T19:16:46.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-16T19:16:46.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-16T19:16:46.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-16T19:16:46.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-16T19:16:46.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-16T19:16:46.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-16T19:16:46.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-16T19:16:46.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-16T19:16:46.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-16T19:16:46.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-16T19:16:46.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-16T19:16:46.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-16T19:16:46.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-16T19:16:46.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-16T19:16:46.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-16T19:16:46.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-16T19:16:46.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-16T19:16:46.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-16T19:16:46.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-16T19:16:46.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-16T19:16:46.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-16T19:16:46.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-16T19:16:46.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-16T19:16:46.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-16T19:16:46.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-16T19:16:46.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-16T19:16:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-16T19:16:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-16T19:16:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-16T19:16:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-16T19:16:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-16T19:16:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-16T19:16:46.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-16T19:16:46.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-16T19:16:46.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-16T19:16:46.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-16T19:16:46.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-16T19:16:46.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-16T19:16:46.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-16T19:16:46.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-16T19:16:46.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-16T19:16:46.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-16T19:16:46.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-16T19:16:46.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-16T19:16:46.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-16T19:16:46.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-16T19:16:46.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-16T19:16:46.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-16T19:16:46.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-16T19:16:46.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-16T19:16:46.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-16T19:16:46.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-16T19:16:46.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-16T19:16:46.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-16T19:16:46.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-16T19:16:46.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-16T19:16:46.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-16T19:16:46.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-16T19:16:46.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-16T19:16:46.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-16T19:16:46.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-16T19:16:46.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-16T19:16:46.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-16T19:16:46.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-16T19:16:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-16T19:16:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-16T19:16:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-16T19:16:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-16T19:16:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-16T19:16:46.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-16T19:16:46.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-16T19:16:46.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-16T19:16:46.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-16T19:16:46.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-16T19:16:46.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-16T19:16:46.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-16T19:16:46.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-16T19:16:46.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-16T19:16:46.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-16T19:16:46.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-16T19:16:46.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-16T19:16:46.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-16T19:16:46.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-16T19:16:46.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-16T19:16:46.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-16T19:16:46.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-16T19:16:46.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-16T19:16:46.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-16T19:16:46.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-16T19:16:46.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-16T19:16:46.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-16T19:16:46.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-16T19:16:46.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-16T19:16:46.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-16T19:16:46.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-16T19:16:46.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-16T19:16:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-16T19:16:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-16T19:16:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-16T19:16:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-16T19:16:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-16T19:16:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-16T19:16:46.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-16T19:16:46.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-16T19:16:46.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-16T19:16:46.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-16T19:16:46.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-16T19:16:46.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-16T19:16:46.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-16T19:16:46.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-16T19:16:46.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-16T19:16:46.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-16T19:16:46.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-16T19:16:46.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-16T19:16:46.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-16T19:16:46.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-16T19:16:46.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-16T19:16:46.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-16T19:16:46.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-16T19:16:46.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-16T19:16:46.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-16T19:16:46.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-16T19:16:46.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-16T19:16:46.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-16T19:16:46.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-16T19:16:46.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-16T19:16:46.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-16T19:16:46.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-16T19:16:46.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-16T19:16:46.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-16T19:16:46.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-16T19:16:46.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-16T19:16:46.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-16T19:16:46.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-16T19:16:46.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-16T19:16:46.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-16T19:16:46.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-16T19:16:46.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-16T19:16:46.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-16T19:16:46.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-16T19:16:46.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-16T19:16:46.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-16T19:16:46.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-16T19:16:46.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-16T19:16:46.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-16T19:16:46.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-16T19:16:46.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-16T19:16:46.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-16T19:16:46.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-16T19:16:46.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-16T19:16:46.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-16T19:16:46.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-16T19:16:46.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-16T19:16:46.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-16T19:16:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-16T19:16:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-16T19:16:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-16T19:16:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-16T19:16:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-16T19:16:46.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-16T19:16:46.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-16T19:16:46.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-16T19:16:46.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-16T19:16:46.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-16T19:16:46.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-16T19:16:46.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-16T19:16:46.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-16T19:16:46.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-16T19:16:46.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-16T19:16:46.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-16T19:16:46.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-16T19:16:46.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-16T19:16:46.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-16T19:16:46.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-16T19:16:46.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-16T19:16:46.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-16T19:16:46.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-16T19:16:46.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-16T19:16:46.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-16T19:16:46.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-16T19:16:46.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-16T19:16:46.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-16T19:16:46.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-16T19:16:46.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-16T19:16:46.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-16T19:16:46.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-16T19:16:46.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-16T19:16:46.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-16T19:16:46.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-16T19:16:46.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-16T19:16:46.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-16T19:16:46.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-16T19:16:46.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-16T19:16:46.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-16T19:16:46.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-16T19:16:46.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-16T19:16:46.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-16T19:16:46.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-16T19:16:46.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-16T19:16:46.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-16T19:16:46.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-16T19:16:46.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-16T19:16:46.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-16T19:16:46.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-16T19:16:46.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-16T19:16:46.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-16T19:16:46.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-16T19:16:46.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-16T19:16:46.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-16T19:16:46.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-16T19:16:46.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-16T19:16:46.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-16T19:16:46.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-16T19:16:46.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-16T19:16:46.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-16T19:16:46.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-16T19:16:46.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-16T19:16:46.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-16T19:16:46.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-16T19:16:46.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-16T19:16:46.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-16T19:16:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-16T19:16:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-16T19:16:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-16T19:16:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-16T19:16:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-16T19:16:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-16T19:16:46.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-16T19:16:46.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-16T19:16:46.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-16T19:16:46.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-16T19:16:46.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-16T19:16:46.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-16T19:16:46.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-16T19:16:46.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-16T19:16:46.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-16T19:16:46.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-16T19:16:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-16T19:16:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-16T19:16:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-16T19:16:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-16T19:16:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-16T19:16:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-16T19:16:46.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-16T19:16:46.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-16T19:16:46.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-16T19:16:46.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-16T19:16:46.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-16T19:16:46.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-16T19:16:46.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-16T19:16:46.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-16T19:16:46.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-16T19:16:46.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-16T19:16:46.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-16T19:16:46.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-16T19:16:46.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-16T19:16:46.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-16T19:16:46.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-16T19:16:46.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-16T19:16:46.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-16T19:16:46.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-16T19:16:46.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-16T19:16:46.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-16T19:16:46.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-16T19:16:46.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-16T19:16:46.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-16T19:16:46.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-16T19:16:46.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-16T19:16:46.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-16T19:16:46.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-16T19:16:46.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-16T19:16:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-16T19:16:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-16T19:16:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-16T19:16:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-16T19:16:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-16T19:16:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-16T19:16:46.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-16T19:16:46.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-16T19:16:46.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-16T19:16:46.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-16T19:16:46.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-16T19:16:46.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-16T19:16:46.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-16T19:16:46.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-16T19:16:46.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-16T19:16:46.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-16T19:16:46.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-16T19:16:46.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-16T19:16:46.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-16T19:16:46.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-16T19:16:46.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-16T19:16:46.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-16T19:16:46.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-16T19:16:46.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-16T19:16:46.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-16T19:16:46.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-16T19:16:46.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-16T19:16:46.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-16T19:16:46.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-16T19:16:46.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-16T19:16:46.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-16T19:16:46.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-16T19:16:46.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-16T19:16:46.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-16T19:16:46.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-16T19:16:46.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-16T19:16:46.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-16T19:16:46.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-16T19:16:46.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-16T19:16:46.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-16T19:16:46.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-16T19:16:46.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-16T19:16:46.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-16T19:16:46.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-16T19:16:46.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-16T19:16:46.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-16T19:16:46.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-16T19:16:46.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-16T19:16:46.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-16T19:16:46.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-16T19:16:46.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-16T19:16:46.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-16T19:16:46.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-16T19:16:46.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-16T19:16:46.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-16T19:16:46.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-16T19:16:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-16T19:16:46.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-16T19:16:46.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-16T19:16:46.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-16T19:16:46.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-16T19:16:46.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-16T19:16:46.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-16T19:16:46.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-16T19:16:46.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-16T19:16:46.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-16T19:16:46.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-16T19:16:46.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-16T19:16:46.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-16T19:16:46.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-16T19:16:46.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-16T19:16:46.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-16T19:16:46.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-16T19:16:46.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-16T19:16:46.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-16T19:16:46.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-16T19:16:46.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-16T19:16:46.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-16T19:16:46.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-16T19:16:46.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-16T19:16:46.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-16T19:16:46.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-16T19:16:46.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-16T19:16:46.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-16T19:16:46.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-16T19:16:46.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-16T19:16:46.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-16T19:16:46.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-16T19:16:46.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-16T19:16:46.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-16T19:16:46.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-16T19:16:46.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-16T19:16:46.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-16T19:16:46.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-16T19:16:46.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-16T19:16:46.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-16T19:16:46.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-16T19:16:46.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-16T19:16:46.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-16T19:16:46.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-16T19:16:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-16T19:16:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-16T19:16:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-16T19:16:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-16T19:16:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-16T19:16:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-16T19:16:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-16T19:16:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-16T19:16:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-16T19:16:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-16T19:16:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-16T19:16:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-16T19:16:46.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-16T19:16:46.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-16T19:16:46.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-16T19:16:46.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-16T19:16:46.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-16T19:16:46.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-16T19:16:46.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-16T19:16:46.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-16T19:16:46.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-16T19:16:46.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-16T19:16:46.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-16T19:16:46.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-16T19:16:46.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-16T19:16:46.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-16T19:16:46.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-16T19:16:46.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-16T19:16:46.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-16T19:16:46.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-16T19:16:46.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-16T19:16:46.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-16T19:16:46.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-16T19:16:46.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-16T19:16:46.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-16T19:16:46.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-16T19:16:46.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-16T19:16:46.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-16T19:16:46.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-16T19:16:46.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-16T19:16:46.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-16T19:16:46.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-16T19:16:46.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-16T19:16:46.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-16T19:16:46.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-16T19:16:46.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-16T19:16:46.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-16T19:16:46.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-16T19:16:46.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-16T19:16:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-16T19:16:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-16T19:16:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-16T19:16:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-16T19:16:46.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-16T19:16:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-16T19:16:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-16T19:16:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-16T19:16:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-16T19:16:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-16T19:16:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-16T19:16:46.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-16T19:16:46.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-16T19:16:46.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-16T19:16:46.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-16T19:16:46.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-16T19:16:46.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-16T19:16:46.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-16T19:16:46.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-16T19:16:46.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-16T19:16:46.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-16T19:16:46.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-16T19:16:46.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-16T19:16:46.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-16T19:16:46.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-16T19:16:46.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-16T19:16:46.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-16T19:16:46.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-16T19:16:46.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-16T19:16:46.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-16T19:16:46.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-16T19:16:46.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-16T19:16:46.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-16T19:16:46.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-16T19:16:46.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-16T19:16:46.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-16T19:16:46.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-16T19:16:46.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-16T19:16:46.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-16T19:16:46.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-16T19:16:46.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-16T19:16:46.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-16T19:16:46.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-16T19:16:46.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-16T19:16:46.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-16T19:16:46.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-16T19:16:46.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-16T19:16:46.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-16T19:16:46.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-16T19:16:46.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-16T19:16:46.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-16T19:16:46.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-16T19:16:46.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-16T19:16:46.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-16T19:16:46.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-16T19:16:46.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-16T19:16:46.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-16T19:16:46.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-16T19:16:46.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-16T19:16:46.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-16T19:16:46.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-16T19:16:46.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-16T19:16:46.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-16T19:16:46.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-16T19:16:46.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-16T19:16:46.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-16T19:16:46.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-16T19:16:46.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-16T19:16:46.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-16T19:16:46.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-16T19:16:46.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-16T19:16:46.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-16T19:16:46.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-16T19:16:46.861 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.862 DEBUG:teuthology.orchestra.run.smithi057:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-16T19:16:46.888 INFO:teuthology.orchestra.run.smithi057.stdout:postinstall scriptlet (using /bin/sh): 2023-10-16T19:16:46.888 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-16T19:16:46.888 INFO:teuthology.orchestra.run.smithi057.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:46.889 INFO:teuthology.orchestra.run.smithi057.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:46.889 INFO:teuthology.orchestra.run.smithi057.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.889 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:46.889 INFO:teuthology.orchestra.run.smithi057.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T19:16:46.889 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-10-16T19:16:46.889 INFO:teuthology.orchestra.run.smithi057.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-16T19:16:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-16T19:16:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-16T19:16:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-16T19:16:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-10-16T19:16:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-16T19:16:46.891 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-16T19:16:46.891 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.891 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-10-16T19:16:46.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2023-10-16T19:16:46.975 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2023-10-16T19:16:46.975 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2023-10-16T19:16:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.06 2023-10-16T19:16:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 68.el9 2023-10-16T19:16:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2023-10-16T19:16:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-16T19:16:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:Group : Unspecified 2023-10-16T19:16:46.977 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 8264254 2023-10-16T19:16:46.977 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2023-10-16T19:16:46.977 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-16T19:16:46.977 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-16T19:16:46.977 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-16T19:16:46.977 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-16T19:16:46.978 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : builder@centos.org 2023-10-16T19:16:46.978 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : CentOS 2023-10-16T19:16:46.978 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-16T19:16:46.978 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2023-10-16T19:16:46.978 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2023-10-16T19:16:46.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:16:46.979 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-16T19:16:46.979 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-16T19:16:46.979 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-16T19:16:46.979 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2023-10-16T19:16:46.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:16:46.980 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2023-10-16T19:16:46.981 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-16T19:16:46.981 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 6.6.0-rc5-g47672119149b 2023-10-16T19:16:46.981 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-16T19:16:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-10-16T19:16:49.301 INFO:teuthology.orchestra.run.smithi057.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-16T19:16:49.321 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-10-16T19:16:49.323 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-10-16T19:16:49.339 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.PgeyJGFPfO 2023-10-16T19:16:49.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PgeyJGFPfO 2023-10-16T19:16:49.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.PgeyJGFPfO 2023-10-16T19:16:49.553 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.PgeyJGFPfO is 6KB 2023-10-16T19:16:49.602 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.PgeyJGFPfO 2023-10-16T19:16:49.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2023-10-16T19:16:49.687 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-16T19:16:49.687 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-16T19:16:49.688 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-16T19:16:49.688 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-16T19:16:49.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-16T19:16:49.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2023-10-16T19:17:05.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-16T19:17:05.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-16T19:17:05.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:17:19.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-16T19:17:19.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:17:19.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:17:54.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-16T19:18:03.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:18:03.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:18:05.347 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T19:18:06.522 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-16T19:18:14.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-16T19:18:14.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:18:14.791 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-10-16T19:18:15.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-16T19:18:15.492 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g47672119149b"... 2023-10-16T19:18:15.492 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2023-10-16T19:18:15.539 INFO:teuthology.orchestra.run.smithi110.stdout:6.6.0-rc5-g47672119149b 2023-10-16T19:18:15.539 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-16T19:18:15.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T19:18:15.540 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-16T19:18:16.541 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-16T19:18:16.541 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T19:18:16.702 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2023-10-16T19:18:16.746 DEBUG:teuthology.parallel:result is None 2023-10-16T19:18:18.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:18:18.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:19:18.527 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T19:19:33.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:19:33.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:19:34.001 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-16T19:19:34.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:19:34.709 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-16T19:19:34.709 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-10-16T19:19:34.766 INFO:teuthology.orchestra.run.smithi057.stdout:6.6.0-rc5-g47672119149b 2023-10-16T19:19:34.767 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-16T19:19:34.767 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T19:19:34.767 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-16T19:19:35.768 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-16T19:19:35.769 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T19:19:35.930 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2023-10-16T19:19:35.977 DEBUG:teuthology.parallel:result is None 2023-10-16T19:19:35.978 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T19:19:35.986 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T19:19:35.986 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:19:35.995 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:19:36.060 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T19:19:36.067 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T19:19:36.073 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T19:19:36.073 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:19:36.082 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:19:36.405 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T19:19:36.412 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T19:19:36.412 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:19:36.421 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:19:36.538 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:19:36.573 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:19:36.579 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:19:36.621 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:19:36.626 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T19:19:36.633 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T19:19:36.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:19:36.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:19:36.745 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T19:19:36.756 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T19:19:36.756 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:19:36.765 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:19:36.823 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:19:36.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:19:37.024 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:19:37.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:19:37.211 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:19:37.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:19:37.309 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:19:37.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:19:37.535 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:19:37.626 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:19:37.727 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:19:37.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:19:37.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-10-16T19:19:37.832 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2023-10-16T19:19:37.962 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:19:38.009 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:19:38.493 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T19:19:38.502 INFO:teuthology.task.internal:Starting timer... 2023-10-16T19:19:38.502 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T19:19:38.519 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T19:19:38.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2023-10-16T19:19:38.656 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2023-10-16T19:19:38.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2023-10-16T19:19:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2023-10-16T19:19:38.832 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T19:19:38.833 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2023-10-16T19:19:38.909 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2023-10-16T19:19:38.910 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2023-10-16T19:19:38.979 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2023-10-16T19:19:38.980 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive'} 2023-10-16T19:19:38.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:19:39.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:19:39.092 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:19:39.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:19:39.189 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T19:19:39.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:19:39.315 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:19:39.424 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T19:19:39.434 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T19:19:39.440 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T19:19:39.571 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T19:19:39.587 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T19:19:39.588 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T19:29:51.506 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2023-10-16T19:29:51.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:29:51.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:29:51.656 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-16T19:29:51.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-16T19:29:51.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-16T19:29:51.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:29:51.938 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-10-16T19:29:52.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-10-16T19:29:52.092 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T19:29:52.105 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T19:29:52.105 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T19:29:52.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:29:52.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T19:29:52.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:29:52.223 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T19:29:52.224 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T19:29:52.274 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T19:29:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T19:29:52.371 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2023-10-16T19:29:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2023-10-16T19:29:52.413 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2023-10-16T19:29:52.424 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2023-10-16T19:29:52.463 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T19:29:52.483 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T19:29:52.512 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T19:29:52.541 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T19:29:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2023-10-16T19:29:52.643 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:29:52.644 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2023-10-16T19:29:52.644 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.644 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.644 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.644 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.670 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2023-10-16T19:29:52.679 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:29:52.679 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-10-16T19:29:52.680 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.680 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.680 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.680 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:29:52.681 INFO:teuthology.run_tasks:Running task install... 2023-10-16T19:29:52.693 DEBUG:teuthology.task.install:project ceph 2023-10-16T19:29:52.693 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T19:29:52.694 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T19:29:52.694 INFO:teuthology.task.install:Using flavor: default 2023-10-16T19:29:52.700 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-10-16T19:29:52.700 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T19:29:52.701 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T19:29:52.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:29:52.703 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T19:29:52.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:29:52.852 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-16T19:29:52.853 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T19:29:52.859 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-16T19:29:52.859 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T19:29:53.024 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T19:29:53.024 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:29:53.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T19:29:53.040 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T19:29:53.040 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:29:53.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T19:29:53.129 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T19:29:53.129 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T19:29:53.143 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T19:29:53.143 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T19:29:53.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T19:29:53.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T19:29:53.415 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T19:29:53.427 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T19:29:53.505 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2023-10-16T19:29:53.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2023-10-16T19:29:53.526 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2023-10-16T19:29:53.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2023-10-16T19:29:53.861 INFO:teuthology.orchestra.run.smithi110.stdout:72 files removed 2023-10-16T19:29:53.900 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T19:29:53.908 INFO:teuthology.orchestra.run.smithi057.stdout:72 files removed 2023-10-16T19:29:53.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T19:29:54.960 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 140 kB/s | 78 kB 00:00 2023-10-16T19:29:55.062 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 133 kB/s | 78 kB 00:00 2023-10-16T19:29:55.452 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2023-10-16T19:29:55.538 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-16T19:29:55.953 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2023-10-16T19:29:56.114 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-10-16T19:29:57.047 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 6.1 MB/s | 6.3 MB 00:01 2023-10-16T19:29:57.068 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - AppStream 7.2 MB/s | 6.3 MB 00:00 2023-10-16T19:29:58.598 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2023-10-16T19:29:58.918 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - BaseOS 3.2 MB/s | 2.0 MB 00:00 2023-10-16T19:29:59.711 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-10-16T19:30:01.351 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 7.9 MB 00:02 2023-10-16T19:30:02.287 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-10-16T19:30:04.554 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 18 MB 00:02 2023-10-16T19:30:07.279 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.7 MB 00:01 2023-10-16T19:30:08.830 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 5.7 MB 00:00 2023-10-16T19:30:09.055 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 14 kB 00:00 2023-10-16T19:30:10.373 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 14 kB 00:00 2023-10-16T19:30:10.498 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 15 MB/s | 19 MB 00:01 2023-10-16T19:30:12.814 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 19 MB 00:02 2023-10-16T19:30:15.682 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2023-10-16T19:30:18.175 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-16T19:30:18.176 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T19:30:18.179 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T19:30:18.223 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-16T19:30:18.223 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-16T19:30:18.225 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T19:30:18.226 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-16T19:30:18.228 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T19:30:18.231 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-16T19:30:18.232 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T19:30:18.307 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2023-10-16T19:30:18.330 INFO:teuthology.orchestra.run.smithi110.stdout:==================================================================================================== 2023-10-16T19:30:18.331 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2023-10-16T19:30:18.331 INFO:teuthology.orchestra.run.smithi110.stdout:==================================================================================================== 2023-10-16T19:30:18.331 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2023-10-16T19:30:18.331 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-16T19:30:18.332 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-16T19:30:18.332 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-16T19:30:18.332 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 74 M 2023-10-16T19:30:18.332 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 410 M 2023-10-16T19:30:18.333 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-16T19:30:18.333 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.8 M 2023-10-16T19:30:18.333 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-16T19:30:18.333 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.4 M 2023-10-16T19:30:18.334 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 47 M 2023-10-16T19:30:18.334 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-16T19:30:18.334 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-16T19:30:18.334 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-16T19:30:18.335 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T19:30:18.335 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-16T19:30:18.335 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-16T19:30:18.335 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 112 M 2023-10-16T19:30:18.335 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 315 M 2023-10-16T19:30:18.336 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-16T19:30:18.336 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 174 M 2023-10-16T19:30:18.336 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-16T19:30:18.336 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 625 M 2023-10-16T19:30:18.336 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-16T19:30:18.336 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-16T19:30:18.337 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-16T19:30:18.337 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-16T19:30:18.337 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-16T19:30:18.337 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-16T19:30:18.337 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-16T19:30:18.337 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-16T19:30:18.338 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-16T19:30:18.338 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.1 M 2023-10-16T19:30:18.338 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T19:30:18.338 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 108 k 2023-10-16T19:30:18.339 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 M 2023-10-16T19:30:18.339 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 51 M 2023-10-16T19:30:18.339 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-16T19:30:18.339 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-16T19:30:18.339 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-16T19:30:18.339 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-16T19:30:18.340 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-16T19:30:18.340 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-16T19:30:18.340 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-16T19:30:18.340 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 615 k 2023-10-16T19:30:18.340 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-16T19:30:18.340 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 770 k 2023-10-16T19:30:18.341 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-16T19:30:18.341 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.1 M 2023-10-16T19:30:18.341 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-16T19:30:18.341 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 337 k 2023-10-16T19:30:18.341 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-16T19:30:18.342 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 506 k 2023-10-16T19:30:18.342 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T19:30:18.342 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 51 M 2023-10-16T19:30:18.342 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-16T19:30:18.342 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.2 M 2023-10-16T19:30:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-16T19:30:18.343 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2023-10-16T19:30:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-16T19:30:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-16T19:30:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-16T19:30:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-16T19:30:18.344 INFO:teuthology.orchestra.run.smithi110.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-16T19:30:18.344 INFO:teuthology.orchestra.run.smithi110.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-16T19:30:18.344 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-16T19:30:18.344 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-16T19:30:18.344 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T19:30:18.345 INFO:teuthology.orchestra.run.smithi110.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-16T19:30:18.345 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2023-10-16T19:30:18.345 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-16T19:30:18.345 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-16T19:30:18.345 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T19:30:18.345 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 20 M 2023-10-16T19:30:18.346 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-16T19:30:18.346 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-16T19:30:18.346 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-16T19:30:18.346 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-16T19:30:18.346 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-16T19:30:18.347 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-16T19:30:18.347 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-16T19:30:18.347 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-16T19:30:18.347 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-16T19:30:18.348 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-16T19:30:18.348 INFO:teuthology.orchestra.run.smithi110.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-16T19:30:18.348 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-16T19:30:18.348 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-16T19:30:18.348 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-16T19:30:18.349 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-16T19:30:18.349 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-16T19:30:18.349 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-16T19:30:18.349 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-16T19:30:18.349 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-16T19:30:18.349 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-16T19:30:18.350 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-16T19:30:18.350 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-16T19:30:18.350 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-16T19:30:18.350 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-16T19:30:18.350 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-16T19:30:18.351 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-16T19:30:18.351 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-16T19:30:18.351 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-16T19:30:18.351 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-16T19:30:18.352 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-16T19:30:18.352 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-16T19:30:18.352 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-16T19:30:18.352 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-16T19:30:18.352 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-16T19:30:18.353 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-16T19:30:18.353 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-16T19:30:18.353 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-16T19:30:18.354 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-16T19:30:18.354 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T19:30:18.355 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-16T19:30:18.355 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-16T19:30:18.355 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-16T19:30:18.355 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-16T19:30:18.355 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-16T19:30:18.355 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-16T19:30:18.356 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-16T19:30:18.356 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-16T19:30:18.356 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-16T19:30:18.356 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-16T19:30:18.356 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-16T19:30:18.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-16T19:30:18.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-16T19:30:18.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-16T19:30:18.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-16T19:30:18.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-16T19:30:18.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-16T19:30:18.358 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-16T19:30:18.358 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-16T19:30:18.358 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-16T19:30:18.358 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-16T19:30:18.358 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-16T19:30:18.359 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-16T19:30:18.359 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-16T19:30:18.359 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-16T19:30:18.359 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-16T19:30:18.359 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-16T19:30:18.360 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-16T19:30:18.360 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-16T19:30:18.360 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-16T19:30:18.360 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-16T19:30:18.360 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-16T19:30:18.361 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-16T19:30:18.361 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-16T19:30:18.361 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-16T19:30:18.361 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-16T19:30:18.362 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-16T19:30:18.362 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-16T19:30:18.362 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-16T19:30:18.362 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-16T19:30:18.362 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-16T19:30:18.363 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-16T19:30:18.363 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-16T19:30:18.363 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-16T19:30:18.363 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-16T19:30:18.363 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-16T19:30:18.363 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-16T19:30:18.364 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-16T19:30:18.364 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-16T19:30:18.364 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-16T19:30:18.364 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-16T19:30:18.364 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-16T19:30:18.365 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-16T19:30:18.365 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-16T19:30:18.365 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2023-10-16T19:30:18.365 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-16T19:30:18.365 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:30:18.365 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2023-10-16T19:30:18.366 INFO:teuthology.orchestra.run.smithi110.stdout:==================================================================================================== 2023-10-16T19:30:18.366 INFO:teuthology.orchestra.run.smithi110.stdout:Install 155 Packages 2023-10-16T19:30:18.366 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 10 Packages 2023-10-16T19:30:18.366 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:30:18.367 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 2.1 G 2023-10-16T19:30:18.367 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2023-10-16T19:30:19.067 INFO:teuthology.orchestra.run.smithi110.stdout:(1/165): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2023-10-16T19:30:20.025 INFO:teuthology.orchestra.run.smithi110.stdout:(2/165): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 4.2 MB/s | 5.2 MB 00:01 2023-10-16T19:30:20.834 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T19:30:20.835 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T19:30:20.883 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-16T19:30:20.884 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-16T19:30:20.885 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T19:30:20.886 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-16T19:30:20.889 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T19:30:20.892 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-16T19:30:20.893 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T19:30:20.978 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-10-16T19:30:20.997 INFO:teuthology.orchestra.run.smithi057.stdout:==================================================================================================== 2023-10-16T19:30:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-10-16T19:30:20.998 INFO:teuthology.orchestra.run.smithi057.stdout:==================================================================================================== 2023-10-16T19:30:20.998 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-10-16T19:30:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-16T19:30:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-16T19:30:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-16T19:30:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 74 M 2023-10-16T19:30:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 410 M 2023-10-16T19:30:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-16T19:30:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.8 M 2023-10-16T19:30:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-16T19:30:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.4 M 2023-10-16T19:30:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 47 M 2023-10-16T19:30:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-16T19:30:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-16T19:30:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-16T19:30:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T19:30:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-16T19:30:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-16T19:30:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 112 M 2023-10-16T19:30:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 315 M 2023-10-16T19:30:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-16T19:30:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 174 M 2023-10-16T19:30:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-16T19:30:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 625 M 2023-10-16T19:30:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-16T19:30:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-16T19:30:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-16T19:30:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-16T19:30:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-16T19:30:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-16T19:30:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-16T19:30:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-16T19:30:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-16T19:30:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.1 M 2023-10-16T19:30:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T19:30:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 108 k 2023-10-16T19:30:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 M 2023-10-16T19:30:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 51 M 2023-10-16T19:30:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-16T19:30:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-16T19:30:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-16T19:30:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-16T19:30:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-16T19:30:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-16T19:30:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-16T19:30:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 615 k 2023-10-16T19:30:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-16T19:30:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 770 k 2023-10-16T19:30:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-16T19:30:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.1 M 2023-10-16T19:30:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-16T19:30:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 337 k 2023-10-16T19:30:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-16T19:30:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 506 k 2023-10-16T19:30:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T19:30:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 51 M 2023-10-16T19:30:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-16T19:30:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.2 M 2023-10-16T19:30:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-16T19:30:21.017 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-10-16T19:30:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-16T19:30:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-16T19:30:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-16T19:30:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-16T19:30:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-16T19:30:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-16T19:30:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-16T19:30:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-16T19:30:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T19:30:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-16T19:30:21.020 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-10-16T19:30:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-16T19:30:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-16T19:30:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T19:30:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-debuginfo x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 20 M 2023-10-16T19:30:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-16T19:30:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-16T19:30:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-16T19:30:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-16T19:30:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-16T19:30:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-16T19:30:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-16T19:30:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-16T19:30:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-16T19:30:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-16T19:30:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-16T19:30:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-16T19:30:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-16T19:30:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-16T19:30:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-16T19:30:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-16T19:30:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-16T19:30:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-16T19:30:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-16T19:30:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-16T19:30:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-16T19:30:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-16T19:30:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-16T19:30:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-16T19:30:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-16T19:30:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-16T19:30:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-16T19:30:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-16T19:30:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-16T19:30:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-16T19:30:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-16T19:30:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-16T19:30:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-16T19:30:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-16T19:30:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-16T19:30:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-16T19:30:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-16T19:30:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-16T19:30:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T19:30:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-16T19:30:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-16T19:30:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-16T19:30:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-16T19:30:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-16T19:30:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-16T19:30:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-16T19:30:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-16T19:30:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-16T19:30:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-16T19:30:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-16T19:30:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-16T19:30:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-16T19:30:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-16T19:30:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-16T19:30:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-16T19:30:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-16T19:30:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-16T19:30:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-16T19:30:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-16T19:30:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-16T19:30:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-16T19:30:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-16T19:30:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-16T19:30:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-16T19:30:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-16T19:30:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-16T19:30:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-16T19:30:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-16T19:30:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-16T19:30:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-16T19:30:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-16T19:30:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-16T19:30:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-16T19:30:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-16T19:30:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-16T19:30:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-16T19:30:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-16T19:30:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-16T19:30:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-16T19:30:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-16T19:30:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-16T19:30:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-16T19:30:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-16T19:30:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-16T19:30:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-16T19:30:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-16T19:30:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-16T19:30:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-16T19:30:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-16T19:30:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-16T19:30:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-16T19:30:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-16T19:30:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-16T19:30:21.042 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2023-10-16T19:30:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-16T19:30:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:30:21.043 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-10-16T19:30:21.043 INFO:teuthology.orchestra.run.smithi057.stdout:==================================================================================================== 2023-10-16T19:30:21.043 INFO:teuthology.orchestra.run.smithi057.stdout:Install 155 Packages 2023-10-16T19:30:21.043 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 10 Packages 2023-10-16T19:30:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:30:21.044 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.1 G 2023-10-16T19:30:21.045 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-10-16T19:30:21.476 INFO:teuthology.orchestra.run.smithi057.stdout:(1/165): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 27 kB/s | 6.5 kB 00:00 2023-10-16T19:30:23.951 INFO:teuthology.orchestra.run.smithi057.stdout:(2/165): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 1.9 MB/s | 5.2 MB 00:02 2023-10-16T19:30:24.594 INFO:teuthology.orchestra.run.smithi057.stdout:(3/165): ceph-common-18.0.0-6730.g4ba8a190.el9. 6.1 MB/s | 19 MB 00:03 2023-10-16T19:30:25.309 INFO:teuthology.orchestra.run.smithi110.stdout:(3/165): ceph-base-debuginfo-18.0.0-6730.g4ba8a 11 MB/s | 74 MB 00:06 2023-10-16T19:30:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:(4/165): ceph-common-18.0.0-6730.g4ba8a190.el9. 2.9 MB/s | 19 MB 00:06 2023-10-16T19:30:26.045 INFO:teuthology.orchestra.run.smithi110.stdout:(5/165): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 2.0 MB/s | 855 kB 00:00 2023-10-16T19:30:26.352 INFO:teuthology.orchestra.run.smithi057.stdout:(4/165): ceph-debuginfo-18.0.0-6730.g4ba8a190.e 12 MB/s | 20 MB 00:01 2023-10-16T19:30:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:(5/165): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 4.8 MB/s | 855 kB 00:00 2023-10-16T19:30:27.353 INFO:teuthology.orchestra.run.smithi110.stdout:(6/165): ceph-fuse-debuginfo-18.0.0-6730.g4ba8a 4.4 MB/s | 5.8 MB 00:01 2023-10-16T19:30:27.428 INFO:teuthology.orchestra.run.smithi057.stdout:(6/165): ceph-fuse-debuginfo-18.0.0-6730.g4ba8a 6.4 MB/s | 5.8 MB 00:00 2023-10-16T19:30:27.428 INFO:teuthology.orchestra.run.smithi110.stdout:(7/165): ceph-immutable-object-cache-18.0.0-673 1.9 MB/s | 141 kB 00:00 2023-10-16T19:30:27.486 INFO:teuthology.orchestra.run.smithi057.stdout:(7/165): ceph-immutable-object-cache-18.0.0-673 2.4 MB/s | 141 kB 00:00 2023-10-16T19:30:27.703 INFO:teuthology.orchestra.run.smithi057.stdout:(8/165): ceph-immutable-object-cache-debuginfo- 6.7 MB/s | 1.4 MB 00:00 2023-10-16T19:30:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:(8/165): ceph-debuginfo-18.0.0-6730.g4ba8a190.e 7.9 MB/s | 20 MB 00:02 2023-10-16T19:30:27.920 INFO:teuthology.orchestra.run.smithi057.stdout:(9/165): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 9.7 MB/s | 2.1 MB 00:00 2023-10-16T19:30:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:(9/165): ceph-immutable-object-cache-debuginfo- 2.8 MB/s | 1.4 MB 00:00 2023-10-16T19:30:28.172 INFO:teuthology.orchestra.run.smithi110.stdout:(10/165): ceph-mds-18.0.0-6730.g4ba8a190.el9.x8 6.8 MB/s | 2.1 MB 00:00 2023-10-16T19:30:28.422 INFO:teuthology.orchestra.run.smithi110.stdout:(11/165): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x8 5.9 MB/s | 1.5 MB 00:00 2023-10-16T19:30:31.047 INFO:teuthology.orchestra.run.smithi110.stdout:(12/165): ceph-mgr-debuginfo-18.0.0-6730.g4ba8a 7.3 MB/s | 19 MB 00:02 2023-10-16T19:30:31.772 INFO:teuthology.orchestra.run.smithi110.stdout:(13/165): ceph-mon-18.0.0-6730.g4ba8a190.el9.x8 6.0 MB/s | 4.4 MB 00:00 2023-10-16T19:30:34.053 INFO:teuthology.orchestra.run.smithi057.stdout:(10/165): ceph-mds-debuginfo-18.0.0-6730.g4ba8a 7.7 MB/s | 47 MB 00:06 2023-10-16T19:30:34.445 INFO:teuthology.orchestra.run.smithi057.stdout:(11/165): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x8 3.7 MB/s | 1.5 MB 00:00 2023-10-16T19:30:38.654 INFO:teuthology.orchestra.run.smithi057.stdout:(12/165): ceph-mgr-debuginfo-18.0.0-6730.g4ba8a 4.6 MB/s | 19 MB 00:04 2023-10-16T19:30:38.988 INFO:teuthology.orchestra.run.smithi110.stdout:(14/165): ceph-mds-debuginfo-18.0.0-6730.g4ba8a 4.3 MB/s | 47 MB 00:11 2023-10-16T19:30:39.845 INFO:teuthology.orchestra.run.smithi057.stdout:(13/165): ceph-mon-18.0.0-6730.g4ba8a190.el9.x8 3.7 MB/s | 4.4 MB 00:01 2023-10-16T19:30:42.639 INFO:teuthology.orchestra.run.smithi110.stdout:(15/165): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 4.8 MB/s | 18 MB 00:03 2023-10-16T19:30:53.462 INFO:teuthology.orchestra.run.smithi057.stdout:(14/165): ceph-base-debuginfo-18.0.0-6730.g4ba8 2.3 MB/s | 74 MB 00:32 2023-10-16T19:30:54.830 INFO:teuthology.orchestra.run.smithi110.stdout:(16/165): ceph-mon-debuginfo-18.0.0-6730.g4ba8a 4.9 MB/s | 112 MB 00:23 2023-10-16T19:30:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:(15/165): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 8.3 MB/s | 18 MB 00:02 2023-10-16T19:30:56.513 INFO:teuthology.orchestra.run.smithi110.stdout:(17/165): ceph-radosgw-18.0.0-6730.g4ba8a190.el 5.1 MB/s | 8.6 MB 00:01 2023-10-16T19:31:09.435 INFO:teuthology.orchestra.run.smithi057.stdout:(16/165): ceph-mon-debuginfo-18.0.0-6730.g4ba8a 3.8 MB/s | 112 MB 00:29 2023-10-16T19:31:11.035 INFO:teuthology.orchestra.run.smithi057.stdout:(17/165): ceph-radosgw-18.0.0-6730.g4ba8a190.el 5.4 MB/s | 8.6 MB 00:01 2023-10-16T19:31:42.676 INFO:teuthology.orchestra.run.smithi110.stdout:(18/165): ceph-radosgw-debuginfo-18.0.0-6730.g4 3.8 MB/s | 174 MB 00:46 2023-10-16T19:31:42.810 INFO:teuthology.orchestra.run.smithi110.stdout:(19/165): ceph-selinux-18.0.0-6730.g4ba8a190.el 181 kB/s | 24 kB 00:00 2023-10-16T19:31:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:(18/165): ceph-osd-debuginfo-18.0.0-6730.g4ba8a 6.5 MB/s | 315 MB 00:48 2023-10-16T19:31:44.287 INFO:teuthology.orchestra.run.smithi057.stdout:(19/165): ceph-selinux-18.0.0-6730.g4ba8a190.el 194 kB/s | 24 kB 00:00 2023-10-16T19:31:50.395 INFO:teuthology.orchestra.run.smithi057.stdout:(20/165): ceph-radosgw-debuginfo-18.0.0-6730.g4 4.4 MB/s | 174 MB 00:39 2023-10-16T19:31:50.618 INFO:teuthology.orchestra.run.smithi110.stdout:(20/165): ceph-osd-debuginfo-18.0.0-6730.g4ba8a 4.6 MB/s | 315 MB 01:07 2023-10-16T19:31:54.634 INFO:teuthology.orchestra.run.smithi110.stdout:(21/165): ceph-common-debuginfo-18.0.0-6730.g4b 4.3 MB/s | 410 MB 01:34 2023-10-16T19:31:54.851 INFO:teuthology.orchestra.run.smithi110.stdout:(22/165): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.0 MB/s | 218 kB 00:00 2023-10-16T19:31:54.943 INFO:teuthology.orchestra.run.smithi110.stdout:(23/165): libcephfs-devel-18.0.0-6730.g4ba8a190 344 kB/s | 31 kB 00:00 2023-10-16T19:31:55.136 INFO:teuthology.orchestra.run.smithi057.stdout:(21/165): ceph-common-debuginfo-18.0.0-6730.g4b 4.5 MB/s | 410 MB 01:31 2023-10-16T19:31:55.493 INFO:teuthology.orchestra.run.smithi110.stdout:(24/165): ceph-test-18.0.0-6730.g4ba8a190.el9.x 3.2 MB/s | 41 MB 00:12 2023-10-16T19:31:55.526 INFO:teuthology.orchestra.run.smithi110.stdout:(25/165): libcephfs2-18.0.0-6730.g4ba8a190.el9. 1.2 MB/s | 715 kB 00:00 2023-10-16T19:31:55.628 INFO:teuthology.orchestra.run.smithi057.stdout:(22/165): ceph-test-18.0.0-6730.g4ba8a190.el9.x 3.6 MB/s | 41 MB 00:11 2023-10-16T19:31:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:(26/165): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.2 MB/s | 163 kB 00:00 2023-10-16T19:31:55.662 INFO:teuthology.orchestra.run.smithi057.stdout:(23/165): cephfs-mirror-18.0.0-6730.g4ba8a190.e 416 kB/s | 218 kB 00:00 2023-10-16T19:31:55.736 INFO:teuthology.orchestra.run.smithi110.stdout:(27/165): librados-devel-18.0.0-6730.g4ba8a190. 1.7 MB/s | 127 kB 00:00 2023-10-16T19:31:55.762 INFO:teuthology.orchestra.run.smithi057.stdout:(24/165): libcephfs-devel-18.0.0-6730.g4ba8a190 235 kB/s | 31 kB 00:00 2023-10-16T19:31:55.819 INFO:teuthology.orchestra.run.smithi110.stdout:(28/165): librados-devel-debuginfo-18.0.0-6730. 1.3 MB/s | 108 kB 00:00 2023-10-16T19:31:55.879 INFO:teuthology.orchestra.run.smithi057.stdout:(25/165): libcephfs2-18.0.0-6730.g4ba8a190.el9. 3.2 MB/s | 715 kB 00:00 2023-10-16T19:31:55.979 INFO:teuthology.orchestra.run.smithi057.stdout:(26/165): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.6 MB/s | 163 kB 00:00 2023-10-16T19:31:56.071 INFO:teuthology.orchestra.run.smithi057.stdout:(27/165): librados-devel-18.0.0-6730.g4ba8a190. 1.4 MB/s | 127 kB 00:00 2023-10-16T19:31:56.180 INFO:teuthology.orchestra.run.smithi057.stdout:(28/165): librados-devel-debuginfo-18.0.0-6730. 1.0 MB/s | 108 kB 00:00 2023-10-16T19:31:56.778 INFO:teuthology.orchestra.run.smithi110.stdout:(29/165): libcephfs2-debuginfo-18.0.0-6730.g4ba 4.0 MB/s | 5.1 MB 00:01 2023-10-16T19:31:56.961 INFO:teuthology.orchestra.run.smithi110.stdout:(30/165): libradosstriper1-18.0.0-6730.g4ba8a19 2.5 MB/s | 472 kB 00:00 2023-10-16T19:31:57.513 INFO:teuthology.orchestra.run.smithi057.stdout:(29/165): libcephfs2-debuginfo-18.0.0-6730.g4ba 2.9 MB/s | 5.1 MB 00:01 2023-10-16T19:31:57.739 INFO:teuthology.orchestra.run.smithi057.stdout:(30/165): libradosstriper1-18.0.0-6730.g4ba8a19 2.1 MB/s | 472 kB 00:00 2023-10-16T19:32:01.130 INFO:teuthology.orchestra.run.smithi057.stdout:(31/165): librados2-debuginfo-18.0.0-6730.g4ba8 9.1 MB/s | 45 MB 00:04 2023-10-16T19:32:01.761 INFO:teuthology.orchestra.run.smithi057.stdout:(32/165): librgw2-18.0.0-6730.g4ba8a190.el9.x86 7.6 MB/s | 4.8 MB 00:00 2023-10-16T19:32:01.839 INFO:teuthology.orchestra.run.smithi057.stdout:(33/165): python3-ceph-argparse-18.0.0-6730.g4b 585 kB/s | 45 kB 00:00 2023-10-16T19:32:01.948 INFO:teuthology.orchestra.run.smithi057.stdout:(34/165): python3-ceph-common-18.0.0-6730.g4ba8 1.1 MB/s | 127 kB 00:00 2023-10-16T19:32:02.107 INFO:teuthology.orchestra.run.smithi057.stdout:(35/165): python3-cephfs-18.0.0-6730.g4ba8a190. 1.0 MB/s | 162 kB 00:00 2023-10-16T19:32:02.365 INFO:teuthology.orchestra.run.smithi057.stdout:(36/165): python3-cephfs-debuginfo-18.0.0-6730. 2.3 MB/s | 615 kB 00:00 2023-10-16T19:32:02.474 INFO:teuthology.orchestra.run.smithi057.stdout:(37/165): python3-rados-18.0.0-6730.g4ba8a190.e 2.9 MB/s | 321 kB 00:00 2023-10-16T19:32:02.608 INFO:teuthology.orchestra.run.smithi057.stdout:(38/165): python3-rados-debuginfo-18.0.0-6730.g 5.7 MB/s | 770 kB 00:00 2023-10-16T19:32:02.708 INFO:teuthology.orchestra.run.smithi057.stdout:(39/165): python3-rbd-18.0.0-6730.g4ba8a190.el9 2.9 MB/s | 298 kB 00:00 2023-10-16T19:32:02.908 INFO:teuthology.orchestra.run.smithi057.stdout:(40/165): python3-rbd-debuginfo-18.0.0-6730.g4b 5.6 MB/s | 1.1 MB 00:00 2023-10-16T19:32:03.017 INFO:teuthology.orchestra.run.smithi057.stdout:(41/165): python3-rgw-18.0.0-6730.g4ba8a190.el9 926 kB/s | 99 kB 00:00 2023-10-16T19:32:03.125 INFO:teuthology.orchestra.run.smithi057.stdout:(42/165): python3-rgw-debuginfo-18.0.0-6730.g4b 3.1 MB/s | 337 kB 00:00 2023-10-16T19:32:03.209 INFO:teuthology.orchestra.run.smithi057.stdout:(43/165): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.0 MB/s | 85 kB 00:00 2023-10-16T19:32:03.359 INFO:teuthology.orchestra.run.smithi057.stdout:(44/165): rbd-fuse-debuginfo-18.0.0-6730.g4ba8a 3.3 MB/s | 506 kB 00:00 2023-10-16T19:32:03.760 INFO:teuthology.orchestra.run.smithi057.stdout:(45/165): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 7.6 MB/s | 3.0 MB 00:00 2023-10-16T19:32:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:(31/165): librados2-debuginfo-18.0.0-6730.g4ba8 4.3 MB/s | 45 MB 00:10 2023-10-16T19:32:07.761 INFO:teuthology.orchestra.run.smithi110.stdout:(32/165): librgw2-18.0.0-6730.g4ba8a190.el9.x86 3.3 MB/s | 4.8 MB 00:01 2023-10-16T19:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout:(33/165): python3-ceph-argparse-18.0.0-6730.g4b 389 kB/s | 45 kB 00:00 2023-10-16T19:32:08.003 INFO:teuthology.orchestra.run.smithi110.stdout:(34/165): python3-ceph-common-18.0.0-6730.g4ba8 1.0 MB/s | 127 kB 00:00 2023-10-16T19:32:08.128 INFO:teuthology.orchestra.run.smithi110.stdout:(35/165): python3-cephfs-18.0.0-6730.g4ba8a190. 1.3 MB/s | 162 kB 00:00 2023-10-16T19:32:08.337 INFO:teuthology.orchestra.run.smithi110.stdout:(36/165): python3-cephfs-debuginfo-18.0.0-6730. 2.9 MB/s | 615 kB 00:00 2023-10-16T19:32:08.470 INFO:teuthology.orchestra.run.smithi110.stdout:(37/165): python3-rados-18.0.0-6730.g4ba8a190.e 2.4 MB/s | 321 kB 00:00 2023-10-16T19:32:08.679 INFO:teuthology.orchestra.run.smithi110.stdout:(38/165): python3-rados-debuginfo-18.0.0-6730.g 3.6 MB/s | 770 kB 00:00 2023-10-16T19:32:09.085 INFO:teuthology.orchestra.run.smithi057.stdout:(46/165): rbd-mirror-debuginfo-18.0.0-6730.g4ba 9.6 MB/s | 51 MB 00:05 2023-10-16T19:32:09.202 INFO:teuthology.orchestra.run.smithi057.stdout:(47/165): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 1.4 MB/s | 169 kB 00:00 2023-10-16T19:32:09.427 INFO:teuthology.orchestra.run.smithi057.stdout:(48/165): rbd-nbd-debuginfo-18.0.0-6730.g4ba8a1 5.5 MB/s | 1.2 MB 00:00 2023-10-16T19:32:09.511 INFO:teuthology.orchestra.run.smithi057.stdout:(49/165): ceph-grafana-dashboards-18.0.0-6730.g 282 kB/s | 23 kB 00:00 2023-10-16T19:32:09.546 INFO:teuthology.orchestra.run.smithi110.stdout:(39/165): python3-rbd-18.0.0-6730.g4ba8a190.el9 344 kB/s | 298 kB 00:00 2023-10-16T19:32:09.628 INFO:teuthology.orchestra.run.smithi057.stdout:(50/165): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.1 MB/s | 132 kB 00:00 2023-10-16T19:32:09.871 INFO:teuthology.orchestra.run.smithi110.stdout:(40/165): python3-rbd-debuginfo-18.0.0-6730.g4b 3.5 MB/s | 1.1 MB 00:00 2023-10-16T19:32:09.949 INFO:teuthology.orchestra.run.smithi110.stdout:(41/165): python3-rgw-18.0.0-6730.g4ba8a190.el9 1.3 MB/s | 99 kB 00:00 2023-10-16T19:32:09.953 INFO:teuthology.orchestra.run.smithi057.stdout:(51/165): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 5.4 MB/s | 1.8 MB 00:00 2023-10-16T19:32:10.483 INFO:teuthology.orchestra.run.smithi110.stdout:(42/165): librbd1-debuginfo-18.0.0-6730.g4ba8a1 3.8 MB/s | 51 MB 00:13 2023-10-16T19:32:10.525 INFO:teuthology.orchestra.run.smithi110.stdout:(43/165): python3-rgw-debuginfo-18.0.0-6730.g4b 587 kB/s | 337 kB 00:00 2023-10-16T19:32:10.558 INFO:teuthology.orchestra.run.smithi110.stdout:(44/165): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.1 MB/s | 85 kB 00:00 2023-10-16T19:32:10.712 INFO:teuthology.orchestra.run.smithi057.stdout:(52/165): ceph-mgr-diskprediction-local-18.0.0- 9.8 MB/s | 7.4 MB 00:00 2023-10-16T19:32:10.742 INFO:teuthology.orchestra.run.smithi110.stdout:(45/165): rbd-fuse-debuginfo-18.0.0-6730.g4ba8a 2.3 MB/s | 506 kB 00:00 2023-10-16T19:32:10.804 INFO:teuthology.orchestra.run.smithi057.stdout:(53/165): ceph-mgr-modules-core-18.0.0-6730.g4b 2.6 MB/s | 242 kB 00:00 2023-10-16T19:32:10.887 INFO:teuthology.orchestra.run.smithi057.stdout:(54/165): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 575 kB/s | 47 kB 00:00 2023-10-16T19:32:10.971 INFO:teuthology.orchestra.run.smithi057.stdout:(55/165): ceph-prometheus-alerts-18.0.0-6730.g4 183 kB/s | 15 kB 00:00 2023-10-16T19:32:11.001 INFO:teuthology.orchestra.run.smithi110.stdout:(46/165): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 6.8 MB/s | 3.0 MB 00:00 2023-10-16T19:32:11.054 INFO:teuthology.orchestra.run.smithi057.stdout:(56/165): ceph-volume-18.0.0-6730.g4ba8a190.el9 3.1 MB/s | 262 kB 00:00 2023-10-16T19:32:11.068 INFO:teuthology.orchestra.run.smithi110.stdout:(47/165): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.5 MB/s | 169 kB 00:00 2023-10-16T19:32:11.140 INFO:teuthology.orchestra.run.smithi057.stdout:(57/165): cephadm-18.0.0-6730.g4ba8a190.el9.noa 3.1 MB/s | 269 kB 00:00 2023-10-16T19:32:11.241 INFO:teuthology.orchestra.run.smithi057.stdout:(58/165): cephfs-top-18.0.0-6730.g4ba8a190.el9. 184 kB/s | 18 kB 00:00 2023-10-16T19:32:11.302 INFO:teuthology.orchestra.run.smithi110.stdout:(48/165): rbd-nbd-debuginfo-18.0.0-6730.g4ba8a1 5.3 MB/s | 1.2 MB 00:00 2023-10-16T19:32:11.352 INFO:teuthology.orchestra.run.smithi110.stdout:(49/165): ceph-grafana-dashboards-18.0.0-6730.g 472 kB/s | 23 kB 00:00 2023-10-16T19:32:11.411 INFO:teuthology.orchestra.run.smithi110.stdout:(50/165): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.3 MB/s | 132 kB 00:00 2023-10-16T19:32:11.620 INFO:teuthology.orchestra.run.smithi110.stdout:(51/165): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 8.5 MB/s | 1.8 MB 00:00 2023-10-16T19:32:11.925 INFO:teuthology.orchestra.run.smithi057.stdout:(59/165): librbd1-debuginfo-18.0.0-6730.g4ba8a1 3.6 MB/s | 51 MB 00:14 2023-10-16T19:32:12.041 INFO:teuthology.orchestra.run.smithi057.stdout:(60/165): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 920 kB 00:00 2023-10-16T19:32:12.067 INFO:teuthology.orchestra.run.smithi057.stdout:(61/165): boost-program-options-1.75.0-8.el9.x8 772 kB/s | 106 kB 00:00 2023-10-16T19:32:12.117 INFO:teuthology.orchestra.run.smithi057.stdout:(62/165): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-10-16T19:32:12.134 INFO:teuthology.orchestra.run.smithi057.stdout:(63/165): flexiblas-3.0.4-8.el9.x86_64.rpm 484 kB/s | 32 kB 00:00 2023-10-16T19:32:12.276 INFO:teuthology.orchestra.run.smithi057.stdout:(64/165): flexiblas-openblas-openmp-3.0.4-8.el9 122 kB/s | 17 kB 00:00 2023-10-16T19:32:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:(65/165): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2023-10-16T19:32:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:(66/165): libaio-devel-0.3.111-13.el9.x86_64.rp 98 kB/s | 10 kB 00:00 2023-10-16T19:32:12.394 INFO:teuthology.orchestra.run.smithi110.stdout:(52/165): ceph-mgr-diskprediction-local-18.0.0- 9.6 MB/s | 7.4 MB 00:00 2023-10-16T19:32:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:(67/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2023-10-16T19:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout:(53/165): ceph-mgr-modules-core-18.0.0-6730.g4b 4.1 MB/s | 242 kB 00:00 2023-10-16T19:32:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:(68/165): librdkafka-1.6.1-102.el9.x86_64.rpm 8.0 MB/s | 661 kB 00:00 2023-10-16T19:32:12.503 INFO:teuthology.orchestra.run.smithi110.stdout:(54/165): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 964 kB/s | 47 kB 00:00 2023-10-16T19:32:12.510 INFO:teuthology.orchestra.run.smithi057.stdout:(69/165): libtool-2.4.6-45.el9.x86_64.rpm 5.8 MB/s | 578 kB 00:00 2023-10-16T19:32:12.536 INFO:teuthology.orchestra.run.smithi057.stdout:(70/165): libzstd-devel-1.5.1-2.el9.x86_64.rpm 762 kB/s | 46 kB 00:00 2023-10-16T19:32:12.554 INFO:teuthology.orchestra.run.smithi110.stdout:(55/165): ceph-prometheus-alerts-18.0.0-6730.g4 307 kB/s | 15 kB 00:00 2023-10-16T19:32:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:(71/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-10-16T19:32:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:(72/165): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-10-16T19:32:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:(73/165): openblas-0.3.21-2.el9.x86_64.rpm 721 kB/s | 34 kB 00:00 2023-10-16T19:32:12.621 INFO:teuthology.orchestra.run.smithi110.stdout:(56/165): ceph-volume-18.0.0-6730.g4ba8a190.el9 3.9 MB/s | 262 kB 00:00 2023-10-16T19:32:12.688 INFO:teuthology.orchestra.run.smithi110.stdout:(57/165): cephadm-18.0.0-6730.g4ba8a190.el9.noa 4.0 MB/s | 269 kB 00:00 2023-10-16T19:32:12.746 INFO:teuthology.orchestra.run.smithi110.stdout:(58/165): cephfs-top-18.0.0-6730.g4ba8a190.el9. 317 kB/s | 18 kB 00:00 2023-10-16T19:32:12.870 INFO:teuthology.orchestra.run.smithi057.stdout:(74/165): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2023-10-16T19:32:12.937 INFO:teuthology.orchestra.run.smithi057.stdout:(75/165): postgresql-13.11-1.el9.x86_64.rpm 4.8 MB/s | 1.5 MB 00:00 2023-10-16T19:32:12.979 INFO:teuthology.orchestra.run.smithi057.stdout:(76/165): postgresql-contrib-13.11-1.el9.x86_64 8.4 MB/s | 811 kB 00:00 2023-10-16T19:32:13.004 INFO:teuthology.orchestra.run.smithi057.stdout:(77/165): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-10-16T19:32:13.080 INFO:teuthology.orchestra.run.smithi110.stdout:(59/165): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 920 kB 00:00 2023-10-16T19:32:13.147 INFO:teuthology.orchestra.run.smithi110.stdout:(60/165): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-10-16T19:32:13.214 INFO:teuthology.orchestra.run.smithi110.stdout:(61/165): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2023-10-16T19:32:13.221 INFO:teuthology.orchestra.run.smithi057.stdout:(78/165): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2023-10-16T19:32:13.273 INFO:teuthology.orchestra.run.smithi110.stdout:(62/165): flexiblas-3.0.4-8.el9.x86_64.rpm 550 kB/s | 32 kB 00:00 2023-10-16T19:32:13.405 INFO:teuthology.orchestra.run.smithi057.stdout:(79/165): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-10-16T19:32:13.430 INFO:teuthology.orchestra.run.smithi057.stdout:(80/165): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 205 kB 00:00 2023-10-16T19:32:13.464 INFO:teuthology.orchestra.run.smithi057.stdout:(81/165): python3-jinja2-2.11.3-4.el9.noarch.rp 3.9 MB/s | 228 kB 00:00 2023-10-16T19:32:13.464 INFO:teuthology.orchestra.run.smithi110.stdout:(63/165): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2023-10-16T19:32:13.489 INFO:teuthology.orchestra.run.smithi057.stdout:(82/165): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 24 kB 00:00 2023-10-16T19:32:13.506 INFO:teuthology.orchestra.run.smithi110.stdout:(64/165): flexiblas-openblas-openmp-3.0.4-8.el9 421 kB/s | 17 kB 00:00 2023-10-16T19:32:13.514 INFO:teuthology.orchestra.run.smithi057.stdout:(83/165): python3-jsonpointer-2.0-4.el9.noarch. 370 kB/s | 18 kB 00:00 2023-10-16T19:32:13.539 INFO:teuthology.orchestra.run.smithi057.stdout:(84/165): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-10-16T19:32:13.548 INFO:teuthology.orchestra.run.smithi110.stdout:(65/165): libaio-devel-0.3.111-13.el9.x86_64.rp 246 kB/s | 10 kB 00:00 2023-10-16T19:32:13.573 INFO:teuthology.orchestra.run.smithi057.stdout:(85/165): python3-markupsafe-1.1.1-12.el9.x86_6 558 kB/s | 32 kB 00:00 2023-10-16T19:32:13.599 INFO:teuthology.orchestra.run.smithi110.stdout:(66/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2023-10-16T19:32:13.691 INFO:teuthology.orchestra.run.smithi110.stdout:(67/165): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 661 kB 00:00 2023-10-16T19:32:13.750 INFO:teuthology.orchestra.run.smithi110.stdout:(68/165): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-10-16T19:32:13.782 INFO:teuthology.orchestra.run.smithi057.stdout:(86/165): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2023-10-16T19:32:13.783 INFO:teuthology.orchestra.run.smithi110.stdout:(69/165): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-10-16T19:32:13.815 INFO:teuthology.orchestra.run.smithi057.stdout:(87/165): python3-numpy-f2py-1.20.1-5.el9.x86_6 952 kB/s | 217 kB 00:00 2023-10-16T19:32:13.833 INFO:teuthology.orchestra.run.smithi110.stdout:(70/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2023-10-16T19:32:13.875 INFO:teuthology.orchestra.run.smithi057.stdout:(88/165): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 174 kB 00:00 2023-10-16T19:32:13.884 INFO:teuthology.orchestra.run.smithi110.stdout:(71/165): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-10-16T19:32:13.908 INFO:teuthology.orchestra.run.smithi057.stdout:(89/165): python3-prettytable-0.7.2-27.el9.noar 460 kB/s | 41 kB 00:00 2023-10-16T19:32:13.918 INFO:teuthology.orchestra.run.smithi110.stdout:(72/165): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-16T19:32:13.933 INFO:teuthology.orchestra.run.smithi057.stdout:(90/165): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-10-16T19:32:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:(91/165): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-10-16T19:32:13.992 INFO:teuthology.orchestra.run.smithi057.stdout:(92/165): python3-requests-oauthlib-1.3.0-12.el 757 kB/s | 43 kB 00:00 2023-10-16T19:32:14.060 INFO:teuthology.orchestra.run.smithi110.stdout:(73/165): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2023-10-16T19:32:14.135 INFO:teuthology.orchestra.run.smithi110.stdout:(74/165): postgresql-13.11-1.el9.x86_64.rpm 21 MB/s | 1.5 MB 00:00 2023-10-16T19:32:14.202 INFO:teuthology.orchestra.run.smithi110.stdout:(75/165): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-10-16T19:32:14.244 INFO:teuthology.orchestra.run.smithi110.stdout:(76/165): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-10-16T19:32:14.326 INFO:teuthology.orchestra.run.smithi057.stdout:(93/165): python3-toml-0.10.2-6.el9.noarch.rpm 121 kB/s | 39 kB 00:00 2023-10-16T19:32:14.445 INFO:teuthology.orchestra.run.smithi110.stdout:(77/165): postgresql-server-13.11-1.el9.x86_64. 28 MB/s | 5.7 MB 00:00 2023-10-16T19:32:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:(94/165): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2023-10-16T19:32:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:(95/165): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-10-16T19:32:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:(96/165): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-10-16T19:32:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:(78/165): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 5.8 MB 00:00 2023-10-16T19:32:14.627 INFO:teuthology.orchestra.run.smithi057.stdout:(97/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-10-16T19:32:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:(79/165): python3-devel-3.9.17-2.el9.x86_64.rpm 4.9 MB/s | 205 kB 00:00 2023-10-16T19:32:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:(98/165): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-10-16T19:32:14.713 INFO:teuthology.orchestra.run.smithi110.stdout:(80/165): python3-jinja2-2.11.3-4.el9.noarch.rp 3.4 MB/s | 228 kB 00:00 2023-10-16T19:32:14.714 INFO:teuthology.orchestra.run.smithi057.stdout:(99/165): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.6 MB/s | 803 kB 00:00 2023-10-16T19:32:14.744 INFO:teuthology.orchestra.run.smithi057.stdout:(100/165): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.3 MB/s | 195 kB 00:00 2023-10-16T19:32:14.746 INFO:teuthology.orchestra.run.smithi110.stdout:(81/165): python3-jsonpatch-1.21-16.el9.noarch. 753 kB/s | 24 kB 00:00 2023-10-16T19:32:14.778 INFO:teuthology.orchestra.run.smithi057.stdout:(101/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-10-16T19:32:14.788 INFO:teuthology.orchestra.run.smithi110.stdout:(82/165): python3-jsonpointer-2.0-4.el9.noarch. 441 kB/s | 18 kB 00:00 2023-10-16T19:32:14.795 INFO:teuthology.orchestra.run.smithi057.stdout:(102/165): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-10-16T19:32:14.820 INFO:teuthology.orchestra.run.smithi057.stdout:(103/165): python3-pycparser-2.20-6.el9.noarch. 3.0 MB/s | 124 kB 00:00 2023-10-16T19:32:14.830 INFO:teuthology.orchestra.run.smithi110.stdout:(83/165): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2023-10-16T19:32:14.845 INFO:teuthology.orchestra.run.smithi057.stdout:(104/165): python3-requests-2.25.1-7.el9.noarch 2.3 MB/s | 113 kB 00:00 2023-10-16T19:32:14.863 INFO:teuthology.orchestra.run.smithi110.stdout:(84/165): python3-markupsafe-1.1.1-12.el9.x86_6 968 kB/s | 32 kB 00:00 2023-10-16T19:32:14.900 INFO:teuthology.orchestra.run.smithi057.stdout:(105/165): python3-urllib3-1.26.5-3.el9.noarch. 2.4 MB/s | 188 kB 00:00 2023-10-16T19:32:15.031 INFO:teuthology.orchestra.run.smithi110.stdout:(85/165): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2023-10-16T19:32:15.081 INFO:teuthology.orchestra.run.smithi110.stdout:(86/165): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 217 kB 00:00 2023-10-16T19:32:15.096 INFO:teuthology.orchestra.run.smithi057.stdout:(106/165): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2023-10-16T19:32:15.123 INFO:teuthology.orchestra.run.smithi110.stdout:(87/165): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-10-16T19:32:15.138 INFO:teuthology.orchestra.run.smithi057.stdout:(107/165): elfutils-libelf-devel-0.189-3.el9.x8 550 kB/s | 22 kB 00:00 2023-10-16T19:32:15.156 INFO:teuthology.orchestra.run.smithi110.stdout:(88/165): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-10-16T19:32:15.196 INFO:teuthology.orchestra.run.smithi057.stdout:(108/165): python3-cryptography-36.0.1-4.el9.x8 3.5 MB/s | 1.2 MB 00:00 2023-10-16T19:32:15.198 INFO:teuthology.orchestra.run.smithi110.stdout:(89/165): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-10-16T19:32:15.230 INFO:teuthology.orchestra.run.smithi057.stdout:(109/165): jq-1.6-15.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-10-16T19:32:15.240 INFO:teuthology.orchestra.run.smithi110.stdout:(90/165): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-10-16T19:32:15.274 INFO:teuthology.orchestra.run.smithi110.stdout:(91/165): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-10-16T19:32:15.314 INFO:teuthology.orchestra.run.smithi057.stdout:(110/165): libuuid-devel-2.37.4-15.el9.x86_64.r 310 kB/s | 26 kB 00:00 2023-10-16T19:32:15.339 INFO:teuthology.orchestra.run.smithi057.stdout:(111/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 320 kB/s | 45 kB 00:00 2023-10-16T19:32:15.439 INFO:teuthology.orchestra.run.smithi057.stdout:(112/165): python3-pytz-2021.1-5.el9.noarch.rpm 514 kB/s | 51 kB 00:00 2023-10-16T19:32:15.573 INFO:teuthology.orchestra.run.smithi057.stdout:(113/165): openssl-devel-3.0.7-24.el9.x86_64.rp 16 MB/s | 4.1 MB 00:00 2023-10-16T19:32:15.607 INFO:teuthology.orchestra.run.smithi057.stdout:(114/165): xfsprogs-devel-5.19.0-4.el9.x86_64.r 518 kB/s | 86 kB 00:00 2023-10-16T19:32:15.625 INFO:teuthology.orchestra.run.smithi110.stdout:(92/165): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2023-10-16T19:32:15.649 INFO:teuthology.orchestra.run.smithi057.stdout:(115/165): zlib-devel-1.2.11-40.el9.x86_64.rpm 606 kB/s | 45 kB 00:00 2023-10-16T19:32:15.666 INFO:teuthology.orchestra.run.smithi110.stdout:(93/165): python3-toml-0.10.2-6.el9.noarch.rpm 954 kB/s | 39 kB 00:00 2023-10-16T19:32:15.708 INFO:teuthology.orchestra.run.smithi110.stdout:(94/165): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2023-10-16T19:32:15.742 INFO:teuthology.orchestra.run.smithi110.stdout:(95/165): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-10-16T19:32:15.776 INFO:teuthology.orchestra.run.smithi110.stdout:(96/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2023-10-16T19:32:15.818 INFO:teuthology.orchestra.run.smithi110.stdout:(97/165): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2023-10-16T19:32:15.885 INFO:teuthology.orchestra.run.smithi110.stdout:(98/165): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-10-16T19:32:15.927 INFO:teuthology.orchestra.run.smithi110.stdout:(99/165): libquadmath-11.4.1-2.3.el9.x86_64.rpm 4.7 MB/s | 195 kB 00:00 2023-10-16T19:32:15.966 INFO:teuthology.orchestra.run.smithi057.stdout:(116/165): fmt-8.1.1-5.el9.x86_64.rpm 310 kB/s | 111 kB 00:00 2023-10-16T19:32:15.969 INFO:teuthology.orchestra.run.smithi110.stdout:(100/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.8 MB/s | 241 kB 00:00 2023-10-16T19:32:16.011 INFO:teuthology.orchestra.run.smithi110.stdout:(101/165): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2023-10-16T19:32:16.053 INFO:teuthology.orchestra.run.smithi110.stdout:(102/165): python3-pycparser-2.20-6.el9.noarch. 3.0 MB/s | 124 kB 00:00 2023-10-16T19:32:16.095 INFO:teuthology.orchestra.run.smithi110.stdout:(103/165): python3-requests-2.25.1-7.el9.noarch 2.7 MB/s | 113 kB 00:00 2023-10-16T19:32:16.099 INFO:teuthology.orchestra.run.smithi057.stdout:(117/165): gperftools-libs-2.9.1-2.el9.x86_64.r 687 kB/s | 309 kB 00:00 2023-10-16T19:32:16.137 INFO:teuthology.orchestra.run.smithi110.stdout:(104/165): python3-urllib3-1.26.5-3.el9.noarch. 4.5 MB/s | 188 kB 00:00 2023-10-16T19:32:16.158 INFO:teuthology.orchestra.run.smithi057.stdout:(118/165): libarrow-doc-9.0.0-9.el9.noarch.rpm 425 kB/s | 24 kB 00:00 2023-10-16T19:32:16.233 INFO:teuthology.orchestra.run.smithi057.stdout:(119/165): liboath-2.6.7-2.el9.x86_64.rpm 656 kB/s | 49 kB 00:00 2023-10-16T19:32:16.317 INFO:teuthology.orchestra.run.smithi057.stdout:(120/165): libunwind-1.6.2-1.el9.x86_64.rpm 818 kB/s | 67 kB 00:00 2023-10-16T19:32:16.734 INFO:teuthology.orchestra.run.smithi057.stdout:(121/165): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.0 MB/s | 837 kB 00:00 2023-10-16T19:32:16.983 INFO:teuthology.orchestra.run.smithi057.stdout:(122/165): python3-asyncssh-2.13.2-3.el9.noarch 2.2 MB/s | 548 kB 00:00 2023-10-16T19:32:17.059 INFO:teuthology.orchestra.run.smithi057.stdout:(123/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2023-10-16T19:32:17.118 INFO:teuthology.orchestra.run.smithi057.stdout:(124/165): python3-cachetools-4.2.4-1.el9.noarc 556 kB/s | 32 kB 00:00 2023-10-16T19:32:17.185 INFO:teuthology.orchestra.run.smithi057.stdout:(125/165): python3-certifi-2021.10.8-2.el9.noar 228 kB/s | 15 kB 00:00 2023-10-16T19:32:17.277 INFO:teuthology.orchestra.run.smithi057.stdout:(126/165): libarrow-9.0.0-9.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2023-10-16T19:32:17.327 INFO:teuthology.orchestra.run.smithi057.stdout:(127/165): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-10-16T19:32:17.396 INFO:teuthology.orchestra.run.smithi110.stdout:(105/165): python3-cryptography-36.0.1-4.el9.x8 998 kB/s | 1.2 MB 00:01 2023-10-16T19:32:17.410 INFO:teuthology.orchestra.run.smithi057.stdout:(128/165): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-10-16T19:32:17.444 INFO:teuthology.orchestra.run.smithi057.stdout:(129/165): python3-google-auth-2.23.2-1.el9.noa 1.7 MB/s | 196 kB 00:00 2023-10-16T19:32:17.495 INFO:teuthology.orchestra.run.smithi057.stdout:(130/165): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2023-10-16T19:32:17.528 INFO:teuthology.orchestra.run.smithi057.stdout:(131/165): python3-jaraco-classes-3.2.1-5.el9.n 213 kB/s | 18 kB 00:00 2023-10-16T19:32:17.570 INFO:teuthology.orchestra.run.smithi057.stdout:(132/165): python3-jaraco-collections-3.0.0-8.e 312 kB/s | 23 kB 00:00 2023-10-16T19:32:17.595 INFO:teuthology.orchestra.run.smithi057.stdout:(133/165): python3-jaraco-functools-3.5.0-2.el9 294 kB/s | 19 kB 00:00 2023-10-16T19:32:17.637 INFO:teuthology.orchestra.run.smithi057.stdout:(134/165): python3-jaraco-text-3.2.0-6.el9.noar 298 kB/s | 20 kB 00:00 2023-10-16T19:32:17.671 INFO:teuthology.orchestra.run.smithi057.stdout:(135/165): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-10-16T19:32:17.696 INFO:teuthology.orchestra.run.smithi057.stdout:(136/165): python3-jwt-2.4.0-1.el9.noarch.rpm 707 kB/s | 41 kB 00:00 2023-10-16T19:32:17.763 INFO:teuthology.orchestra.run.smithi057.stdout:(137/165): python3-logutils-0.3.5-21.el9.noarch 703 kB/s | 46 kB 00:00 2023-10-16T19:32:17.822 INFO:teuthology.orchestra.run.smithi057.stdout:(138/165): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-10-16T19:32:17.889 INFO:teuthology.orchestra.run.smithi057.stdout:(139/165): python3-natsort-7.1.1-5.el9.noarch.r 879 kB/s | 58 kB 00:00 2023-10-16T19:32:17.939 INFO:teuthology.orchestra.run.smithi057.stdout:(140/165): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2023-10-16T19:32:18.007 INFO:teuthology.orchestra.run.smithi057.stdout:(141/165): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-10-16T19:32:18.039 INFO:teuthology.orchestra.run.smithi057.stdout:(142/165): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2023-10-16T19:32:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:(143/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-10-16T19:32:18.115 INFO:teuthology.orchestra.run.smithi057.stdout:(144/165): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2023-10-16T19:32:18.157 INFO:teuthology.orchestra.run.smithi057.stdout:(145/165): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2023-10-16T19:32:18.182 INFO:teuthology.orchestra.run.smithi057.stdout:(146/165): python3-rsa-4.9-2.el9.noarch.rpm 894 kB/s | 59 kB 00:00 2023-10-16T19:32:18.224 INFO:teuthology.orchestra.run.smithi057.stdout:(147/165): python3-tempora-5.0.0-2.el9.noarch.r 543 kB/s | 36 kB 00:00 2023-10-16T19:32:18.250 INFO:teuthology.orchestra.run.smithi057.stdout:(148/165): python3-typing-extensions-4.4.0-2.el 771 kB/s | 51 kB 00:00 2023-10-16T19:32:18.288 INFO:teuthology.orchestra.run.smithi110.stdout:(106/165): rbd-mirror-debuginfo-18.0.0-6730.g4b 6.7 MB/s | 51 MB 00:07 2023-10-16T19:32:18.300 INFO:teuthology.orchestra.run.smithi057.stdout:(149/165): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-10-16T19:32:18.325 INFO:teuthology.orchestra.run.smithi057.stdout:(150/165): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-10-16T19:32:18.329 INFO:teuthology.orchestra.run.smithi110.stdout:(107/165): automake-1.16.2-8.el9.noarch.rpm 739 kB/s | 689 kB 00:00 2023-10-16T19:32:18.375 INFO:teuthology.orchestra.run.smithi057.stdout:(151/165): python3-zc-lockfile-2.0-10.el9.noarc 406 kB/s | 20 kB 00:00 2023-10-16T19:32:18.409 INFO:teuthology.orchestra.run.smithi057.stdout:(152/165): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2023-10-16T19:32:18.421 INFO:teuthology.orchestra.run.smithi110.stdout:(108/165): elfutils-libelf-devel-0.189-3.el9.x8 168 kB/s | 22 kB 00:00 2023-10-16T19:32:18.451 INFO:teuthology.orchestra.run.smithi057.stdout:(153/165): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-10-16T19:32:18.505 INFO:teuthology.orchestra.run.smithi110.stdout:(109/165): jq-1.6-15.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-10-16T19:32:18.564 INFO:teuthology.orchestra.run.smithi110.stdout:(110/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 320 kB/s | 45 kB 00:00 2023-10-16T19:32:18.589 INFO:teuthology.orchestra.run.smithi110.stdout:(111/165): libuuid-devel-2.37.4-15.el9.x86_64.r 308 kB/s | 26 kB 00:00 2023-10-16T19:32:18.643 INFO:teuthology.orchestra.run.smithi057.stdout:(154/165): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2023-10-16T19:32:18.648 INFO:teuthology.orchestra.run.smithi110.stdout:(112/165): python3-pytz-2021.1-5.el9.noarch.rpm 885 kB/s | 51 kB 00:00 2023-10-16T19:32:18.740 INFO:teuthology.orchestra.run.smithi110.stdout:(113/165): xfsprogs-devel-5.19.0-4.el9.x86_64.r 949 kB/s | 86 kB 00:00 2023-10-16T19:32:18.807 INFO:teuthology.orchestra.run.smithi110.stdout:(114/165): zlib-devel-1.2.11-40.el9.x86_64.rpm 687 kB/s | 45 kB 00:00 2023-10-16T19:32:19.041 INFO:teuthology.orchestra.run.smithi110.stdout:(115/165): fmt-8.1.1-5.el9.x86_64.rpm 476 kB/s | 111 kB 00:00 2023-10-16T19:32:19.157 INFO:teuthology.orchestra.run.smithi110.stdout:(116/165): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2023-10-16T19:32:19.443 INFO:teuthology.orchestra.run.smithi057.stdout:(155/165): librados2-18.0.0-6730.g4ba8a190.el9. 3.3 MB/s | 3.3 MB 00:00 2023-10-16T19:32:19.485 INFO:teuthology.orchestra.run.smithi057.stdout:(156/165): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-10-16T19:32:19.602 INFO:teuthology.orchestra.run.smithi057.stdout:(157/165): librbd1-18.0.0-6730.g4ba8a190.el9.x8 3.2 MB/s | 3.0 MB 00:00 2023-10-16T19:32:19.677 INFO:teuthology.orchestra.run.smithi057.stdout:(158/165): NetworkManager-1.45.4-1.el9.x86_64.r 12 MB/s | 2.2 MB 00:00 2023-10-16T19:32:19.783 INFO:teuthology.orchestra.run.smithi110.stdout:(117/165): openssl-devel-3.0.7-24.el9.x86_64.rp 3.4 MB/s | 4.1 MB 00:01 2023-10-16T19:32:19.983 INFO:teuthology.orchestra.run.smithi110.stdout:(118/165): libarrow-doc-9.0.0-9.el9.noarch.rpm 122 kB/s | 24 kB 00:00 2023-10-16T19:32:20.050 INFO:teuthology.orchestra.run.smithi110.stdout:(119/165): liboath-2.6.7-2.el9.x86_64.rpm 740 kB/s | 49 kB 00:00 2023-10-16T19:32:20.126 INFO:teuthology.orchestra.run.smithi110.stdout:(120/165): libunwind-1.6.2-1.el9.x86_64.rpm 906 kB/s | 67 kB 00:00 2023-10-16T19:32:20.144 INFO:teuthology.orchestra.run.smithi057.stdout:(159/165): NetworkManager-libnm-1.45.4-1.el9.x8 3.4 MB/s | 1.8 MB 00:00 2023-10-16T19:32:20.169 INFO:teuthology.orchestra.run.smithi057.stdout:(160/165): NetworkManager-team-1.45.4-1.el9.x86 84 kB/s | 41 kB 00:00 2023-10-16T19:32:20.220 INFO:teuthology.orchestra.run.smithi057.stdout:(161/165): NetworkManager-tui-1.45.4-1.el9.x86_ 3.2 MB/s | 244 kB 00:00 2023-10-16T19:32:20.245 INFO:teuthology.orchestra.run.smithi057.stdout:(162/165): acl-2.3.1-4.el9.x86_64.rpm 936 kB/s | 69 kB 00:00 2023-10-16T19:32:20.270 INFO:teuthology.orchestra.run.smithi057.stdout:(163/165): libacl-2.3.1-4.el9.x86_64.rpm 452 kB/s | 22 kB 00:00 2023-10-16T19:32:20.329 INFO:teuthology.orchestra.run.smithi057.stdout:(164/165): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2023-10-16T19:32:20.418 INFO:teuthology.orchestra.run.smithi110.stdout:(121/165): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.8 MB/s | 837 kB 00:00 2023-10-16T19:32:20.634 INFO:teuthology.orchestra.run.smithi110.stdout:(122/165): python3-asyncssh-2.13.2-3.el9.noarch 2.5 MB/s | 548 kB 00:00 2023-10-16T19:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout:(123/165): libarrow-9.0.0-9.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2023-10-16T19:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout:(124/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 349 kB/s | 43 kB 00:00 2023-10-16T19:32:20.785 INFO:teuthology.orchestra.run.smithi110.stdout:(125/165): python3-cachetools-4.2.4-1.el9.noarc 780 kB/s | 32 kB 00:00 2023-10-16T19:32:20.802 INFO:teuthology.orchestra.run.smithi110.stdout:(126/165): python3-certifi-2021.10.8-2.el9.noar 364 kB/s | 15 kB 00:00 2023-10-16T19:32:20.861 INFO:teuthology.orchestra.run.smithi110.stdout:(127/165): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2023-10-16T19:32:20.961 INFO:teuthology.orchestra.run.smithi110.stdout:(128/165): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2023-10-16T19:32:21.687 INFO:teuthology.orchestra.run.smithi110.stdout:(129/165): python3-google-auth-2.23.2-1.el9.noa 238 kB/s | 196 kB 00:00 2023-10-16T19:32:21.720 INFO:teuthology.orchestra.run.smithi110.stdout:(130/165): python3-jaraco-8.2.1-3.el9.noarch.rp 335 kB/s | 11 kB 00:00 2023-10-16T19:32:21.737 INFO:teuthology.orchestra.run.smithi110.stdout:(131/165): python3-jaraco-classes-3.2.1-5.el9.n 363 kB/s | 18 kB 00:00 2023-10-16T19:32:21.762 INFO:teuthology.orchestra.run.smithi110.stdout:(132/165): python3-jaraco-collections-3.0.0-8.e 563 kB/s | 23 kB 00:00 2023-10-16T19:32:21.779 INFO:teuthology.orchestra.run.smithi110.stdout:(133/165): python3-jaraco-functools-3.5.0-2.el9 473 kB/s | 19 kB 00:00 2023-10-16T19:32:21.805 INFO:teuthology.orchestra.run.smithi110.stdout:(134/165): python3-jaraco-text-3.2.0-6.el9.noar 479 kB/s | 20 kB 00:00 2023-10-16T19:32:21.830 INFO:teuthology.orchestra.run.smithi110.stdout:(135/165): python3-jwt+crypto-2.4.0-1.el9.noarc 183 kB/s | 9.0 kB 00:00 2023-10-16T19:32:21.855 INFO:teuthology.orchestra.run.smithi110.stdout:(136/165): python3-jwt-2.4.0-1.el9.noarch.rpm 826 kB/s | 41 kB 00:00 2023-10-16T19:32:21.897 INFO:teuthology.orchestra.run.smithi110.stdout:(137/165): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-10-16T19:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout:(138/165): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-10-16T19:32:22.006 INFO:teuthology.orchestra.run.smithi110.stdout:(139/165): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2023-10-16T19:32:22.148 INFO:teuthology.orchestra.run.smithi110.stdout:(140/165): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-10-16T19:32:22.190 INFO:teuthology.orchestra.run.smithi110.stdout:(141/165): python3-portend-3.1.0-2.el9.noarch.r 403 kB/s | 16 kB 00:00 2023-10-16T19:32:22.257 INFO:teuthology.orchestra.run.smithi110.stdout:(142/165): python3-kubernetes-26.1.0-2.el9.noar 2.4 MB/s | 1.0 MB 00:00 2023-10-16T19:32:22.282 INFO:teuthology.orchestra.run.smithi110.stdout:(143/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 986 kB/s | 90 kB 00:00 2023-10-16T19:32:22.308 INFO:teuthology.orchestra.run.smithi110.stdout:(144/165): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2023-10-16T19:32:22.350 INFO:teuthology.orchestra.run.smithi110.stdout:(145/165): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2023-10-16T19:32:22.383 INFO:teuthology.orchestra.run.smithi110.stdout:(146/165): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-10-16T19:32:22.417 INFO:teuthology.orchestra.run.smithi110.stdout:(147/165): python3-tempora-5.0.0-2.el9.noarch.r 539 kB/s | 36 kB 00:00 2023-10-16T19:32:22.442 INFO:teuthology.orchestra.run.smithi110.stdout:(148/165): python3-typing-extensions-4.4.0-2.el 879 kB/s | 51 kB 00:00 2023-10-16T19:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout:(149/165): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-10-16T19:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout:(150/165): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-10-16T19:32:22.602 INFO:teuthology.orchestra.run.smithi110.stdout:(151/165): python3-zc-lockfile-2.0-10.el9.noarc 407 kB/s | 20 kB 00:00 2023-10-16T19:32:22.677 INFO:teuthology.orchestra.run.smithi110.stdout:(152/165): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2023-10-16T19:32:22.702 INFO:teuthology.orchestra.run.smithi110.stdout:(153/165): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-10-16T19:32:23.203 INFO:teuthology.orchestra.run.smithi110.stdout:(154/165): thrift-0.15.0-2.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2023-10-16T19:32:23.420 INFO:teuthology.orchestra.run.smithi110.stdout:(155/165): librados2-18.0.0-6730.g4ba8a190.el9. 4.6 MB/s | 3.3 MB 00:00 2023-10-16T19:32:23.470 INFO:teuthology.orchestra.run.smithi110.stdout:(156/165): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-10-16T19:32:23.587 INFO:teuthology.orchestra.run.smithi110.stdout:(157/165): NetworkManager-1.45.4-1.el9.x86_64.r 19 MB/s | 2.2 MB 00:00 2023-10-16T19:32:23.704 INFO:teuthology.orchestra.run.smithi110.stdout:(158/165): NetworkManager-libnm-1.45.4-1.el9.x8 15 MB/s | 1.8 MB 00:00 2023-10-16T19:32:23.788 INFO:teuthology.orchestra.run.smithi110.stdout:(159/165): librbd1-18.0.0-6730.g4ba8a190.el9.x8 5.2 MB/s | 3.0 MB 00:00 2023-10-16T19:32:23.813 INFO:teuthology.orchestra.run.smithi110.stdout:(160/165): NetworkManager-team-1.45.4-1.el9.x86 384 kB/s | 41 kB 00:00 2023-10-16T19:32:23.880 INFO:teuthology.orchestra.run.smithi110.stdout:(161/165): NetworkManager-tui-1.45.4-1.el9.x86_ 2.6 MB/s | 244 kB 00:00 2023-10-16T19:32:23.914 INFO:teuthology.orchestra.run.smithi110.stdout:(162/165): acl-2.3.1-4.el9.x86_64.rpm 707 kB/s | 69 kB 00:00 2023-10-16T19:32:23.939 INFO:teuthology.orchestra.run.smithi110.stdout:(163/165): libacl-2.3.1-4.el9.x86_64.rpm 384 kB/s | 22 kB 00:00 2023-10-16T19:32:23.972 INFO:teuthology.orchestra.run.smithi110.stdout:(164/165): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-10-16T19:32:58.658 INFO:teuthology.orchestra.run.smithi057.stdout:(165/165): ceph-test-debuginfo-18.0.0-6730.g4ba 9.2 MB/s | 625 MB 01:08 2023-10-16T19:32:58.663 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:32:58.663 INFO:teuthology.orchestra.run.smithi057.stdout:Total 14 MB/s | 2.1 GB 02:37 2023-10-16T19:32:59.081 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-10-16T19:32:59.311 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-10-16T19:32:59.311 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-10-16T19:33:13.852 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-10-16T19:33:13.853 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-10-16T19:33:35.277 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-10-16T19:33:35.380 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_6 1/175 2023-10-16T19:33:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/175 2023-10-16T19:33:35.499 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/175 2023-10-16T19:33:35.537 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/175 2023-10-16T19:33:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/175 2023-10-16T19:33:36.073 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/175 2023-10-16T19:33:36.125 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/175 2023-10-16T19:33:36.403 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/175 2023-10-16T19:33:36.434 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/175 2023-10-16T19:33:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/175 2023-10-16T19:33:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/175 2023-10-16T19:33:36.696 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 10/175 2023-10-16T19:33:36.963 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/175 2023-10-16T19:33:37.014 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/175 2023-10-16T19:33:37.072 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/175 2023-10-16T19:33:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/175 2023-10-16T19:33:37.248 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 14/175 2023-10-16T19:33:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 14/175 2023-10-16T19:33:37.712 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/175 2023-10-16T19:33:37.845 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-16T19:33:37.933 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-16T19:33:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-16T19:33:38.256 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-16T19:33:38.708 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-16T19:33:38.753 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/175 2023-10-16T19:33:38.811 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/175 2023-10-16T19:33:38.935 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/175 2023-10-16T19:33:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 21/175 2023-10-16T19:33:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/175 2023-10-16T19:33:39.136 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/175 2023-10-16T19:33:39.250 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/175 2023-10-16T19:33:39.304 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/175 2023-10-16T19:33:39.344 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/175 2023-10-16T19:33:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/175 2023-10-16T19:33:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 28/175 2023-10-16T19:33:39.554 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 29/175 2023-10-16T19:33:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 30/175 2023-10-16T19:33:39.841 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/175 2023-10-16T19:33:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/175 2023-10-16T19:33:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/175 2023-10-16T19:33:40.734 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/175 2023-10-16T19:33:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/175 2023-10-16T19:33:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 36/175 2023-10-16T19:33:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 37/175 2023-10-16T19:33:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : re2-1:20211101-3.el9.x86_64 38/175 2023-10-16T19:33:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 39/175 2023-10-16T19:33:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 40/175 2023-10-16T19:33:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 41/175 2023-10-16T19:33:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 42/175 2023-10-16T19:33:41.712 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 43/175 2023-10-16T19:33:41.785 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 44/175 2023-10-16T19:33:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 45/175 2023-10-16T19:33:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 46/175 2023-10-16T19:33:42.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 47/175 2023-10-16T19:33:42.160 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 48/175 2023-10-16T19:33:42.239 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 49/175 2023-10-16T19:33:42.347 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 50/175 2023-10-16T19:33:42.392 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 51/175 2023-10-16T19:33:42.448 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 52/175 2023-10-16T19:33:42.485 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 53/175 2023-10-16T19:33:42.525 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 54/175 2023-10-16T19:33:42.567 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fmt-8.1.1-5.el9.x86_64 55/175 2023-10-16T19:33:42.620 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 56/175 2023-10-16T19:33:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 57/175 2023-10-16T19:33:42.837 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.2-8.el9.noarch 58/175 2023-10-16T19:33:42.931 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ply-3.11-14.el9.noarch 59/175 2023-10-16T19:33:43.014 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 60/175 2023-10-16T19:33:43.268 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 61/175 2023-10-16T19:33:43.328 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 62/175 2023-10-16T19:33:43.498 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 63/175 2023-10-16T19:33:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 64/175 2023-10-16T19:33:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 65/175 2023-10-16T19:33:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 66/175 2023-10-16T19:33:43.652 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 67/175 2023-10-16T19:33:43.696 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.9-15.el9.x86_64 68/175 2023-10-16T19:33:43.779 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/175 2023-10-16T19:33:43.882 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/175 2023-10-16T19:33:43.945 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 71/175 2023-10-16T19:33:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/175 2023-10-16T19:33:44.116 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/175 2023-10-16T19:33:44.153 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 74/175 2023-10-16T19:33:44.187 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/175 2023-10-16T19:33:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/175 2023-10-16T19:33:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/175 2023-10-16T19:33:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/175 2023-10-16T19:33:44.522 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 79/175 2023-10-16T19:33:44.671 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/175 2023-10-16T19:33:44.746 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/175 2023-10-16T19:33:45.806 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/175 2023-10-16T19:33:45.861 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/175 2023-10-16T19:33:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-16T19:33:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/175 2023-10-16T19:33:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 86/175 2023-10-16T19:33:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/175 2023-10-16T19:33:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/175 2023-10-16T19:33:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/175 2023-10-16T19:33:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/175 2023-10-16T19:33:47.450 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/175 2023-10-16T19:33:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/175 2023-10-16T19:33:49.203 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/175 2023-10-16T19:33:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/175 2023-10-16T19:33:49.280 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-15.el9.x86_64 95/175 2023-10-16T19:33:49.320 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/175 2023-10-16T19:33:49.711 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 97/175 2023-10-16T19:33:49.751 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/175 2023-10-16T19:33:49.874 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/175 2023-10-16T19:33:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 99/175 2023-10-16T19:33:49.994 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 100/175 2023-10-16T19:33:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 101/175 2023-10-16T19:33:50.553 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/175 2023-10-16T19:33:50.629 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/175 2023-10-16T19:33:50.655 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/175 2023-10-16T19:33:53.330 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/175 2023-10-16T19:33:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/175 2023-10-16T19:33:54.027 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/175 2023-10-16T19:33:54.080 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/175 2023-10-16T19:33:54.249 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/175 2023-10-16T19:33:54.249 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-16T19:33:54.250 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-16T19:33:54.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:33:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 106/175 2023-10-16T19:34:01.813 INFO:teuthology.orchestra.run.smithi110.stdout:(165/165): ceph-test-debuginfo-18.0.0-6730.g4ba 4.8 MB/s | 625 MB 02:11 2023-10-16T19:34:01.826 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:34:01.827 INFO:teuthology.orchestra.run.smithi110.stdout:Total 9.7 MB/s | 2.1 GB 03:43 2023-10-16T19:34:02.259 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2023-10-16T19:34:02.470 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2023-10-16T19:34:02.471 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2023-10-16T19:34:07.969 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 106/175 2023-10-16T19:34:07.969 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2023-10-16T19:34:07.970 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2023-10-16T19:34:07.970 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2023-10-16T19:34:07.970 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2023-10-16T19:34:07.970 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2023-10-16T19:34:07.971 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /root 2023-10-16T19:34:07.971 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2023-10-16T19:34:07.971 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:08.166 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 107/175 2023-10-16T19:34:08.214 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 107/175 2023-10-16T19:34:08.214 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:08.215 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-16T19:34:08.215 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:09.994 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/175 2023-10-16T19:34:10.084 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/175 2023-10-16T19:34:10.084 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:10.084 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-16T19:34:10.084 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T19:34:10.085 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T19:34:10.085 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/175 2023-10-16T19:34:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/175 2023-10-16T19:34:10.412 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:10.413 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-16T19:34:10.413 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T19:34:10.413 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T19:34:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:10.936 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 110/175 2023-10-16T19:34:11.013 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 110/175 2023-10-16T19:34:11.013 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:11.013 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-16T19:34:11.013 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T19:34:11.014 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T19:34:11.014 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:11.648 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 111/175 2023-10-16T19:34:11.681 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 111/175 2023-10-16T19:34:11.728 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 112/175 2023-10-16T19:34:11.843 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 113/175 2023-10-16T19:34:11.875 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 114/175 2023-10-16T19:34:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 114/175 2023-10-16T19:34:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 115/175 2023-10-16T19:34:13.437 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 115/175 2023-10-16T19:34:13.467 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 116/175 2023-10-16T19:34:13.615 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 116/175 2023-10-16T19:34:13.800 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 117/175 2023-10-16T19:34:13.828 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 118/175 2023-10-16T19:34:13.929 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 118/175 2023-10-16T19:34:13.930 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:13.930 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-16T19:34:13.930 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T19:34:13.930 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T19:34:13.930 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:13.987 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 119/175 2023-10-16T19:34:14.028 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 119/175 2023-10-16T19:34:14.961 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/175 2023-10-16T19:34:14.996 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 121/175 2023-10-16T19:34:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 121/175 2023-10-16T19:34:15.081 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:15.081 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-16T19:34:15.081 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T19:34:15.081 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T19:34:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 122/175 2023-10-16T19:34:15.227 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 122/175 2023-10-16T19:34:15.227 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:15.228 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-16T19:34:15.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:15.298 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/175 2023-10-16T19:34:15.411 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/175 2023-10-16T19:34:15.411 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:15.411 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-16T19:34:15.412 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T19:34:15.412 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T19:34:15.412 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:15.790 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/175 2023-10-16T19:34:15.867 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/175 2023-10-16T19:34:15.867 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:34:15.868 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-16T19:34:15.868 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T19:34:15.868 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T19:34:15.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:34:16.379 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2023-10-16T19:34:16.380 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2023-10-16T19:34:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/175 2023-10-16T19:34:20.303 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/175 2023-10-16T19:34:20.344 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 127/175 2023-10-16T19:34:20.644 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 128/175 2023-10-16T19:34:20.797 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 129/175 2023-10-16T19:34:20.870 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 130/175 2023-10-16T19:34:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/175 2023-10-16T19:34:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/175 2023-10-16T19:34:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 133/175 2023-10-16T19:34:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 134/175 2023-10-16T19:34:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 135/175 2023-10-16T19:34:21.211 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 136/175 2023-10-16T19:34:21.276 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 137/175 2023-10-16T19:34:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-16T19:34:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-16T19:34:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-16T19:34:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 139/175 2023-10-16T19:34:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2023-10-16T19:34:37.199 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_6 1/175 2023-10-16T19:34:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/175 2023-10-16T19:34:37.334 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/175 2023-10-16T19:34:37.372 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/175 2023-10-16T19:34:37.481 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/175 2023-10-16T19:34:37.890 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/175 2023-10-16T19:34:37.948 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/175 2023-10-16T19:34:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/175 2023-10-16T19:34:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/175 2023-10-16T19:34:38.248 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/175 2023-10-16T19:34:38.327 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/175 2023-10-16T19:34:38.368 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 10/175 2023-10-16T19:34:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/175 2023-10-16T19:34:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/175 2023-10-16T19:34:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/175 2023-10-16T19:34:38.858 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/175 2023-10-16T19:34:38.889 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 14/175 2023-10-16T19:34:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 14/175 2023-10-16T19:34:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/175 2023-10-16T19:34:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-16T19:34:39.599 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-16T19:34:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-16T19:34:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-16T19:34:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-16T19:34:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/175 2023-10-16T19:34:40.478 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/175 2023-10-16T19:34:40.590 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/175 2023-10-16T19:34:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 21/175 2023-10-16T19:34:40.700 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/175 2023-10-16T19:34:40.755 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/175 2023-10-16T19:34:40.861 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/175 2023-10-16T19:34:40.909 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/175 2023-10-16T19:34:40.951 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/175 2023-10-16T19:34:41.060 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/175 2023-10-16T19:34:41.106 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 28/175 2023-10-16T19:34:41.157 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 29/175 2023-10-16T19:34:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 30/175 2023-10-16T19:34:41.415 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/175 2023-10-16T19:34:41.474 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/175 2023-10-16T19:34:42.189 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/175 2023-10-16T19:34:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/175 2023-10-16T19:34:42.588 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/175 2023-10-16T19:34:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 36/175 2023-10-16T19:34:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 37/175 2023-10-16T19:34:42.957 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 38/175 2023-10-16T19:34:43.001 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 39/175 2023-10-16T19:34:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 40/175 2023-10-16T19:34:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 41/175 2023-10-16T19:34:43.242 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 42/175 2023-10-16T19:34:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 43/175 2023-10-16T19:34:43.350 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 44/175 2023-10-16T19:34:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 45/175 2023-10-16T19:34:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 46/175 2023-10-16T19:34:43.666 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 47/175 2023-10-16T19:34:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 48/175 2023-10-16T19:34:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 49/175 2023-10-16T19:34:44.284 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 50/175 2023-10-16T19:34:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 51/175 2023-10-16T19:34:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 52/175 2023-10-16T19:34:44.463 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 53/175 2023-10-16T19:34:44.505 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 54/175 2023-10-16T19:34:44.540 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fmt-8.1.1-5.el9.x86_64 55/175 2023-10-16T19:34:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 56/175 2023-10-16T19:34:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 57/175 2023-10-16T19:34:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 58/175 2023-10-16T19:34:44.898 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 59/175 2023-10-16T19:34:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 60/175 2023-10-16T19:34:45.272 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 61/175 2023-10-16T19:34:45.333 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 62/175 2023-10-16T19:34:45.528 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 63/175 2023-10-16T19:34:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 64/175 2023-10-16T19:34:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 65/175 2023-10-16T19:34:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 66/175 2023-10-16T19:34:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 67/175 2023-10-16T19:34:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 68/175 2023-10-16T19:34:45.817 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/175 2023-10-16T19:34:45.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/175 2023-10-16T19:34:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 71/175 2023-10-16T19:34:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/175 2023-10-16T19:34:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/175 2023-10-16T19:34:46.199 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 74/175 2023-10-16T19:34:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/175 2023-10-16T19:34:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/175 2023-10-16T19:34:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/175 2023-10-16T19:34:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/175 2023-10-16T19:34:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 79/175 2023-10-16T19:34:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/175 2023-10-16T19:34:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/175 2023-10-16T19:34:47.746 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/175 2023-10-16T19:34:47.799 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/175 2023-10-16T19:34:47.833 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-16T19:34:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/175 2023-10-16T19:34:47.999 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 86/175 2023-10-16T19:34:48.229 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/175 2023-10-16T19:34:48.263 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/175 2023-10-16T19:34:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/175 2023-10-16T19:34:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/175 2023-10-16T19:34:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/175 2023-10-16T19:34:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/175 2023-10-16T19:34:50.993 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/175 2023-10-16T19:34:51.031 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/175 2023-10-16T19:34:51.062 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.6-15.el9.x86_64 95/175 2023-10-16T19:34:51.101 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/175 2023-10-16T19:34:51.473 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 97/175 2023-10-16T19:34:51.501 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/175 2023-10-16T19:34:51.620 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/175 2023-10-16T19:34:51.648 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 99/175 2023-10-16T19:34:51.704 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 100/175 2023-10-16T19:34:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 101/175 2023-10-16T19:34:52.220 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/175 2023-10-16T19:34:52.311 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/175 2023-10-16T19:34:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/175 2023-10-16T19:34:54.860 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/175 2023-10-16T19:34:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/175 2023-10-16T19:34:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/175 2023-10-16T19:34:55.564 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/175 2023-10-16T19:34:55.762 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/175 2023-10-16T19:34:55.762 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-16T19:34:55.762 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-16T19:34:55.763 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:34:55.815 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 106/175 2023-10-16T19:35:08.431 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 106/175 2023-10-16T19:35:08.431 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2023-10-16T19:35:08.431 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2023-10-16T19:35:08.432 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2023-10-16T19:35:08.432 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2023-10-16T19:35:08.432 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2023-10-16T19:35:08.432 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2023-10-16T19:35:08.432 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2023-10-16T19:35:08.432 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:08.655 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 107/175 2023-10-16T19:35:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 107/175 2023-10-16T19:35:08.703 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:08.704 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-16T19:35:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:10.451 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/175 2023-10-16T19:35:10.550 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/175 2023-10-16T19:35:10.550 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:10.551 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-16T19:35:10.551 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T19:35:10.551 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T19:35:10.551 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:10.801 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/175 2023-10-16T19:35:10.890 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/175 2023-10-16T19:35:10.891 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:10.891 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-16T19:35:10.891 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T19:35:10.891 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T19:35:10.892 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:11.386 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 110/175 2023-10-16T19:35:11.454 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 110/175 2023-10-16T19:35:11.455 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:11.455 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-16T19:35:11.455 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T19:35:11.455 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T19:35:11.455 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:12.063 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 111/175 2023-10-16T19:35:12.106 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 111/175 2023-10-16T19:35:12.154 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 112/175 2023-10-16T19:35:12.275 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 113/175 2023-10-16T19:35:12.308 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 114/175 2023-10-16T19:35:12.631 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 114/175 2023-10-16T19:35:12.667 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 115/175 2023-10-16T19:35:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 115/175 2023-10-16T19:35:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 116/175 2023-10-16T19:35:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 116/175 2023-10-16T19:35:14.141 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 117/175 2023-10-16T19:35:14.170 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 118/175 2023-10-16T19:35:14.255 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 118/175 2023-10-16T19:35:14.255 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:14.256 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-16T19:35:14.256 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T19:35:14.256 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T19:35:14.256 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:14.312 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 119/175 2023-10-16T19:35:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 119/175 2023-10-16T19:35:15.205 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/175 2023-10-16T19:35:15.239 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 121/175 2023-10-16T19:35:15.336 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 140/175 2023-10-16T19:35:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 121/175 2023-10-16T19:35:15.339 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:15.339 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-16T19:35:15.339 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T19:35:15.340 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T19:35:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 122/175 2023-10-16T19:35:15.481 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 122/175 2023-10-16T19:35:15.481 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:15.481 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-16T19:35:15.481 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/175 2023-10-16T19:35:15.657 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/175 2023-10-16T19:35:15.657 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:15.657 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-16T19:35:15.657 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T19:35:15.658 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T19:35:15.658 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:16.016 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/175 2023-10-16T19:35:16.037 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6730.g4ba8a190.el 141/175 2023-10-16T19:35:16.098 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/175 2023-10-16T19:35:16.098 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T19:35:16.099 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-16T19:35:16.099 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T19:35:16.099 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T19:35:16.099 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:35:16.227 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 142/175 2023-10-16T19:35:20.154 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/175 2023-10-16T19:35:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/175 2023-10-16T19:35:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 127/175 2023-10-16T19:35:20.507 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 128/175 2023-10-16T19:35:20.634 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 129/175 2023-10-16T19:35:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 130/175 2023-10-16T19:35:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/175 2023-10-16T19:35:20.776 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/175 2023-10-16T19:35:20.806 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 133/175 2023-10-16T19:35:20.851 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 134/175 2023-10-16T19:35:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 135/175 2023-10-16T19:35:21.061 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 136/175 2023-10-16T19:35:21.083 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 143/175 2023-10-16T19:35:21.110 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 137/175 2023-10-16T19:35:22.017 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-16T19:35:22.068 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-16T19:35:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-16T19:35:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 144/175 2023-10-16T19:35:30.354 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 139/175 2023-10-16T19:35:36.865 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 145/175 2023-10-16T19:36:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 146/175 2023-10-16T19:36:12.066 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 140/175 2023-10-16T19:36:12.718 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6730.g4ba8a190.el 141/175 2023-10-16T19:36:13.517 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 142/175 2023-10-16T19:36:18.060 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 143/175 2023-10-16T19:36:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 144/175 2023-10-16T19:36:31.885 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 147/175 2023-10-16T19:36:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 145/175 2023-10-16T19:37:05.716 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 146/175 2023-10-16T19:37:24.505 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 147/175 2023-10-16T19:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6730.g4ba8a190.e 148/175 2023-10-16T19:37:43.441 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 149/175 2023-10-16T19:37:43.487 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6730.g4ba8a190.el9 150/175 2023-10-16T19:37:48.949 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6730.g4ba8a190 151/175 2023-10-16T19:37:55.212 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados2-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 152/175 2023-10-16T19:37:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librbd1-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 153/175 2023-10-16T19:37:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6730.g4ba8a190 154/175 2023-10-16T19:37:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6730.g4ba8a190. 155/175 2023-10-16T19:37:55.636 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6730.g4ba8a190.el 156/175 2023-10-16T19:37:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6730.g4ba8a190.el 157/175 2023-10-16T19:38:01.908 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 158/175 2023-10-16T19:38:02.106 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6730.g4ba8a190.el9 159/175 2023-10-16T19:38:02.166 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 160/175 2023-10-16T19:38:03.542 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/175 2023-10-16T19:38:03.641 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 162/175 2023-10-16T19:38:03.698 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/175 2023-10-16T19:38:03.844 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/175 2023-10-16T19:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/175 2023-10-16T19:38:03.981 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 166/175 2023-10-16T19:38:03.981 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-16T19:38:04.118 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-16T19:38:04.153 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 168/175 2023-10-16T19:38:04.189 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 169/175 2023-10-16T19:38:04.221 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 170/175 2023-10-16T19:38:04.262 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-16T19:38:04.262 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-16T19:38:04.598 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-16T19:38:04.598 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-16T19:38:04.744 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-16T19:38:04.775 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-16T19:38:04.775 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-16T19:38:04.913 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-16T19:38:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-16T19:38:05.314 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-16T19:38:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-16T19:38:05.315 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:38:13.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/175 2023-10-16T19:38:13.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/175 2023-10-16T19:38:13.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 3/175 2023-10-16T19:38:13.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/175 2023-10-16T19:38:13.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6730.g4ba8a190.el 5/175 2023-10-16T19:38:13.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_6 6/175 2023-10-16T19:38:13.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/175 2023-10-16T19:38:13.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 8/175 2023-10-16T19:38:13.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 9/175 2023-10-16T19:38:13.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 10/175 2023-10-16T19:38:13.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/175 2023-10-16T19:38:13.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 12/175 2023-10-16T19:38:13.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/175 2023-10-16T19:38:13.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 14/175 2023-10-16T19:38:13.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/175 2023-10-16T19:38:13.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 16/175 2023-10-16T19:38:13.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 17/175 2023-10-16T19:38:13.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 18/175 2023-10-16T19:38:13.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/175 2023-10-16T19:38:13.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6730.g4ba8a190.e 20/175 2023-10-16T19:38:13.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 21/175 2023-10-16T19:38:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 22/175 2023-10-16T19:38:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 23/175 2023-10-16T19:38:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/175 2023-10-16T19:38:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 25/175 2023-10-16T19:38:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/175 2023-10-16T19:38:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6730.g4ba8a190.el9 27/175 2023-10-16T19:38:13.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/175 2023-10-16T19:38:13.929 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/175 2023-10-16T19:38:13.929 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6730.g4ba8a190 30/175 2023-10-16T19:38:13.929 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 31/175 2023-10-16T19:38:13.930 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 32/175 2023-10-16T19:38:13.930 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 33/175 2023-10-16T19:38:13.930 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 34/175 2023-10-16T19:38:13.930 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 35/175 2023-10-16T19:38:13.930 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 36/175 2023-10-16T19:38:13.931 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 37/175 2023-10-16T19:38:13.931 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6730.g4ba8a190 38/175 2023-10-16T19:38:13.931 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 39/175 2023-10-16T19:38:13.931 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6730.g4ba8a190. 40/175 2023-10-16T19:38:13.931 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 41/175 2023-10-16T19:38:13.932 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6730.g4ba8a190.el 42/175 2023-10-16T19:38:13.932 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 43/175 2023-10-16T19:38:13.932 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6730.g4ba8a190.el 44/175 2023-10-16T19:38:13.932 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 45/175 2023-10-16T19:38:13.932 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 46/175 2023-10-16T19:38:13.933 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 47/175 2023-10-16T19:38:13.933 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6730.g4ba8a190.el9 48/175 2023-10-16T19:38:13.933 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 49/175 2023-10-16T19:38:13.933 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 50/175 2023-10-16T19:38:13.933 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 51/175 2023-10-16T19:38:13.933 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 52/175 2023-10-16T19:38:13.934 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 53/175 2023-10-16T19:38:13.934 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 54/175 2023-10-16T19:38:13.934 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 55/175 2023-10-16T19:38:13.934 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 56/175 2023-10-16T19:38:13.934 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 57/175 2023-10-16T19:38:13.935 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 58/175 2023-10-16T19:38:13.935 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 59/175 2023-10-16T19:38:13.935 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 60/175 2023-10-16T19:38:13.935 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.7.4-5.el9.x86_64 61/175 2023-10-16T19:38:13.935 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 62/175 2023-10-16T19:38:13.936 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.4-9.el9.x86_64 63/175 2023-10-16T19:38:13.936 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 64/175 2023-10-16T19:38:13.936 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 65/175 2023-10-16T19:38:13.936 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/175 2023-10-16T19:38:13.936 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 67/175 2023-10-16T19:38:13.937 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/175 2023-10-16T19:38:13.937 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 69/175 2023-10-16T19:38:13.937 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 70/175 2023-10-16T19:38:13.937 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 71/175 2023-10-16T19:38:13.937 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/175 2023-10-16T19:38:13.938 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 73/175 2023-10-16T19:38:13.938 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 74/175 2023-10-16T19:38:13.938 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 75/175 2023-10-16T19:38:13.938 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-13.11-1.el9.x86_64 76/175 2023-10-16T19:38:13.938 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 77/175 2023-10-16T19:38:13.939 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 78/175 2023-10-16T19:38:13.939 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 79/175 2023-10-16T19:38:13.939 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 80/175 2023-10-16T19:38:13.939 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/175 2023-10-16T19:38:13.939 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 82/175 2023-10-16T19:38:13.940 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 83/175 2023-10-16T19:38:13.940 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-16T19:38:13.940 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 85/175 2023-10-16T19:38:13.940 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 86/175 2023-10-16T19:38:13.940 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 87/175 2023-10-16T19:38:13.940 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/175 2023-10-16T19:38:13.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 89/175 2023-10-16T19:38:13.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 90/175 2023-10-16T19:38:13.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/175 2023-10-16T19:38:13.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/175 2023-10-16T19:38:13.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/175 2023-10-16T19:38:13.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/175 2023-10-16T19:38:13.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/175 2023-10-16T19:38:13.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 96/175 2023-10-16T19:38:13.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 97/175 2023-10-16T19:38:13.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 98/175 2023-10-16T19:38:13.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 99/175 2023-10-16T19:38:13.943 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 100/175 2023-10-16T19:38:13.943 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 101/175 2023-10-16T19:38:13.943 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 102/175 2023-10-16T19:38:13.943 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 103/175 2023-10-16T19:38:13.943 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/175 2023-10-16T19:38:13.944 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 105/175 2023-10-16T19:38:13.944 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 106/175 2023-10-16T19:38:13.944 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 107/175 2023-10-16T19:38:13.944 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.2-8.el9.noarch 108/175 2023-10-16T19:38:13.944 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 109/175 2023-10-16T19:38:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-15.el9.x86_64 110/175 2023-10-16T19:38:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 111/175 2023-10-16T19:38:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 112/175 2023-10-16T19:38:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 113/175 2023-10-16T19:38:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/175 2023-10-16T19:38:13.945 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 115/175 2023-10-16T19:38:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 116/175 2023-10-16T19:38:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 117/175 2023-10-16T19:38:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 118/175 2023-10-16T19:38:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 119/175 2023-10-16T19:38:13.946 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 120/175 2023-10-16T19:38:13.947 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 121/175 2023-10-16T19:38:13.947 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 122/175 2023-10-16T19:38:13.947 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 123/175 2023-10-16T19:38:13.947 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 124/175 2023-10-16T19:38:13.948 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 125/175 2023-10-16T19:38:13.948 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 126/175 2023-10-16T19:38:13.948 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 127/175 2023-10-16T19:38:13.948 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 128/175 2023-10-16T19:38:13.949 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 129/175 2023-10-16T19:38:13.949 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 130/175 2023-10-16T19:38:13.949 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 131/175 2023-10-16T19:38:13.950 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 132/175 2023-10-16T19:38:13.950 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 133/175 2023-10-16T19:38:13.950 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 134/175 2023-10-16T19:38:13.950 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 135/175 2023-10-16T19:38:13.950 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 136/175 2023-10-16T19:38:13.951 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 137/175 2023-10-16T19:38:13.951 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 138/175 2023-10-16T19:38:13.951 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 139/175 2023-10-16T19:38:13.951 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 140/175 2023-10-16T19:38:13.951 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/175 2023-10-16T19:38:13.952 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 142/175 2023-10-16T19:38:13.952 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 143/175 2023-10-16T19:38:13.952 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 144/175 2023-10-16T19:38:13.952 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 145/175 2023-10-16T19:38:13.952 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 146/175 2023-10-16T19:38:13.953 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 147/175 2023-10-16T19:38:13.953 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/175 2023-10-16T19:38:13.953 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 149/175 2023-10-16T19:38:13.953 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 150/175 2023-10-16T19:38:13.953 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 151/175 2023-10-16T19:38:13.954 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 152/175 2023-10-16T19:38:13.954 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/175 2023-10-16T19:38:13.954 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : re2-1:20211101-3.el9.x86_64 154/175 2023-10-16T19:38:13.954 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 155/175 2023-10-16T19:38:13.954 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 156/175 2023-10-16T19:38:13.955 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 157/175 2023-10-16T19:38:13.955 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 158/175 2023-10-16T19:38:13.955 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 159/175 2023-10-16T19:38:13.955 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 160/175 2023-10-16T19:38:13.955 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 161/175 2023-10-16T19:38:13.956 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 162/175 2023-10-16T19:38:13.956 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 163/175 2023-10-16T19:38:13.956 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 164/175 2023-10-16T19:38:13.956 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/175 2023-10-16T19:38:13.956 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 166/175 2023-10-16T19:38:13.956 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 167/175 2023-10-16T19:38:13.957 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 168/175 2023-10-16T19:38:13.957 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 169/175 2023-10-16T19:38:13.957 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : acl-2.3.1-4.el9.x86_64 170/175 2023-10-16T19:38:13.958 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : acl-2.3.1-3.el9.x86_64 171/175 2023-10-16T19:38:13.958 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/175 2023-10-16T19:38:13.958 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-16T19:38:13.958 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/175 2023-10-16T19:38:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-16T19:38:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:38:16.564 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-10-16T19:38:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-16T19:38:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-16T19:38:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-16T19:38:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-16T19:38:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: acl-2.3.1-4.el9.x86_64 2023-10-16T19:38:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-16T19:38:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-16T19:38:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-16T19:38:16.566 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-10-16T19:38:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.2-8.el9.noarch 2023-10-16T19:38:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.7.4-5.el9.x86_64 2023-10-16T19:38:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-16T19:38:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:38:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-16T19:38:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.4-9.el9.x86_64 2023-10-16T19:38:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-16T19:38:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-16T19:38:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-16T19:38:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-16T19:38:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-16T19:38:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-16T19:38:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-15.el9.x86_64 2023-10-16T19:38:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-16T19:38:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-16T19:38:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-16T19:38:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-16T19:38:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-16T19:38:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-16T19:38:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-16T19:38:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-16T19:38:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-16T19:38:16.581 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.581 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-16T19:38:16.581 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-16T19:38:16.581 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-16T19:38:16.581 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-16T19:38:16.582 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-16T19:38:16.582 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-16T19:38:16.582 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-16T19:38:16.582 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-16T19:38:16.582 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-16T19:38:16.583 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-16T19:38:16.583 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-13.11-1.el9.x86_64 2023-10-16T19:38:16.583 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-16T19:38:16.583 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-16T19:38:16.583 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-16T19:38:16.584 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-16T19:38:16.584 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-16T19:38:16.584 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-16T19:38:16.584 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-16T19:38:16.584 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-16T19:38:16.585 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-16T19:38:16.586 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-16T19:38:16.586 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-16T19:38:16.586 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-16T19:38:16.586 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-16T19:38:16.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-16T19:38:16.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-16T19:38:16.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-16T19:38:16.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-16T19:38:16.587 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-16T19:38:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-16T19:38:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-16T19:38:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-16T19:38:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-16T19:38:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-16T19:38:16.589 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-16T19:38:16.589 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-16T19:38:16.589 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-16T19:38:16.589 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-16T19:38:16.589 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-16T19:38:16.590 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-16T19:38:16.590 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-16T19:38:16.590 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-16T19:38:16.590 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-16T19:38:16.590 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-16T19:38:16.591 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-16T19:38:16.591 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply-3.11-14.el9.noarch 2023-10-16T19:38:16.591 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-16T19:38:16.591 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-16T19:38:16.591 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-16T19:38:16.592 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-16T19:38:16.592 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-16T19:38:16.592 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-16T19:38:16.592 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-16T19:38:16.592 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.593 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.593 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.593 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.593 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-16T19:38:16.593 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-16T19:38:16.594 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-16T19:38:16.594 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.594 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.594 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-16T19:38:16.594 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-16T19:38:16.595 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-16T19:38:16.595 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-16T19:38:16.595 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-16T19:38:16.595 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-16T19:38:16.595 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-16T19:38:16.596 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-16T19:38:16.596 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-16T19:38:16.596 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-16T19:38:16.596 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-16T19:38:16.596 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.597 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.597 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.597 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.597 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.597 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:38:16.598 INFO:teuthology.orchestra.run.smithi057.stdout: re2-1:20211101-3.el9.x86_64 2023-10-16T19:38:16.598 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-16T19:38:16.598 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-16T19:38:16.598 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-16T19:38:16.599 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-16T19:38:16.599 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-16T19:38:16.599 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-16T19:38:16.600 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:38:16.600 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-10-16T19:38:17.949 DEBUG:teuthology.parallel:result is None 2023-10-16T19:38:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6730.g4ba8a190.e 148/175 2023-10-16T19:38:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 149/175 2023-10-16T19:38:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6730.g4ba8a190.el9 150/175 2023-10-16T19:38:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6730.g4ba8a190 151/175 2023-10-16T19:38:46.190 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados2-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 152/175 2023-10-16T19:38:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librbd1-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 153/175 2023-10-16T19:38:47.807 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6730.g4ba8a190 154/175 2023-10-16T19:38:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6730.g4ba8a190. 155/175 2023-10-16T19:38:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6730.g4ba8a190.el 156/175 2023-10-16T19:38:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6730.g4ba8a190.el 157/175 2023-10-16T19:38:53.985 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 158/175 2023-10-16T19:38:54.134 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6730.g4ba8a190.el9 159/175 2023-10-16T19:38:54.179 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 160/175 2023-10-16T19:38:55.432 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/175 2023-10-16T19:38:55.741 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 162/175 2023-10-16T19:38:55.837 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/175 2023-10-16T19:38:56.015 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/175 2023-10-16T19:38:56.057 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/175 2023-10-16T19:38:56.095 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 166/175 2023-10-16T19:38:56.096 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-16T19:38:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-16T19:38:56.261 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 168/175 2023-10-16T19:38:56.295 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 169/175 2023-10-16T19:38:56.327 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 170/175 2023-10-16T19:38:56.367 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-16T19:38:56.367 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-16T19:38:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-16T19:38:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-16T19:38:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-16T19:38:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-16T19:38:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-16T19:38:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-16T19:38:57.152 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-16T19:38:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-16T19:38:57.418 INFO:teuthology.orchestra.run.smithi110.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-16T19:38:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:05.854 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/175 2023-10-16T19:39:05.854 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/175 2023-10-16T19:39:05.854 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 3/175 2023-10-16T19:39:05.854 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/175 2023-10-16T19:39:05.855 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6730.g4ba8a190.el 5/175 2023-10-16T19:39:05.855 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_6 6/175 2023-10-16T19:39:05.855 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/175 2023-10-16T19:39:05.855 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 8/175 2023-10-16T19:39:05.855 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 9/175 2023-10-16T19:39:05.856 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 10/175 2023-10-16T19:39:05.856 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/175 2023-10-16T19:39:05.856 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 12/175 2023-10-16T19:39:05.856 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/175 2023-10-16T19:39:05.856 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 14/175 2023-10-16T19:39:05.857 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/175 2023-10-16T19:39:05.857 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 16/175 2023-10-16T19:39:05.858 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 17/175 2023-10-16T19:39:05.858 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 18/175 2023-10-16T19:39:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/175 2023-10-16T19:39:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6730.g4ba8a190.e 20/175 2023-10-16T19:39:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 21/175 2023-10-16T19:39:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 22/175 2023-10-16T19:39:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 23/175 2023-10-16T19:39:05.860 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/175 2023-10-16T19:39:05.860 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 25/175 2023-10-16T19:39:05.860 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/175 2023-10-16T19:39:05.860 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6730.g4ba8a190.el9 27/175 2023-10-16T19:39:05.860 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/175 2023-10-16T19:39:05.861 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/175 2023-10-16T19:39:05.861 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6730.g4ba8a190 30/175 2023-10-16T19:39:05.861 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-debuginfo-2:18.0.0-6730.g4ba8a190.el9. 31/175 2023-10-16T19:39:05.861 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 32/175 2023-10-16T19:39:05.874 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 33/175 2023-10-16T19:39:05.875 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 34/175 2023-10-16T19:39:05.875 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 35/175 2023-10-16T19:39:05.875 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 36/175 2023-10-16T19:39:05.875 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 37/175 2023-10-16T19:39:05.876 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6730.g4ba8a190 38/175 2023-10-16T19:39:05.876 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 39/175 2023-10-16T19:39:05.876 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6730.g4ba8a190. 40/175 2023-10-16T19:39:05.876 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 41/175 2023-10-16T19:39:05.876 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6730.g4ba8a190.el 42/175 2023-10-16T19:39:05.877 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 43/175 2023-10-16T19:39:05.877 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6730.g4ba8a190.el 44/175 2023-10-16T19:39:05.877 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 45/175 2023-10-16T19:39:05.877 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x 46/175 2023-10-16T19:39:05.877 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 47/175 2023-10-16T19:39:05.878 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6730.g4ba8a190.el9 48/175 2023-10-16T19:39:05.878 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 49/175 2023-10-16T19:39:05.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x8 50/175 2023-10-16T19:39:05.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 51/175 2023-10-16T19:39:05.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 52/175 2023-10-16T19:39:05.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 53/175 2023-10-16T19:39:05.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 54/175 2023-10-16T19:39:05.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 55/175 2023-10-16T19:39:05.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 56/175 2023-10-16T19:39:05.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 57/175 2023-10-16T19:39:05.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 58/175 2023-10-16T19:39:05.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 59/175 2023-10-16T19:39:05.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 60/175 2023-10-16T19:39:05.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 61/175 2023-10-16T19:39:05.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 62/175 2023-10-16T19:39:05.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 63/175 2023-10-16T19:39:05.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 64/175 2023-10-16T19:39:05.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 65/175 2023-10-16T19:39:05.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/175 2023-10-16T19:39:05.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 67/175 2023-10-16T19:39:05.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/175 2023-10-16T19:39:05.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 69/175 2023-10-16T19:39:05.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 70/175 2023-10-16T19:39:05.883 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 71/175 2023-10-16T19:39:05.883 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/175 2023-10-16T19:39:05.883 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 73/175 2023-10-16T19:39:05.883 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 74/175 2023-10-16T19:39:05.883 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 75/175 2023-10-16T19:39:05.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.11-1.el9.x86_64 76/175 2023-10-16T19:39:05.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 77/175 2023-10-16T19:39:05.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 78/175 2023-10-16T19:39:05.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 79/175 2023-10-16T19:39:05.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 80/175 2023-10-16T19:39:05.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/175 2023-10-16T19:39:05.885 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 82/175 2023-10-16T19:39:05.885 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 83/175 2023-10-16T19:39:05.885 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-16T19:39:05.885 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 85/175 2023-10-16T19:39:05.885 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 86/175 2023-10-16T19:39:05.886 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 87/175 2023-10-16T19:39:05.886 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/175 2023-10-16T19:39:05.886 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 89/175 2023-10-16T19:39:05.886 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 90/175 2023-10-16T19:39:05.886 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/175 2023-10-16T19:39:05.887 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/175 2023-10-16T19:39:05.887 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/175 2023-10-16T19:39:05.887 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/175 2023-10-16T19:39:05.887 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/175 2023-10-16T19:39:05.887 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 96/175 2023-10-16T19:39:05.888 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 97/175 2023-10-16T19:39:05.888 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 98/175 2023-10-16T19:39:05.888 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 99/175 2023-10-16T19:39:05.889 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 100/175 2023-10-16T19:39:05.889 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 101/175 2023-10-16T19:39:05.889 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 102/175 2023-10-16T19:39:05.889 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 103/175 2023-10-16T19:39:05.889 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/175 2023-10-16T19:39:05.890 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 105/175 2023-10-16T19:39:05.890 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 106/175 2023-10-16T19:39:05.890 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 107/175 2023-10-16T19:39:05.890 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 108/175 2023-10-16T19:39:05.890 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 109/175 2023-10-16T19:39:05.891 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.6-15.el9.x86_64 110/175 2023-10-16T19:39:05.891 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 111/175 2023-10-16T19:39:05.891 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 112/175 2023-10-16T19:39:05.891 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 113/175 2023-10-16T19:39:05.891 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/175 2023-10-16T19:39:05.891 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 115/175 2023-10-16T19:39:05.892 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 116/175 2023-10-16T19:39:05.892 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 117/175 2023-10-16T19:39:05.892 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 118/175 2023-10-16T19:39:05.892 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 119/175 2023-10-16T19:39:05.892 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 120/175 2023-10-16T19:39:05.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 121/175 2023-10-16T19:39:05.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 122/175 2023-10-16T19:39:05.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 123/175 2023-10-16T19:39:05.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 124/175 2023-10-16T19:39:05.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 125/175 2023-10-16T19:39:05.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 126/175 2023-10-16T19:39:05.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 127/175 2023-10-16T19:39:05.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 128/175 2023-10-16T19:39:05.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 129/175 2023-10-16T19:39:05.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 130/175 2023-10-16T19:39:05.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 131/175 2023-10-16T19:39:05.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 132/175 2023-10-16T19:39:05.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 133/175 2023-10-16T19:39:05.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 134/175 2023-10-16T19:39:05.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 135/175 2023-10-16T19:39:05.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 136/175 2023-10-16T19:39:05.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 137/175 2023-10-16T19:39:05.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 138/175 2023-10-16T19:39:05.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 139/175 2023-10-16T19:39:05.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 140/175 2023-10-16T19:39:05.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/175 2023-10-16T19:39:05.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 142/175 2023-10-16T19:39:05.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 143/175 2023-10-16T19:39:05.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 144/175 2023-10-16T19:39:05.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 145/175 2023-10-16T19:39:05.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 146/175 2023-10-16T19:39:05.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 147/175 2023-10-16T19:39:05.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/175 2023-10-16T19:39:05.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 149/175 2023-10-16T19:39:05.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 150/175 2023-10-16T19:39:05.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 151/175 2023-10-16T19:39:05.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 152/175 2023-10-16T19:39:05.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/175 2023-10-16T19:39:05.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 154/175 2023-10-16T19:39:05.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 155/175 2023-10-16T19:39:05.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 156/175 2023-10-16T19:39:05.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 157/175 2023-10-16T19:39:05.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 158/175 2023-10-16T19:39:05.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 159/175 2023-10-16T19:39:05.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 160/175 2023-10-16T19:39:05.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 161/175 2023-10-16T19:39:05.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 162/175 2023-10-16T19:39:05.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 163/175 2023-10-16T19:39:05.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 164/175 2023-10-16T19:39:05.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/175 2023-10-16T19:39:05.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 166/175 2023-10-16T19:39:05.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 167/175 2023-10-16T19:39:05.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 168/175 2023-10-16T19:39:05.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 169/175 2023-10-16T19:39:05.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : acl-2.3.1-4.el9.x86_64 170/175 2023-10-16T19:39:05.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : acl-2.3.1-3.el9.x86_64 171/175 2023-10-16T19:39:05.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/175 2023-10-16T19:39:05.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-16T19:39:05.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/175 2023-10-16T19:39:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-16T19:39:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:08.100 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2023-10-16T19:39:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-16T19:39:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-16T19:39:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-16T19:39:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-16T19:39:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: acl-2.3.1-4.el9.x86_64 2023-10-16T19:39:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-16T19:39:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-16T19:39:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-16T19:39:08.102 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2023-10-16T19:39:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2023-10-16T19:39:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2023-10-16T19:39:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-16T19:39:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T19:39:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-16T19:39:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2023-10-16T19:39:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-16T19:39:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-16T19:39:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-16T19:39:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-16T19:39:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-16T19:39:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-16T19:39:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.6-15.el9.x86_64 2023-10-16T19:39:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-16T19:39:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-16T19:39:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-16T19:39:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-16T19:39:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-16T19:39:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-16T19:39:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-16T19:39:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-16T19:39:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-16T19:39:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-16T19:39:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-16T19:39:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-16T19:39:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-16T19:39:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-16T19:39:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-16T19:39:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-16T19:39:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-16T19:39:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-16T19:39:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-16T19:39:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.11-1.el9.x86_64 2023-10-16T19:39:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-16T19:39:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-16T19:39:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-16T19:39:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-16T19:39:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-16T19:39:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-16T19:39:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-16T19:39:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-16T19:39:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-16T19:39:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-16T19:39:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-16T19:39:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-16T19:39:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-16T19:39:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-16T19:39:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-16T19:39:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-16T19:39:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-16T19:39:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-16T19:39:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-16T19:39:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-16T19:39:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-16T19:39:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-16T19:39:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-16T19:39:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-16T19:39:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-16T19:39:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-16T19:39:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-16T19:39:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-16T19:39:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-16T19:39:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-16T19:39:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-16T19:39:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-16T19:39:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-16T19:39:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-16T19:39:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2023-10-16T19:39:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-16T19:39:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-16T19:39:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-16T19:39:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-16T19:39:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-16T19:39:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-16T19:39:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-16T19:39:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-16T19:39:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-16T19:39:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-16T19:39:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-16T19:39:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-16T19:39:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-16T19:39:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-16T19:39:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-16T19:39:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-16T19:39:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-16T19:39:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-16T19:39:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-16T19:39:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-16T19:39:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-16T19:39:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-debuginfo-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T19:39:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2023-10-16T19:39:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-16T19:39:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-16T19:39:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-16T19:39:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-16T19:39:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-16T19:39:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-16T19:39:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:08.133 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2023-10-16T19:39:09.332 DEBUG:teuthology.parallel:result is None 2023-10-16T19:39:09.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:39:09.485 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T19:39:09.564 INFO:teuthology.orchestra.run.smithi057.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-16T19:39:09.565 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-16T19:39:09.565 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T19:39:09.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:39:09.885 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T19:39:09.949 INFO:teuthology.orchestra.run.smithi110.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-16T19:39:09.949 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-16T19:39:09.949 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T19:39:09.950 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T19:39:09.951 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:09.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T19:39:10.066 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:10.066 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T19:39:10.143 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T19:39:10.144 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:10.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T19:39:10.246 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T19:39:10.393 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:10.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T19:39:10.470 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T19:39:10.590 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T19:39:10.591 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:10.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T19:39:10.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T19:39:10.845 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:10.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T19:39:10.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T19:39:11.055 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T19:39:11.056 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:11.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T19:39:11.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T19:39:11.268 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:11.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T19:39:11.355 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T19:39:11.474 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T19:39:11.542 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T19:39:11.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-10-16T19:39:11.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2023-10-16T19:39:11.651 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T19:39:11.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T19:39:11.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T19:39:11.751 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T19:39:11.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T19:39:11.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T19:39:11.864 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T19:39:11.864 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T19:39:11.865 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T19:39:11.865 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:11.865 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T19:39:11.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:12.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:12.314 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:12.314 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T19:39:12.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:12.582 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:12.663 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T19:39:12.664 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T19:39:12.664 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061', 'branch': 'rishabh-2023oct13', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7430061', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-qa2', 'sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-qa2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2zusky+XBRcCSZzHYHFmLoRFcxSn8E5NGKEAsqcPkd3RWzrXWZ/UENhfaQ/IVdYDBN0rdhcEliONWfbnIvHb4=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyv10wTIhXE0Wp2+/pnLwD0VllAIiMrvMNwpE9DceocyJdBs8b6tCs+fOlHkaKfpGuV2PeuurBhsdCKBoq0bqY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_18:49:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T19:39:12.665 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T19:39:12.674 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T19:39:12.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T19:39:12.735 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T19:39:12.841 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:12.842 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T19:39:12.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T19:39:12.905 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-10-16T19:39:12.962 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T19:39:12.963 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:12.963 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-10-16T19:39:12.963 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:12.963 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:12.964 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-16 19:38:05.788849854 +0000 2023-10-16T19:39:12.964 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-16 19:29:07.287167225 +0000 2023-10-16T19:39:12.964 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-16 19:29:07.287167225 +0000 2023-10-16T19:39:12.964 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-10-16 19:29:07.287167225 +0000 2023-10-16T19:39:12.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T19:39:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-16T19:39:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-16T19:39:13.062 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000432924 s, 1.2 MB/s 2023-10-16T19:39:13.065 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T19:39:13.126 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-10-16T19:39:13.181 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T19:39:13.181 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:13.181 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-10-16T19:39:13.182 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:13.182 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:13.182 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-16 19:38:05.789849838 +0000 2023-10-16T19:39:13.182 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-16 19:29:08.347150391 +0000 2023-10-16T19:39:13.183 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-16 19:29:08.347150391 +0000 2023-10-16T19:39:13.183 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-10-16 19:29:08.347150391 +0000 2023-10-16T19:39:13.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T19:39:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-16T19:39:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-16T19:39:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000414836 s, 1.2 MB/s 2023-10-16T19:39:13.288 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T19:39:13.352 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-10-16T19:39:13.407 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T19:39:13.407 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:13.408 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-10-16T19:39:13.408 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:13.408 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:13.408 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-16 19:38:05.789849838 +0000 2023-10-16T19:39:13.408 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-16 19:29:09.433133145 +0000 2023-10-16T19:39:13.409 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-16 19:29:09.433133145 +0000 2023-10-16T19:39:13.409 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-10-16 19:29:09.433133145 +0000 2023-10-16T19:39:13.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T19:39:13.505 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-16T19:39:13.505 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-16T19:39:13.505 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000424338 s, 1.2 MB/s 2023-10-16T19:39:13.509 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T19:39:13.572 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-10-16T19:39:13.627 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T19:39:13.627 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:13.627 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-10-16T19:39:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-16 19:38:05.790849822 +0000 2023-10-16T19:39:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-16 19:29:10.506116104 +0000 2023-10-16T19:39:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-16 19:29:10.506116104 +0000 2023-10-16T19:39:13.629 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-10-16 19:29:10.506116104 +0000 2023-10-16T19:39:13.629 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T19:39:13.726 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-16T19:39:13.726 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-16T19:39:13.726 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000436371 s, 1.2 MB/s 2023-10-16T19:39:13.731 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T19:39:13.793 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:13.794 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:13.794 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T19:39:13.854 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T19:39:13.855 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2023-10-16T19:39:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T19:39:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:13.908 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-10-16T19:39:13.908 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:13.908 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:13.908 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-16 19:38:58.155227089 +0000 2023-10-16T19:39:13.909 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-16 19:28:43.298529983 +0000 2023-10-16T19:39:13.909 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-16 19:28:43.298529983 +0000 2023-10-16T19:39:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-16 19:28:43.298529983 +0000 2023-10-16T19:39:13.909 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T19:39:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-16T19:39:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-16T19:39:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000341355 s, 1.5 MB/s 2023-10-16T19:39:14.001 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T19:39:14.058 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2023-10-16T19:39:14.108 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T19:39:14.108 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:14.108 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-10-16T19:39:14.109 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:14.109 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:14.109 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-16 19:38:58.156227072 +0000 2023-10-16T19:39:14.109 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-16 19:28:44.273513245 +0000 2023-10-16T19:39:14.109 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-16 19:28:44.273513245 +0000 2023-10-16T19:39:14.110 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-16 19:28:44.273513245 +0000 2023-10-16T19:39:14.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T19:39:14.194 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-16T19:39:14.194 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-16T19:39:14.195 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000228784 s, 2.2 MB/s 2023-10-16T19:39:14.197 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T19:39:14.254 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2023-10-16T19:39:14.304 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T19:39:14.304 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:14.304 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-10-16T19:39:14.304 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:14.305 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:14.305 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-16 19:38:58.157227055 +0000 2023-10-16T19:39:14.305 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-16 19:28:45.285495871 +0000 2023-10-16T19:39:14.305 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-16 19:28:45.285495871 +0000 2023-10-16T19:39:14.305 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-16 19:28:45.285495871 +0000 2023-10-16T19:39:14.306 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T19:39:14.408 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-16T19:39:14.409 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-16T19:39:14.409 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000237251 s, 2.2 MB/s 2023-10-16T19:39:14.412 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T19:39:14.468 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2023-10-16T19:39:14.520 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T19:39:14.520 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:39:14.520 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-10-16T19:39:14.520 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:39:14.521 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:39:14.521 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-10-16 19:38:58.157227055 +0000 2023-10-16T19:39:14.521 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-10-16 19:28:46.299478463 +0000 2023-10-16T19:39:14.521 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-10-16 19:28:46.299478463 +0000 2023-10-16T19:39:14.521 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-10-16 19:28:46.299478463 +0000 2023-10-16T19:39:14.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T19:39:14.614 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-10-16T19:39:14.614 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-10-16T19:39:14.614 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000223713 s, 2.3 MB/s 2023-10-16T19:39:14.617 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T19:39:14.673 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:14.673 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T19:39:14.674 INFO:tasks.ceph:Generating config... 2023-10-16T19:39:14.675 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T19:39:14.675 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T19:39:14.676 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T19:39:14.676 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T19:39:14.676 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T19:39:14.676 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-10-16T19:39:14.677 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-10-16T19:39:14.677 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-10-16T19:39:14.677 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T19:39:14.678 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T19:39:14.678 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T19:39:14.678 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T19:39:14.678 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T19:39:14.679 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T19:39:14.679 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-10-16T19:39:14.679 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T19:39:14.679 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T19:39:14.680 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T19:39:14.680 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T19:39:14.680 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T19:39:14.680 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T19:39:14.681 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T19:39:14.681 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T19:39:14.681 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T19:39:14.681 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T19:39:14.682 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-10-16T19:39:14.682 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T19:39:14.682 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-16T19:39:14.683 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T19:39:14.683 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-16T19:39:14.683 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-16T19:39:14.683 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T19:39:14.684 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T19:39:14.684 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-16T19:39:14.684 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T19:39:14.684 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T19:39:14.685 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T19:39:14.685 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T19:39:14.685 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-10-16T19:39:14.685 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T19:39:14.686 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T19:39:14.686 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T19:39:14.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T19:39:14.836 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T19:39:14.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T19:39:14.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:39:15.069 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2023-10-16T19:39:15.070 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T19:39:15.071 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:15.071 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T19:39:15.126 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:15.289 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:15.289 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid ee1d7270-3118-4d78-b8fc-a1736155df58 2023-10-16T19:39:15.289 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = pacific 2023-10-16T19:39:15.290 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2023-10-16T19:39:15.290 INFO:teuthology.orchestra.run.smithi057.stdout:fsid ee1d7270-3118-4d78-b8fc-a1736155df58 2023-10-16T19:39:15.290 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2023-10-16T19:39:15.288341+0000 2023-10-16T19:39:15.290 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-10-16T19:39:15.288341+0000 2023-10-16T19:39:15.290 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 16 (pacific) 2023-10-16T19:39:15.291 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2023-10-16T19:39:15.291 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2023-10-16T19:39:15.291 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2023-10-16T19:39:15.291 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2023-10-16T19:39:15.291 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T19:39:15.293 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T19:39:15.345 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ee1d7270-3118-4d78-b8fc-a1736155df58... 2023-10-16T19:39:15.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T19:39:15.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T19:39:15.523 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-16T19:39:15.523 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-16T19:39:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T19:39:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-16T19:39:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-16T19:39:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-16T19:39:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-16T19:39:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-16T19:39:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-16T19:39:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-16T19:39:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T19:39:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-16T19:39:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T19:39:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T19:39:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-16T19:39:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-16T19:39:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-16T19:39:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-16T19:39:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-16T19:39:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-16T19:39:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-16T19:39:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-16T19:39:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T19:39:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T19:39:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-16T19:39:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T19:39:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-16T19:39:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-16T19:39:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-16T19:39:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-16T19:39:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-16T19:39:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2023-10-16T19:39:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: mds beacon grace = 60 2023-10-16T19:39:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: mds heartbeat grace = 60 2023-10-16T19:39:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: osd heartbeat grace = 60 2023-10-16T19:39:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = ee1d7270-3118-4d78-b8fc-a1736155df58 2023-10-16T19:39:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.532 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-16T19:39:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-16T19:39:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-16T19:39:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-16T19:39:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-16T19:39:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-16T19:39:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-16T19:39:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-16T19:39:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-16T19:39:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-16T19:39:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-16T19:39:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-16T19:39:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-16T19:39:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-16T19:39:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-16T19:39:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-16T19:39:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-16T19:39:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-16T19:39:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-16T19:39:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-16T19:39:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression mode = aggressive 2023-10-16T19:39:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-16T19:39:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 20 2023-10-16T19:39:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 20 2023-10-16T19:39:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-16T19:39:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-16T19:39:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 10 2023-10-16T19:39:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T19:39:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-16T19:39:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-16T19:39:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-16T19:39:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: osd fast shutdown = False 2023-10-16T19:39:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-16T19:39:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-16T19:39:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.541 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-16T19:39:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-16T19:39:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-16T19:39:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-16T19:39:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-16T19:39:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:39:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:39:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-16T19:39:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.542 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-16T19:39:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-16T19:39:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-16T19:39:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-16T19:39:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-16T19:39:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-16T19:39:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-16T19:39:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:39:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-16T19:39:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-16T19:39:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:39:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T19:39:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T19:39:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T19:39:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T19:39:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T19:39:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T19:39:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-16T19:39:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-16T19:39:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-16T19:39:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-16T19:39:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd crush smoke test = False 2023-10-16T19:39:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:39:15.547 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-16T19:39:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-16T19:39:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-16T19:39:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-16T19:39:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T19:39:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T19:39:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-16T19:39:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-16T19:39:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-16T19:39:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-16T19:39:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-16T19:39:15.549 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-16T19:39:15.549 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-16T19:39:15.550 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-16T19:39:15.550 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-16T19:39:15.550 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-16T19:39:15.550 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.e] 2023-10-16T19:39:15.550 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-16T19:39:15.551 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-16T19:39:15.551 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.f] 2023-10-16T19:39:15.551 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-16T19:39:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-16T19:39:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2023-10-16T19:39:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-16T19:39:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-16T19:39:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-16T19:39:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-16T19:39:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: mds valgrind exit = True 2023-10-16T19:39:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-16T19:39:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-16T19:39:15.553 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-16T19:39:15.553 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-16T19:39:15.553 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2023-10-16T19:39:15.554 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2023-10-16T19:39:15.554 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T19:39:15.554 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2023-10-16T19:39:15.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.554 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2023-10-16T19:39:15.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.555 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2023-10-16T19:39:15.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.555 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2023-10-16T19:39:15.555 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2023-10-16T19:39:15.556 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.556 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2023-10-16T19:39:15.556 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2023-10-16T19:39:15.556 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.556 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T19:39:15.556 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2023-10-16T19:39:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T19:39:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T19:39:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2023-10-16T19:39:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.558 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2023-10-16T19:39:15.558 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2023-10-16T19:39:15.558 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2023-10-16T19:39:15.558 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2023-10-16T19:39:15.558 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2023-10-16T19:39:15.559 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2023-10-16T19:39:15.559 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2023-10-16T19:39:15.559 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T19:39:15.559 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T19:39:15.559 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2023-10-16T19:39:15.560 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.560 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T19:39:15.560 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.560 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2023-10-16T19:39:15.560 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.560 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2023-10-16T19:39:15.561 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.561 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2023-10-16T19:39:15.561 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2023-10-16T19:39:15.561 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2023-10-16T19:39:15.561 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.57,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2023-10-16T19:39:15.561 INFO:teuthology.orchestra.run.smithi110.stdout: mds beacon grace = 60 2023-10-16T19:39:15.562 INFO:teuthology.orchestra.run.smithi110.stdout: mds heartbeat grace = 60 2023-10-16T19:39:15.562 INFO:teuthology.orchestra.run.smithi110.stdout: osd heartbeat grace = 60 2023-10-16T19:39:15.562 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = ee1d7270-3118-4d78-b8fc-a1736155df58 2023-10-16T19:39:15.562 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.562 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2023-10-16T19:39:15.563 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2023-10-16T19:39:15.563 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.563 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2023-10-16T19:39:15.563 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2023-10-16T19:39:15.563 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2023-10-16T19:39:15.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.564 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2023-10-16T19:39:15.564 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2023-10-16T19:39:15.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.564 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2023-10-16T19:39:15.564 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2023-10-16T19:39:15.565 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2023-10-16T19:39:15.565 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.565 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2023-10-16T19:39:15.565 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2023-10-16T19:39:15.565 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.566 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2023-10-16T19:39:15.566 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.566 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2023-10-16T19:39:15.566 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.566 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2023-10-16T19:39:15.566 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.567 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2023-10-16T19:39:15.567 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2023-10-16T19:39:15.567 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.567 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2023-10-16T19:39:15.567 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2023-10-16T19:39:15.568 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2023-10-16T19:39:15.568 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression mode = aggressive 2023-10-16T19:39:15.568 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2023-10-16T19:39:15.568 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2023-10-16T19:39:15.568 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2023-10-16T19:39:15.569 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-16T19:39:15.569 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2023-10-16T19:39:15.569 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2023-10-16T19:39:15.569 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T19:39:15.569 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2023-10-16T19:39:15.569 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2023-10-16T19:39:15.570 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2023-10-16T19:39:15.570 INFO:teuthology.orchestra.run.smithi110.stdout: osd fast shutdown = False 2023-10-16T19:39:15.570 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2023-10-16T19:39:15.570 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2023-10-16T19:39:15.570 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.571 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2023-10-16T19:39:15.571 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-16T19:39:15.571 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2023-10-16T19:39:15.571 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2023-10-16T19:39:15.571 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2023-10-16T19:39:15.571 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:39:15.572 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:39:15.572 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2023-10-16T19:39:15.572 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.572 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2023-10-16T19:39:15.572 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-16T19:39:15.572 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2023-10-16T19:39:15.573 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2023-10-16T19:39:15.573 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2023-10-16T19:39:15.573 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2023-10-16T19:39:15.573 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2023-10-16T19:39:15.573 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:39:15.574 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2023-10-16T19:39:15.574 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2023-10-16T19:39:15.574 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:39:15.574 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.574 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T19:39:15.574 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T19:39:15.575 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T19:39:15.575 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.575 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T19:39:15.575 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T19:39:15.575 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T19:39:15.575 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.576 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2023-10-16T19:39:15.576 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2023-10-16T19:39:15.576 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.576 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2023-10-16T19:39:15.576 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2023-10-16T19:39:15.577 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd crush smoke test = False 2023-10-16T19:39:15.577 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-10-16T19:39:15.577 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2023-10-16T19:39:15.577 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2023-10-16T19:39:15.577 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2023-10-16T19:39:15.577 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2023-10-16T19:39:15.578 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T19:39:15.578 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T19:39:15.578 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2023-10-16T19:39:15.578 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2023-10-16T19:39:15.578 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-16T19:39:15.579 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2023-10-16T19:39:15.579 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2023-10-16T19:39:15.579 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2023-10-16T19:39:15.579 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2023-10-16T19:39:15.579 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2023-10-16T19:39:15.579 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2023-10-16T19:39:15.580 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2023-10-16T19:39:15.580 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2023-10-16T19:39:15.580 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2023-10-16T19:39:15.580 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2023-10-16T19:39:15.580 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2023-10-16T19:39:15.580 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2023-10-16T19:39:15.581 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2023-10-16T19:39:15.581 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2023-10-16T19:39:15.581 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-10-16T19:39:15.581 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2023-10-16T19:39:15.581 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2023-10-16T19:39:15.582 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2023-10-16T19:39:15.582 INFO:teuthology.orchestra.run.smithi110.stdout: mds valgrind exit = True 2023-10-16T19:39:15.582 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2023-10-16T19:39:15.582 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2023-10-16T19:39:15.582 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2023-10-16T19:39:15.582 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2023-10-16T19:39:15.584 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T19:39:15.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T19:39:15.748 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T19:39:15.748 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:15.749 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T19:39:15.803 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:15.804 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T19:39:15.860 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T19:39:15.861 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:15.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T19:39:15.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:39:16.023 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:16.024 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:16.125 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T19:39:16.126 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:16.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T19:39:16.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:39:16.284 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:16.284 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:16.383 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T19:39:16.383 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T19:39:16.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T19:39:16.589 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T19:39:16.601 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T19:39:16.813 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T19:39:16.825 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T19:39:16.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T19:39:17.013 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T19:39:17.023 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T19:39:17.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T19:39:17.310 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T19:39:17.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T19:39:17.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-10-16T19:39:17.618 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-10-16T19:39:17.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-10-16T19:39:17.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T19:39:17.922 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T19:39:17.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T19:39:18.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T19:39:18.207 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T19:39:18.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T19:39:18.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-10-16T19:39:18.484 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-10-16T19:39:18.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-10-16T19:39:18.585 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T19:39:18.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T19:39:18.729 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T19:39:18.784 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T19:39:18.784 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T19:39:18.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:18.891 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:18.892 INFO:tasks.ceph:role: osd.0 2023-10-16T19:39:18.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T19:39:18.892 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T19:39:19.023 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:19.024 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:19.024 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:19.024 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:19.025 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:20.413 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-10-16T19:39:20.420 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-16T19:39:20.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:20.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:20.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:20.791 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:20.791 INFO:tasks.ceph:role: osd.1 2023-10-16T19:39:20.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T19:39:20.792 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T19:39:20.917 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:20.919 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:20.919 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:20.919 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:20.920 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-10-16T19:39:22.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-16T19:39:22.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:22.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:22.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:22.625 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:22.625 INFO:tasks.ceph:role: osd.2 2023-10-16T19:39:22.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T19:39:22.626 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T19:39:22.750 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:22.750 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:22.751 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:22.751 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:22.751 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:22.751 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:22.751 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:22.752 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:22.752 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:22.752 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:24.073 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-10-16T19:39:24.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-16T19:39:24.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:24.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:24.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:24.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:24.398 INFO:tasks.ceph:role: osd.3 2023-10-16T19:39:24.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T19:39:24.398 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T19:39:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:24.528 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:25.852 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-10-16T19:39:25.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-16T19:39:25.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:25.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:26.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:26.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:26.235+0000 7f5195939500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T19:39:26.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:26.236+0000 7f5195939500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T19:39:26.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:26.236+0000 7f5195939500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T19:39:26.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:26.236+0000 7f5195939500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T19:39:26.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:26.236+0000 7f5195939500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T19:39:26.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:26.240+0000 7f5195939500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T19:39:29.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:29.551 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:29.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:29.699+0000 7f1cd7d07500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T19:39:29.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:29.700+0000 7f1cd7d07500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T19:39:29.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:29.700+0000 7f1cd7d07500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T19:39:29.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:29.700+0000 7f1cd7d07500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T19:39:29.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:29.700+0000 7f1cd7d07500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T19:39:29.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:29.703+0000 7f1cd7d07500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T19:39:32.641 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:32.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:32.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:32.897+0000 7ff529a24500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T19:39:32.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:32.898+0000 7ff529a24500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T19:39:32.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:32.898+0000 7ff529a24500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T19:39:32.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:32.898+0000 7ff529a24500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T19:39:32.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:32.898+0000 7ff529a24500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T19:39:32.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:32.900+0000 7ff529a24500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T19:39:36.098 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:36.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:36.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:36.473+0000 7fc5c4607500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T19:39:36.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:36.474+0000 7fc5c4607500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T19:39:36.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:36.474+0000 7fc5c4607500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T19:39:36.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:36.474+0000 7fc5c4607500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T19:39:36.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:36.474+0000 7fc5c4607500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T19:39:36.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:39:36.476+0000 7fc5c4607500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T19:39:39.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:39.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:39.633 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:39.634 INFO:tasks.ceph:role: osd.4 2023-10-16T19:39:39.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T19:39:39.635 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T19:39:39.730 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:39.731 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:39.732 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:39.732 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:39.732 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:39.765 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-16T19:39:39.770 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-16T19:39:39.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:39.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:39.976 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:40.062 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:40.063 INFO:tasks.ceph:role: osd.5 2023-10-16T19:39:40.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T19:39:40.063 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T19:39:40.153 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:40.154 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:40.154 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:40.154 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:40.154 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:40.155 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:40.155 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:40.155 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:40.155 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:40.155 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:40.187 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-16T19:39:40.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-16T19:39:40.192 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:40.303 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:40.383 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:40.473 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:40.473 INFO:tasks.ceph:role: osd.6 2023-10-16T19:39:40.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T19:39:40.474 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T19:39:40.566 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:40.566 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:40.566 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:40.567 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:40.567 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:40.567 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:40.567 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:40.567 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:40.568 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:40.568 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:40.599 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-16T19:39:40.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-16T19:39:40.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:40.720 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:40.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:40.905 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:40.906 INFO:tasks.ceph:role: osd.7 2023-10-16T19:39:40.906 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T19:39:40.906 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T19:39:41.000 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:41.000 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:41.001 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:41.001 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T19:39:41.001 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:41.001 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:41.001 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:41.002 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T19:39:41.002 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:41.002 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:41.034 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-10-16T19:39:41.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-10-16T19:39:41.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:41.155 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:41.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:41.380+0000 7f1dbac0e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T19:39:41.383 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:41.381+0000 7f1dbac0e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T19:39:41.383 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:41.381+0000 7f1dbac0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T19:39:41.383 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:41.381+0000 7f1dbac0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T19:39:41.384 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:41.381+0000 7f1dbac0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T19:39:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:41.384+0000 7f1dbac0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T19:39:42.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:42.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:44.299 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:44.395 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:44.536 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:44.534+0000 7ff74e421500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T19:39:44.537 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:44.535+0000 7ff74e421500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T19:39:44.537 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:44.535+0000 7ff74e421500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T19:39:44.537 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:44.535+0000 7ff74e421500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T19:39:44.538 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:44.535+0000 7ff74e421500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T19:39:44.538 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:44.537+0000 7ff74e421500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T19:39:47.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:47.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:47.939+0000 7f78c662a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T19:39:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:47.940+0000 7f78c662a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T19:39:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:47.940+0000 7f78c662a500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T19:39:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:47.940+0000 7f78c662a500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T19:39:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:47.940+0000 7f78c662a500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T19:39:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:47.942+0000 7f78c662a500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T19:39:51.109 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:51.205 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:51.349 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:51.346+0000 7fc40ca1f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T19:39:51.349 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:51.346+0000 7fc40ca1f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T19:39:51.349 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:51.347+0000 7fc40ca1f500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T19:39:51.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:51.347+0000 7fc40ca1f500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T19:39:51.350 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:51.347+0000 7fc40ca1f500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T19:39:51.351 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:39:51.349+0000 7fc40ca1f500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T19:39:54.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:54.616 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T19:39:54.616 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:54.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T19:39:54.728 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:54.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T19:39:54.828 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:54.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T19:39:54.931 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:54.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-10-16T19:39:55.033 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:55.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T19:39:55.134 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:55.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T19:39:55.241 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:55.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T19:39:55.342 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:55.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T19:39:55.444 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:55.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T19:39:55.552 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:55.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T19:39:55.646 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:55.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T19:39:55.740 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:55.740 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-10-16T19:39:55.833 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:55.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T19:39:55.930 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:55.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T19:39:56.030 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:56.030 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T19:39:56.130 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:39:56.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T19:39:56.231 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:39:56.231 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T19:39:56.295 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T19:39:56.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T19:39:56.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T19:39:56.393 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2023-10-16T19:39:56.394 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBkkS1lPKodIxAAHk7S3+TE/5Q8qmWFVqN5EQ== 2023-10-16T19:39:56.394 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-16T19:39:56.395 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBlkS1l82DAABAADERNHaa9Z4K+uf9CPDOgqw== 2023-10-16T19:39:56.395 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-16T19:39:56.395 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBlkS1lCJ10EhAA673YzgBEFbQq0fWzNsBjlQ== 2023-10-16T19:39:56.395 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.e] 2023-10-16T19:39:56.396 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBlkS1ldTLXJBAAEb+XxnpDN8nccaZlcdUL8A== 2023-10-16T19:39:56.396 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-10-16T19:39:56.396 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBukS1lxS4XDhAAx2KM4WWfeI9r0u08u7vc7g== 2023-10-16T19:39:56.396 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2023-10-16T19:39:56.397 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBxkS1lxDjBKRAAjkeEZfGctFtq8lgMdaoH6w== 2023-10-16T19:39:56.397 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2023-10-16T19:39:56.397 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB0kS1llgaJNRAA/nWzXWY178RTaKBNml5CAw== 2023-10-16T19:39:56.397 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2023-10-16T19:39:56.398 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB4kS1lETBBHBAAc4tX8jjw0vR67U2Q2MJQqQ== 2023-10-16T19:39:56.398 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-10-16T19:39:56.398 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBkkS1lnuJxMBAA4sxdqo+Sg54NaHFg9QxzWw== 2023-10-16T19:39:56.398 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-16T19:39:56.399 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBlkS1llsXrNhAAzhhc7GGPUoTXqapQImGctA== 2023-10-16T19:39:56.399 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-16T19:39:56.399 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBmkS1l77RXDBAAihf2tzzmPzlzt92afk4Ojg== 2023-10-16T19:39:56.399 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.f] 2023-10-16T19:39:56.399 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBmkS1lihjRHBAAV3h0PzHDVFzqvpjkRG3EsQ== 2023-10-16T19:39:56.400 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2023-10-16T19:39:56.400 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB9kS1lsQ2+FhAAqxzkdE4lvwKuQznNjrLp+Q== 2023-10-16T19:39:56.400 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2023-10-16T19:39:56.400 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCAkS1ljbfsHxAAVnLsGEvXt1Tv/laXA+pxxg== 2023-10-16T19:39:56.401 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2023-10-16T19:39:56.401 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCDkS1lljgSOBAAGZvdn+kaRl5SeT2vcUZFAA== 2023-10-16T19:39:56.401 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2023-10-16T19:39:56.401 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCHkS1l+7q2FBAAQaptxHGtQ7ANpe42Cio2SA== 2023-10-16T19:39:56.402 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-10-16T19:39:56.402 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBmkS1lQJBqKxAAfTNVODIbjeT8R6JuzvUGaA== 2023-10-16T19:39:56.404 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2023-10-16T19:39:56.404 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBkkS1lPKodIxAAHk7S3+TE/5Q8qmWFVqN5EQ== 2023-10-16T19:39:56.404 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2023-10-16T19:39:56.405 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBlkS1l82DAABAADERNHaa9Z4K+uf9CPDOgqw== 2023-10-16T19:39:56.405 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2023-10-16T19:39:56.405 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBlkS1lCJ10EhAA673YzgBEFbQq0fWzNsBjlQ== 2023-10-16T19:39:56.406 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2023-10-16T19:39:56.406 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBlkS1ldTLXJBAAEb+XxnpDN8nccaZlcdUL8A== 2023-10-16T19:39:56.406 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2023-10-16T19:39:56.406 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBukS1lxS4XDhAAx2KM4WWfeI9r0u08u7vc7g== 2023-10-16T19:39:56.407 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2023-10-16T19:39:56.407 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBxkS1lxDjBKRAAjkeEZfGctFtq8lgMdaoH6w== 2023-10-16T19:39:56.407 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2023-10-16T19:39:56.407 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB0kS1llgaJNRAA/nWzXWY178RTaKBNml5CAw== 2023-10-16T19:39:56.408 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2023-10-16T19:39:56.408 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB4kS1lETBBHBAAc4tX8jjw0vR67U2Q2MJQqQ== 2023-10-16T19:39:56.408 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2023-10-16T19:39:56.408 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBkkS1lnuJxMBAA4sxdqo+Sg54NaHFg9QxzWw== 2023-10-16T19:39:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2023-10-16T19:39:56.409 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBlkS1llsXrNhAAzhhc7GGPUoTXqapQImGctA== 2023-10-16T19:39:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2023-10-16T19:39:56.409 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBmkS1l77RXDBAAihf2tzzmPzlzt92afk4Ojg== 2023-10-16T19:39:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2023-10-16T19:39:56.410 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBmkS1lihjRHBAAV3h0PzHDVFzqvpjkRG3EsQ== 2023-10-16T19:39:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2023-10-16T19:39:56.410 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB9kS1lsQ2+FhAAqxzkdE4lvwKuQznNjrLp+Q== 2023-10-16T19:39:56.411 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2023-10-16T19:39:56.411 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCAkS1ljbfsHxAAVnLsGEvXt1Tv/laXA+pxxg== 2023-10-16T19:39:56.411 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2023-10-16T19:39:56.411 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCDkS1lljgSOBAAGZvdn+kaRl5SeT2vcUZFAA== 2023-10-16T19:39:56.412 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2023-10-16T19:39:56.412 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCHkS1l+7q2FBAAQaptxHGtQ7ANpe42Cio2SA== 2023-10-16T19:39:56.412 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2023-10-16T19:39:56.412 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBmkS1lQJBqKxAAfTNVODIbjeT8R6JuzvUGaA== 2023-10-16T19:39:56.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:56.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:56.571 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:56.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:56.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:56.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:56.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:56.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:57.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.220 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:57.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:57.686 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:57.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:57.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:57.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:57.993 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:58.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:58.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:58.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.473 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.623 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.781 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:58.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:39:58.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:39:59.094 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T19:39:59.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T19:39:59.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:39:59.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T19:39:59.478 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T19:39:59.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:39:59.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T19:39:59.832 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T19:39:59.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:40:00.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T19:40:00.169 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:40:00.178 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:40:00.231 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T19:40:00.232 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-16T19:40:00.232 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T19:40:00.233 DEBUG:teuthology.orchestra.run.smithi057:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-10-16T19:40:00.238 INFO:tasks.ceph.mon.a:Started 2023-10-16T19:40:00.239 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-16T19:40:00.239 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T19:40:00.239 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-10-16T19:40:00.245 INFO:tasks.ceph.mon.b:Started 2023-10-16T19:40:00.245 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-16T19:40:00.245 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T19:40:00.246 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-10-16T19:40:00.254 INFO:tasks.ceph.mon.c:Started 2023-10-16T19:40:00.255 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T19:40:00.255 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T19:40:00.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-10-16T19:40:00.264 INFO:tasks.ceph.mgr.y:Started 2023-10-16T19:40:00.264 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T19:40:00.264 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-10-16T19:40:00.269 INFO:tasks.ceph.mgr.x:Started 2023-10-16T19:40:00.270 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T19:40:00.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T19:40:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.452+0000 7f23af8c2640 1 Processor -- start 2023-10-16T19:40:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.453+0000 7f23af8c2640 1 -- start start 2023-10-16T19:40:00.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23af8c2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 0x7f23a806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23af8c2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f23a806e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23af8c2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a80aeb10 con 0x7f23a80ae730 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23af8c2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a815cf60 con 0x7f23a80c8460 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23af8c2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a806dd60 con 0x7f23a806efe0 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23ad65e640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f23a80ae730 legacy=0x7f23a806b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23ace5d640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 msgr2=0x7f23a806e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23ade5f640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f23a806e730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23ade5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f23a806e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.454+0000 7f23ace5d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 0x7f23a806e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.655+0000 7f23ace5d640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 msgr2=0x7f23a806e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.655+0000 7f23ade5f640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f23a806e730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.655+0000 7f23ad65e640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f23a80ae730 legacy=0x7f23a806b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.655+0000 7f23ace5d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 0x7f23a806e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:00.655+0000 7f23ade5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f23a806e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:01.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.056+0000 7f23ace5d640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 msgr2=0x7f23a806e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:01.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.056+0000 7f23ade5f640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f23a806e730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:01.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.056+0000 7f23ad65e640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f23a80ae730 legacy=0x7f23a806b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:01.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.056+0000 7f23ace5d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 0x7f23a806e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:01.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.056+0000 7f23ade5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f23a806e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:01.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.857+0000 7f23ace5d640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 msgr2=0x7f23a806e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:01.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.857+0000 7f23ace5d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 0x7f23a806e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.857+0000 7f23ad65e640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f23a80ae730 legacy=0x7f23a806b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.857+0000 7f23ade5f640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f23a806e730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:01.857+0000 7f23ade5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f23a806e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:03.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f23a806e730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:03.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f23a806e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:03.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 msgr2=0x7f23a806e1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:03.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a80c8460 0x7f23a806e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:03.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f23a80ae730 legacy=0x7f23a806b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.453+0000 7f239effd640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a815d450 con 0x7f238c006190 2023-10-16T19:40:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.454+0000 7f239effd640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a815cf60 con 0x7f238c0036c0 2023-10-16T19:40:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.454+0000 7f23ad65e640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.454+0000 7f23ad65e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:03.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.454+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.655+0000 7f23ad65e640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.655+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:03.655+0000 7f23ad65e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:04.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:04.056+0000 7f23ad65e640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:04.056+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:04.056+0000 7f23ad65e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:04.857+0000 7f23ad65e640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:04.857+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:04.857+0000 7f23ad65e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:06.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:06.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:06.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f23ade5f640 1 -- reap_dead start 2023-10-16T19:40:06.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a80aeb10 con 0x7f238c006190 2023-10-16T19:40:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a815cf60 con 0x7f238c0036c0 2023-10-16T19:40:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f239effd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a806dd60 con 0x7f23a806efe0 2023-10-16T19:40:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f23ade5f640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f23ad65e640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:06.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.454+0000 7f23ade5f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:06.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.455+0000 7f23ad65e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:06.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.655+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:06.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.655+0000 7f23ade5f640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:06.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.655+0000 7f23ade5f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:06.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.656+0000 7f23ad65e640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:06.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:06.656+0000 7f23ad65e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:07.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.056+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:07.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.056+0000 7f23ade5f640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:07.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.056+0000 7f23ade5f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:07.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.057+0000 7f23ad65e640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:07.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.057+0000 7f23ad65e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.857+0000 7f23ace5d640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.57:6789/0 2023-10-16T19:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.857+0000 7f23ade5f640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.57:3300/0 2023-10-16T19:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.857+0000 7f23ade5f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.858+0000 7f23ad65e640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2023-10-16T19:40:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:07.858+0000 7f23ad65e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:08.879 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:00:08.428 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:40:08.901 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:00:08.450 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:40:09.201 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:00:08.750 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:40:09.223 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:00:08.772 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:40:09.278 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:00:08.839 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:40:09.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:09.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:09.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 -- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 msgr2=0x7f238c005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:09.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f238c0036c0 0x7f238c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:09.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 -- >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c0085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:09.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a815d450 con 0x7f238c00f620 2023-10-16T19:40:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.454+0000 7f239effd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a815cf60 con 0x7f238c00a640 2023-10-16T19:40:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.455+0000 7f23ad65e640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 msgr2=0x7f238c00f0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.455+0000 7f23ace5d640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f238c00f620 legacy=0x7f238c011a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.455+0000 7f23ad65e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:09.621 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:00:09.182 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:40:09.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.656+0000 7f23ad65e640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 msgr2=0x7f238c00f0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:09.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.656+0000 7f23ace5d640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f238c00f620 legacy=0x7f238c011a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:09.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:09.656+0000 7f23ad65e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:10.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:10.057+0000 7f23ad65e640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 msgr2=0x7f238c00f0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2023-10-16T19:40:10.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:10.057+0000 7f23ace5d640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f238c00f620 legacy=0x7f238c011a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2023-10-16T19:40:10.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:10.057+0000 7f23ad65e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:11.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.050+0000 7f23ad65e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:11.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.065+0000 7f23ace5d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f238c00f620 0x7f238c011a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:44002/0 (socket says 172.21.15.57:44002) 2023-10-16T19:40:11.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.065+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 learned_addr learned my addr 172.21.15.57:0/12044423 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:11.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.150+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 msgr2=0x7f238c00f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T19:40:11.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.150+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 msgr2=0x7f238c00f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:11.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.150+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:11.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:11.150+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.454+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 msgr2=0x7f238c00f0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c00a640 0x7f238c00f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 >> v1:172.21.15.110:6789/0 conn(0x7f238c00f620 legacy=0x7f238c011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 reap_dead start 2023-10-16T19:40:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a80aeb10 con 0x7f238c006190 2023-10-16T19:40:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a815cf60 con 0x7f238c013130 2023-10-16T19:40:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a806dd60 con 0x7f23a806efe0 2023-10-16T19:40:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.624+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:12.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.656+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:12.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.657+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:12.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.657+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:12.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.657+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:12.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.657+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.760+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T19:40:12.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.760+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.760+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.761+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:12.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:12.853 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:12.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.893+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:12.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.897+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:12.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.897+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:12.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.897+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:12.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:12.897+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:13.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.046+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:13.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.053+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.053+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.053+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.053+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:13.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.301+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:13.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.303+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:13.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.303+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:13.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.303+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:13.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.303+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:13.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.457+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:13.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.460+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:13.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.460+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:13.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.460+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:13.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:13.460+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.105+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.108+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.108+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.108+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.108+0000 7f23ade5f640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:14.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.262+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.265+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:14.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.265+0000 7f23ace5d640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:14.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.265+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:14.266+0000 7f23ace5d640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:40:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 msgr2=0x7f238c009f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a806efe0 0x7f238c009f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 msgr2=0x7f238c015520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.110:3300/0 conn(0x7f238c013130 0x7f238c015520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 >> v1:172.21.15.57:6789/0 conn(0x7f238c006190 legacy=0x7f238c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c00e0e0 con 0x7f238c00d700 2023-10-16T19:40:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.455+0000 7f239effd640 1 -- 172.21.15.57:0/12044423 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a815cf60 con 0x7f238c00d250 2023-10-16T19:40:15.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.469+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.475+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 msgr2=0x7f238c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:15.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.475+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 msgr2=0x7f238c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:15.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.475+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:15.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.475+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:40:15.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.678+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.680+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 msgr2=0x7f238c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.680+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 msgr2=0x7f238c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.680+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:15.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:15.681+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:40:16.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:16.268+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:16.301+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 msgr2=0x7f238c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:40:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:16.301+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 msgr2=0x7f238c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:40:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:16.301+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:40:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:16.301+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:40:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.138+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> v2:172.21.15.57:3300/0 conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.248+0000 7f239ffff640 1 -- 172.21.15.57:0/12044423 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912502369 0 0) 0x7f238c00e0e0 con 0x7f238c00d700 2023-10-16T19:40:17.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.249+0000 7f239ffff640 1 -- 172.21.15.57:0/12044423 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2394003520 con 0x7f238c00d700 2023-10-16T19:40:17.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.264+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 >> v1:172.21.15.110:6789/0 conn(0x7f238c00d700 legacy=0x7f238c00e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.264+0000 7f23ad65e640 1 -- 172.21.15.57:0/12044423 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c00dbe0 con 0x7f238c00d250 2023-10-16T19:40:17.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.283+0000 7f23ad65e640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f238c00d250 0x7f238c005b00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f23a4000ea0 tx=0x7f23a402cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7386bd72d7e65afd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.402+0000 7f239ffff640 1 -- 172.21.15.57:0/12044423 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a402db10 con 0x7f238c00d250 2023-10-16T19:40:17.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.402+0000 7f239ffff640 1 -- 172.21.15.57:0/12044423 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4031070 con 0x7f238c00d250 2023-10-16T19:40:17.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.402+0000 7f239ffff640 1 -- 172.21.15.57:0/12044423 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4037400 con 0x7f238c00d250 2023-10-16T19:40:17.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.403+0000 7f23af8c2640 1 -- 172.21.15.57:0/12044423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f238c00d250 msgr2=0x7f238c005b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.403+0000 7f23af8c2640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f238c00d250 0x7f238c005b00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f23a4000ea0 tx=0x7f23a402cf60 comp rx=0 tx=0).stop 2023-10-16T19:40:17.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.403+0000 7f23ade5f640 1 -- 172.21.15.57:0/12044423 reap_dead start 2023-10-16T19:40:17.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.403+0000 7f23af8c2640 1 -- 172.21.15.57:0/12044423 shutdown_connections 2023-10-16T19:40:17.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.403+0000 7f23af8c2640 1 --2- 172.21.15.57:0/12044423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f238c00d250 0x7f238c005b00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.403+0000 7f23af8c2640 1 -- 172.21.15.57:0/12044423 >> 172.21.15.57:0/12044423 conn(0x7f23a806f940 msgr2=0x7f23a806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:17.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.404+0000 7f23af8c2640 1 -- 172.21.15.57:0/12044423 shutdown_connections 2023-10-16T19:40:17.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.404+0000 7f23af8c2640 1 -- 172.21.15.57:0/12044423 wait complete. 2023-10-16T19:40:17.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.408+0000 7f23af8c2640 1 Processor -- start 2023-10-16T19:40:17.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.408+0000 7f23af8c2640 1 -- start start 2023-10-16T19:40:17.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.411+0000 7f23af8c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c00d250 0x7f23a8159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.411+0000 7f23af8c2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 0x7f23a8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.411+0000 7f23af8c2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a8156120 0x7f23a81570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.411+0000 7f23af8c2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a8158260 con 0x7f23a8156120 2023-10-16T19:40:17.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.411+0000 7f23af8c2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80c34f0 con 0x7f238c00d250 2023-10-16T19:40:17.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.411+0000 7f23af8c2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a81eec70 con 0x7f23a814ec70 2023-10-16T19:40:17.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.414+0000 7f23ace5d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 0x7f23a8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.416+0000 7f23ace5d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 0x7f23a8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:57598/0 (socket says 172.21.15.57:57598) 2023-10-16T19:40:17.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.416+0000 7f23ace5d640 1 -- 172.21.15.57:0/1310733027 learned_addr learned my addr 172.21.15.57:0/1310733027 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:17.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.498+0000 7f23ade5f640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a8156120 0x7f23a81570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.533+0000 7f23ace5d640 1 -- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c00d250 msgr2=0x7f23a8159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.533+0000 7f23ace5d640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c00d250 0x7f23a8159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.533+0000 7f23ace5d640 1 -- 172.21.15.57:0/1310733027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a8156120 msgr2=0x7f23a81570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.533+0000 7f23ace5d640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a8156120 0x7f23a81570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.533+0000 7f23ace5d640 1 -- 172.21.15.57:0/1310733027 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80aeb10 con 0x7f23a814ec70 2023-10-16T19:40:17.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.560+0000 7f23ace5d640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 0x7f23a8155be0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2398007050 tx=0x7f239800a7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.657+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800be80 con 0x7f23a814ec70 2023-10-16T19:40:17.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.657+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398018420 con 0x7f23a814ec70 2023-10-16T19:40:17.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.657+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398018790 con 0x7f23a814ec70 2023-10-16T19:40:17.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.657+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a81ee360 con 0x7f23a814ec70 2023-10-16T19:40:17.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.658+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a814e710 con 0x7f23a814ec70 2023-10-16T19:40:17.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.660+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a8156500 con 0x7f23a814ec70 2023-10-16T19:40:17.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:17.980+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f23980216f0 con 0x7f23a814ec70 2023-10-16T19:40:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.001+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2398017b80 con 0x7f23a814ec70 2023-10-16T19:40:18.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.002+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2398017df0 con 0x7f23a814ec70 2023-10-16T19:40:18.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.108+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f23a80cbbe0 con 0x7f23a814ec70 2023-10-16T19:40:18.259 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:18.256+0000 7f2bed353040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T19:40:18.326 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:18.323+0000 7f2bed353040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T19:40:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.909+0000 7f239dffb640 1 -- 172.21.15.57:0/1310733027 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f23980188f0 con 0x7f23a814ec70 2023-10-16T19:40:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2023-10-16T19:40:18.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 msgr2=0x7f23a8155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 0x7f23a8155be0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2398007050 tx=0x7f239800a7b0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 shutdown_connections 2023-10-16T19:40:18.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a8156120 0x7f23a81570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23a814ec70 0x7f23a8155be0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 --2- 172.21.15.57:0/1310733027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c00d250 0x7f23a8159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 >> 172.21.15.57:0/1310733027 conn(0x7f23a806f940 msgr2=0x7f23a80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:18.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 shutdown_connections 2023-10-16T19:40:18.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:18.911+0000 7f23af8c2640 1 -- 172.21.15.57:0/1310733027 wait complete. 2023-10-16T19:40:18.937 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T19:40:18.938 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T19:40:18.938 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:40:18.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T19:40:19.030 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:40:19.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T19:40:19.073 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.070+0000 7f2bed353040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T19:40:19.118 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:40:19.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T19:40:19.139 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.136+0000 7f2bed353040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T19:40:19.193 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.190+0000 7f2bed353040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T19:40:19.198 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:19.196+0000 7fe26fa3a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T19:40:19.232 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:40:19.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T19:40:19.263 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:19.261+0000 7fe26fa3a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T19:40:19.264 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.261+0000 7f2bed353040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T19:40:19.316 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:40:19.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T19:40:19.321 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.318+0000 7f2bed353040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T19:40:19.396 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:40:19.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T19:40:19.440 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.438+0000 7f2bed353040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T19:40:19.524 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.521+0000 7f2bed353040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T19:40:19.530 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:40:19.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T19:40:19.579 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.577+0000 7f2bed353040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T19:40:19.615 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-10-16T19:40:19.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T19:40:19.642 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.640+0000 7f2bed353040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T19:40:19.699 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:19.697+0000 7f2bed353040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T19:40:19.748 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 762285c5-2ff8-4f45-b0f8-10b8e78586c6 0 2023-10-16T19:40:19.920 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:19.918+0000 7fe26fa3a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T19:40:19.942 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.940+0000 7f6ece5bd640 1 Processor -- start 2023-10-16T19:40:19.942 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.940+0000 7f6ece5bd640 1 -- start start 2023-10-16T19:40:19.944 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.942+0000 7f6ece5bd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ec8153250 0x7f6ec815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.945 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.942+0000 7f6ece5bd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ec80c6100 0x7f6ec80c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.945 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.942+0000 7f6ece5bd640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80ca260 con 0x7f6ec80ce630 2023-10-16T19:40:19.945 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.942+0000 7f6ece5bd640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec8153630 con 0x7f6ec80c6100 2023-10-16T19:40:19.946 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.942+0000 7f6ece5bd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80c9e50 con 0x7f6ec8153250 2023-10-16T19:40:19.946 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.942+0000 7f6ecd5bb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ec8153250 0x7f6ec815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.947 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.943+0000 7f6ecd5bb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ec8153250 0x7f6ec815cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53076/0 (socket says 172.21.15.110:53076) 2023-10-16T19:40:19.947 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.943+0000 7f6ecd5bb640 1 -- 172.21.15.110:0/3634711821 learned_addr learned my addr 172.21.15.110:0/3634711821 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:19.948 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.944+0000 7f6eccdba640 1 --2- 172.21.15.110:0/3634711821 >> v2:172.21.15.57:3300/0 conn(0x7f6ec80c6100 0x7f6ec80c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.949 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.946+0000 7f6ecd5bb640 1 -- 172.21.15.110:0/3634711821 >> v2:172.21.15.57:3300/0 conn(0x7f6ec80c6100 msgr2=0x7f6ec80c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:19.949 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.946+0000 7f6ecd5bb640 1 --2- 172.21.15.110:0/3634711821 >> v2:172.21.15.57:3300/0 conn(0x7f6ec80c6100 0x7f6ec80c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.950 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.946+0000 7f6ecd5bb640 1 -- 172.21.15.110:0/3634711821 >> v1:172.21.15.57:6789/0 conn(0x7f6ec80ce630 legacy=0x7f6ec8158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:19.950 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.946+0000 7f6ecd5bb640 1 -- 172.21.15.110:0/3634711821 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80c96a0 con 0x7f6ec8153250 2023-10-16T19:40:19.951 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.948+0000 7f6ecd5bb640 1 --2- 172.21.15.110:0/3634711821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815cdf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80cf3e0 tx=0x7f6ec402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0efcf4fbc7305d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.958 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.955+0000 7f6ebffff640 1 -- 172.21.15.110:0/3634711821 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4030860 con 0x7f6ec8153250 2023-10-16T19:40:19.958 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.955+0000 7f6ebffff640 1 -- 172.21.15.110:0/3634711821 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec40309c0 con 0x7f6ec8153250 2023-10-16T19:40:19.959 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.955+0000 7f6ebffff640 1 -- 172.21.15.110:0/3634711821 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4030d50 con 0x7f6ec8153250 2023-10-16T19:40:19.960 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.956+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3634711821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 msgr2=0x7f6ec815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.961 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.956+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3634711821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815cdf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80cf3e0 tx=0x7f6ec402b9a0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.961 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.957+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3634711821 shutdown_connections 2023-10-16T19:40:19.962 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.957+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3634711821 >> v2:172.21.15.57:3300/0 conn(0x7f6ec80c6100 0x7f6ec80c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.962 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.957+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3634711821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815cdf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.962 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.957+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3634711821 >> 172.21.15.110:0/3634711821 conn(0x7f6ec806c7a0 msgr2=0x7f6ec806a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:19.963 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.957+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3634711821 shutdown_connections 2023-10-16T19:40:19.963 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.957+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3634711821 wait complete. 2023-10-16T19:40:19.966 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.959+0000 7f6ece5bd640 1 Processor -- start 2023-10-16T19:40:19.966 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.960+0000 7f6ece5bd640 1 -- start start 2023-10-16T19:40:19.966 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.961+0000 7f6ece5bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80c6100 0x7f6ec815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.967 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.961+0000 7f6ece5bd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec80ce630 0x7f6ec80cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.967 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.961+0000 7f6ece5bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.967 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.961+0000 7f6ece5bd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8158440 con 0x7f6ec80ce630 2023-10-16T19:40:19.969 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.961+0000 7f6ece5bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8158860 con 0x7f6ec8153250 2023-10-16T19:40:19.970 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.961+0000 7f6ece5bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81f2710 con 0x7f6ec80c6100 2023-10-16T19:40:19.970 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.962+0000 7f6ecddbc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.970 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.962+0000 7f6ecd5bb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80c6100 0x7f6ec815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.971 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.962+0000 7f6ecd5bb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80c6100 0x7f6ec815cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50808/0 (socket says 172.21.15.110:50808) 2023-10-16T19:40:19.971 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.962+0000 7f6ecd5bb640 1 -- 172.21.15.110:0/3276065925 learned_addr learned my addr 172.21.15.110:0/3276065925 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:19.971 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.963+0000 7f6eccdba640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec80ce630 0x7f6ec80cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.973 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.968+0000 7f6ecddbc640 1 -- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80c6100 msgr2=0x7f6ec815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.973 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.968+0000 7f6ecddbc640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80c6100 0x7f6ec815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.973 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.968+0000 7f6ecddbc640 1 -- 172.21.15.110:0/3276065925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec80ce630 msgr2=0x7f6ec80cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.968+0000 7f6ecddbc640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec80ce630 0x7f6ec80cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.968+0000 7f6ecddbc640 1 -- 172.21.15.110:0/3276065925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40094d0 con 0x7f6ec8153250 2023-10-16T19:40:19.974 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.971+0000 7f6ecddbc640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815c250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c780 tx=0x7f6ec000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.978 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.976+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0003b70 con 0x7f6ec8153250 2023-10-16T19:40:19.979 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.976+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0003cf0 con 0x7f6ec8153250 2023-10-16T19:40:19.979 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.976+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec81f29d0 con 0x7f6ec8153250 2023-10-16T19:40:19.980 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.976+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0003ea0 con 0x7f6ec8153250 2023-10-16T19:40:19.980 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.976+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8157aa0 con 0x7f6ec8153250 2023-10-16T19:40:19.981 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.977+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec8158580 con 0x7f6ec8153250 2023-10-16T19:40:19.982 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.980+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ec00055b0 con 0x7f6ec8153250 2023-10-16T19:40:19.983 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:19.981+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ec001c7a0 con 0x7f6ec8153250 2023-10-16T19:40:19.991 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:19.989+0000 7fe26fa3a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T19:40:20.045 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.043+0000 7fe26fa3a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T19:40:20.111 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.109+0000 7fe26fa3a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T19:40:20.162 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.160+0000 7fe26fa3a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T19:40:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.169+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6ec8158580 con 0x7f6ec8153250 2023-10-16T19:40:20.174 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.171+0000 7f2bed353040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T19:40:20.261 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.259+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "762285c5-2ff8-4f45-b0f8-10b8e78586c6", "id": 0} v 0) v1 -- 0x7f6ec804e160 con 0x7f6ec8153250 2023-10-16T19:40:20.282 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.280+0000 7fe26fa3a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T19:40:20.343 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.341+0000 7f2bed353040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T19:40:20.364 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.362+0000 7fe26fa3a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T19:40:20.417 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.415+0000 7fe26fa3a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T19:40:20.476 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.474+0000 7fe26fa3a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T19:40:20.496 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.494+0000 7f2bed353040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T19:40:20.532 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:20.530+0000 7fe26fa3a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T19:40:20.553 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.551+0000 7f2bed353040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T19:40:20.672 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.670+0000 7f2bed353040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:40:20.677 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.676+0000 7f6ebdffb640 1 -- 172.21.15.110:0/3276065925 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "762285c5-2ff8-4f45-b0f8-10b8e78586c6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ec0017070 con 0x7f6ec8153250 2023-10-16T19:40:20.678 INFO:teuthology.orchestra.run.smithi110.stdout:0 2023-10-16T19:40:20.680 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 msgr2=0x7f6ec815c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.680 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815c250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c780 tx=0x7f6ec000cc40 comp rx=0 tx=0).stop 2023-10-16T19:40:20.681 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 shutdown_connections 2023-10-16T19:40:20.681 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec8153250 0x7f6ec815c250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.681 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec80ce630 0x7f6ec80cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.681 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 --2- 172.21.15.110:0/3276065925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80c6100 0x7f6ec815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.682 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 >> 172.21.15.110:0/3276065925 conn(0x7f6ec806c7a0 msgr2=0x7f6ec80c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.682 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 shutdown_connections 2023-10-16T19:40:20.682 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.678+0000 7f6ece5bd640 1 -- 172.21.15.110:0/3276065925 wait complete. 2023-10-16T19:40:20.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 539d76b4-ff06-4b6c-8227-e959fa0a0c32 1 2023-10-16T19:40:20.793 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.790+0000 7f2bed353040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T19:40:20.891 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.889+0000 7feb0271a640 1 Processor -- start 2023-10-16T19:40:20.891 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.889+0000 7feb0271a640 1 -- start start 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.890+0000 7feb0271a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc0c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.890+0000 7feb0271a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc0c60b0 con 0x7feafc0c4f40 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.890+0000 7feb0271a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc0c6350 con 0x7feafc150ea0 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.891+0000 7feb0271a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0c8e00 con 0x7feafc0c79e0 2023-10-16T19:40:20.894 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.891+0000 7feb00f17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc0c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.894 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.891+0000 7feb01718640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7feafc150ea0 0x7feafc0cbb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46810/0 (socket says 172.21.15.110:46810) 2023-10-16T19:40:20.894 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.891+0000 7feb01718640 1 -- 172.21.15.110:0/3832214431 learned_addr learned my addr 172.21.15.110:0/3832214431 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.894+0000 7feb00f17640 1 -- 172.21.15.110:0/3832214431 >> v1:172.21.15.110:6789/0 conn(0x7feafc150ea0 legacy=0x7feafc0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.894+0000 7feb00f17640 1 -- 172.21.15.110:0/3832214431 >> v1:172.21.15.57:6789/0 conn(0x7feafc0c4f40 legacy=0x7feafc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.894+0000 7feaf3fff640 1 -- 172.21.15.110:0/3832214431 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343311154 0 0) 0x7feafc0c6350 con 0x7feafc150ea0 2023-10-16T19:40:20.897 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.894+0000 7feb00f17640 1 -- 172.21.15.110:0/3832214431 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc06d7d0 con 0x7feafc0c79e0 2023-10-16T19:40:20.898 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.897+0000 7feb00f17640 1 --2- 172.21.15.110:0/3832214431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc0c4a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feaec0097d0 tx=0x7feaec02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28dc72059e12734d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feaf3fff640 1 -- 172.21.15.110:0/3832214431 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec031890 con 0x7feafc0c79e0 2023-10-16T19:40:20.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feaf3fff640 1 -- 172.21.15.110:0/3832214431 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec0319f0 con 0x7feafc0c79e0 2023-10-16T19:40:20.904 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feaf3fff640 1 -- 172.21.15.110:0/3832214431 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec031d80 con 0x7feafc0c79e0 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feb0271a640 1 -- 172.21.15.110:0/3832214431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 msgr2=0x7feafc0c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feb0271a640 1 --2- 172.21.15.110:0/3832214431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc0c4a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feaec0097d0 tx=0x7feaec02b930 comp rx=0 tx=0).stop 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feb0271a640 1 -- 172.21.15.110:0/3832214431 shutdown_connections 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feb0271a640 1 --2- 172.21.15.110:0/3832214431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc0c4a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.902+0000 7feb0271a640 1 -- 172.21.15.110:0/3832214431 >> 172.21.15.110:0/3832214431 conn(0x7feafc06e760 msgr2=0x7feafc06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.906 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.903+0000 7feb0271a640 1 -- 172.21.15.110:0/3832214431 shutdown_connections 2023-10-16T19:40:20.906 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.903+0000 7feb0271a640 1 -- 172.21.15.110:0/3832214431 wait complete. 2023-10-16T19:40:20.907 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.905+0000 7feb0271a640 1 Processor -- start 2023-10-16T19:40:20.907 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.905+0000 7feb0271a640 1 -- start start 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.906+0000 7feb0271a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feafc0c4f40 0x7feafc14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.906+0000 7feb0271a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc1ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.906+0000 7feb0271a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feafc150ea0 0x7feafc1eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.906+0000 7feb0271a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0c5350 con 0x7feafc150ea0 2023-10-16T19:40:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.906+0000 7feb0271a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc1e02b0 con 0x7feafc0c4f40 2023-10-16T19:40:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.906+0000 7feb0271a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0c4010 con 0x7feafc0c79e0 2023-10-16T19:40:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.907+0000 7feb00f17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc1ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.907+0000 7feb01718640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feafc0c4f40 0x7feafc14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.907+0000 7feb00f17640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc1ee850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50834/0 (socket says 172.21.15.110:50834) 2023-10-16T19:40:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.907+0000 7feb00f17640 1 -- 172.21.15.110:0/1169417348 learned_addr learned my addr 172.21.15.110:0/1169417348 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.908+0000 7feb01f19640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feafc150ea0 0x7feafc1eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.911+0000 7feb00f17640 1 -- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feafc0c4f40 msgr2=0x7feafc14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.911+0000 7feb00f17640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feafc0c4f40 0x7feafc14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.911+0000 7feb00f17640 1 -- 172.21.15.110:0/1169417348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feafc150ea0 msgr2=0x7feafc1eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.911+0000 7feb00f17640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feafc150ea0 0x7feafc1eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.911+0000 7feb00f17640 1 -- 172.21.15.110:0/1169417348 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec009400 con 0x7feafc0c79e0 2023-10-16T19:40:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.913+0000 7feb00f17640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc1ee850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feaec02bf40 tx=0x7feaec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.918 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.916+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec031830 con 0x7feafc0c79e0 2023-10-16T19:40:20.918 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.916+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc0c4530 con 0x7feafc0c79e0 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.917+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc1f27b0 con 0x7feafc0c79e0 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.918+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec046450 con 0x7feafc0c79e0 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.918+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0467c0 con 0x7feafc0c79e0 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.918+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc005250 con 0x7feafc0c79e0 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.922+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feaec046c20 con 0x7feafc0c79e0 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:20.922+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7feaec0303e0 con 0x7feafc0c79e0 2023-10-16T19:40:20.962 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:20.959+0000 7f2bed353040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:40:21.013 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:21.011+0000 7f2bed353040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T19:40:21.018 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.016+0000 7fe26fa3a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T19:40:21.029 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.027+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7feaec035020 con 0x7feafc0c79e0 2023-10-16T19:40:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.112+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "539d76b4-ff06-4b6c-8227-e959fa0a0c32", "id": 1} v 0) v1 -- 0x7feadc005870 con 0x7feafc0c79e0 2023-10-16T19:40:21.182 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:21.179+0000 7f2bed353040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T19:40:21.185 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.183+0000 7fe26fa3a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T19:40:21.332 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.330+0000 7fe26fa3a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T19:40:21.352 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.351+0000 7feaf1ffb640 1 -- 172.21.15.110:0/1169417348 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "539d76b4-ff06-4b6c-8227-e959fa0a0c32", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7feaec04f4c0 con 0x7feafc0c79e0 2023-10-16T19:40:21.353 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-10-16T19:40:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 msgr2=0x7feafc1ee850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc1ee850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feaec02bf40 tx=0x7feaec0046c0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 shutdown_connections 2023-10-16T19:40:21.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feafc150ea0 0x7feafc1eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feafc0c79e0 0x7feafc1ee850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 --2- 172.21.15.110:0/1169417348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feafc0c4f40 0x7feafc14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 >> 172.21.15.110:0/1169417348 conn(0x7feafc06e760 msgr2=0x7feafc06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.356 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 shutdown_connections 2023-10-16T19:40:21.357 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.353+0000 7feb0271a640 1 -- 172.21.15.110:0/1169417348 wait complete. 2023-10-16T19:40:21.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new e331ee7e-ff19-4310-8f8a-dfb08faca3b7 2 2023-10-16T19:40:21.389 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.388+0000 7fe26fa3a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T19:40:21.505 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.503+0000 7fe26fa3a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:40:21.562 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.560+0000 7fd7d0c47640 1 Processor -- start 2023-10-16T19:40:21.562 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.560+0000 7fd7d0c47640 1 -- start start 2023-10-16T19:40:21.563 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.561+0000 7fd7d0c47640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7cc0ce630 0x7fd7cc0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:21.563 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.561+0000 7fd7d0c47640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0ca260 con 0x7fd7cc0c6100 2023-10-16T19:40:21.563 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.561+0000 7fd7d0c47640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0c9e50 con 0x7fd7cc153250 2023-10-16T19:40:21.563 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.561+0000 7fd7d0c47640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc153630 con 0x7fd7cc0ce630 2023-10-16T19:40:21.564 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.562+0000 7fd7cbfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7cc0ce630 0x7fd7cc0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:21.564 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.562+0000 7fd7cb7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd7cc153250 0x7fd7cc15cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46814/0 (socket says 172.21.15.110:46814) 2023-10-16T19:40:21.564 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.563+0000 7fd7cb7fe640 1 -- 172.21.15.110:0/843758543 learned_addr learned my addr 172.21.15.110:0/843758543 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-16T19:40:21.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.566+0000 7fd7cbfff640 1 -- 172.21.15.110:0/843758543 >> v1:172.21.15.110:6789/0 conn(0x7fd7cc153250 legacy=0x7fd7cc15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.566+0000 7fd7cbfff640 1 -- 172.21.15.110:0/843758543 >> v1:172.21.15.57:6789/0 conn(0x7fd7cc0c6100 legacy=0x7fd7cc0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.566+0000 7fd7cbfff640 1 -- 172.21.15.110:0/843758543 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0c96a0 con 0x7fd7cc0ce630 2023-10-16T19:40:21.577 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.576+0000 7fd7cbfff640 1 --2- 172.21.15.110:0/843758543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc0cea60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009d90 tx=0x7fd7c402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47a56bd65c00fdf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:21.582 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.580+0000 7fd7caffd640 1 -- 172.21.15.110:0/843758543 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c402cd80 con 0x7fd7cc0ce630 2023-10-16T19:40:21.586 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.584+0000 7fd7caffd640 1 -- 172.21.15.110:0/843758543 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4034440 con 0x7fd7cc0ce630 2023-10-16T19:40:21.586 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.584+0000 7fd7caffd640 1 -- 172.21.15.110:0/843758543 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40347d0 con 0x7fd7cc0ce630 2023-10-16T19:40:21.587 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.585+0000 7fd7d0c47640 1 -- 172.21.15.110:0/843758543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc0ce630 msgr2=0x7fd7cc0cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.585+0000 7fd7d0c47640 1 --2- 172.21.15.110:0/843758543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc0cea60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009d90 tx=0x7fd7c402bfd0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.585+0000 7fd7d0c47640 1 -- 172.21.15.110:0/843758543 shutdown_connections 2023-10-16T19:40:21.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.585+0000 7fd7d0c47640 1 --2- 172.21.15.110:0/843758543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc0cea60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.585+0000 7fd7d0c47640 1 -- 172.21.15.110:0/843758543 >> 172.21.15.110:0/843758543 conn(0x7fd7cc06c7a0 msgr2=0x7fd7cc06a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.588 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.585+0000 7fd7d0c47640 1 -- 172.21.15.110:0/843758543 shutdown_connections 2023-10-16T19:40:21.589 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.586+0000 7fd7d0c47640 1 -- 172.21.15.110:0/843758543 wait complete. 2023-10-16T19:40:21.589 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.588+0000 7fd7d0c47640 1 Processor -- start 2023-10-16T19:40:21.589 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.588+0000 7fd7d0c47640 1 -- start start 2023-10-16T19:40:21.590 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7d0c47640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc0c6100 0x7fd7cc153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:21.591 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7d0c47640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc1f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:21.591 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7d0c47640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc153250 0x7fd7cc1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:21.591 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7d0c47640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc158090 con 0x7fd7cc0ce630 2023-10-16T19:40:21.591 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7d0c47640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc150e50 con 0x7fd7cc153250 2023-10-16T19:40:21.592 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7d0c47640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1f21c0 con 0x7fd7cc0c6100 2023-10-16T19:40:21.592 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.590+0000 7fd7cbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc153250 0x7fd7cc1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:21.593 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.589+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc0c6100 0x7fd7cc153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:21.593 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.590+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc0c6100 0x7fd7cc153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50848/0 (socket says 172.21.15.110:50848) 2023-10-16T19:40:21.593 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.590+0000 7fd7cb7fe640 1 -- 172.21.15.110:0/1965930256 learned_addr learned my addr 172.21.15.110:0/1965930256 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:21.593 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.591+0000 7fd7c3fff640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc1f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:21.595 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.594+0000 7fd7cbfff640 1 -- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc0c6100 msgr2=0x7fd7cc153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.596 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.594+0000 7fd7cbfff640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc0c6100 0x7fd7cc153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.596 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.594+0000 7fd7cbfff640 1 -- 172.21.15.110:0/1965930256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7cc0ce630 msgr2=0x7fd7cc1f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.596 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.594+0000 7fd7cbfff640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc1f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.596 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.594+0000 7fd7cbfff640 1 -- 172.21.15.110:0/1965930256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4009a70 con 0x7fd7cc153250 2023-10-16T19:40:21.598 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.596+0000 7fd7cbfff640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc153250 0x7fd7cc1521d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4033000 tx=0x7fd7c4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:21.602 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.600+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4040650 con 0x7fd7cc153250 2023-10-16T19:40:21.602 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.600+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40407b0 con 0x7fd7cc153250 2023-10-16T19:40:21.602 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.600+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4040b60 con 0x7fd7cc153250 2023-10-16T19:40:21.603 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.600+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc154510 con 0x7fd7cc153250 2023-10-16T19:40:21.603 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.600+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc1547d0 con 0x7fd7cc153250 2023-10-16T19:40:21.603 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.602+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc066e00 con 0x7fd7cc153250 2023-10-16T19:40:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.604+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd7c4052430 con 0x7fd7cc153250 2023-10-16T19:40:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.604+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd7c403e820 con 0x7fd7cc153250 2023-10-16T19:40:21.624 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.623+0000 7fe26fa3a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T19:40:21.729 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.728+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd7c4044020 con 0x7fd7cc153250 2023-10-16T19:40:21.792 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.791+0000 7fe26fa3a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:40:21.815 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:21.812+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e331ee7e-ff19-4310-8f8a-dfb08faca3b7", "id": 2} v 0) v1 -- 0x7fd7cc04e160 con 0x7fd7cc153250 2023-10-16T19:40:21.846 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:21.845+0000 7fe26fa3a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T19:40:22.014 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:22.011+0000 7fe26fa3a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T19:40:22.220 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.218+0000 7fd7c8ff9640 1 -- 172.21.15.110:0/1965930256 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e331ee7e-ff19-4310-8f8a-dfb08faca3b7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd7c4039070 con 0x7fd7cc153250 2023-10-16T19:40:22.221 INFO:teuthology.orchestra.run.smithi110.stdout:2 2023-10-16T19:40:22.222 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc153250 msgr2=0x7fd7cc1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.222 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc153250 0x7fd7cc1521d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4033000 tx=0x7fd7c4004a40 comp rx=0 tx=0).stop 2023-10-16T19:40:22.222 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 shutdown_connections 2023-10-16T19:40:22.222 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc153250 0x7fd7cc1521d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.223 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7cc0ce630 0x7fd7cc1f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.223 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 --2- 172.21.15.110:0/1965930256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc0c6100 0x7fd7cc153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.223 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 >> 172.21.15.110:0/1965930256 conn(0x7fd7cc06c7a0 msgr2=0x7fd7cc151650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.223 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 shutdown_connections 2023-10-16T19:40:22.223 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.220+0000 7fd7d0c47640 1 -- 172.21.15.110:0/1965930256 wait complete. 2023-10-16T19:40:22.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 984d0dec-e008-4711-b7ac-72ced09a9125 3 2023-10-16T19:40:22.304 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:22.301+0000 7f2bed353040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T19:40:22.485 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.483+0000 7faa413d7640 1 Processor -- start 2023-10-16T19:40:22.486 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.484+0000 7faa413d7640 1 -- start start 2023-10-16T19:40:22.487 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.485+0000 7faa413d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 0x7faa3c0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.487 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.485+0000 7faa413d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa3c0c5ee0 0x7faa3c159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.487 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.485+0000 7faa413d7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa3c159540 0x7faa3c0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.487 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.485+0000 7faa413d7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c0cab20 con 0x7faa3c159540 2023-10-16T19:40:22.488 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.485+0000 7faa413d7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c0cae00 con 0x7faa3c0c5ee0 2023-10-16T19:40:22.488 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.485+0000 7faa413d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c15c610 con 0x7faa3c1532b0 2023-10-16T19:40:22.489 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.486+0000 7faa3bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 0x7faa3c0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.490 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.486+0000 7faa33fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa3c0c5ee0 0x7faa3c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.490 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.486+0000 7faa3bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 0x7faa3c0ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50858/0 (socket says 172.21.15.110:50858) 2023-10-16T19:40:22.490 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.486+0000 7faa3bfff640 1 -- 172.21.15.110:0/2282489183 learned_addr learned my addr 172.21.15.110:0/2282489183 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:22.490 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.486+0000 7faa40bd6640 1 --2- 172.21.15.110:0/2282489183 >> v2:172.21.15.57:3300/0 conn(0x7faa3c159540 0x7faa3c0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.491 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.489+0000 7faa3bfff640 1 -- 172.21.15.110:0/2282489183 >> v2:172.21.15.110:3300/0 conn(0x7faa3c0c5ee0 msgr2=0x7faa3c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.491 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.489+0000 7faa3bfff640 1 --2- 172.21.15.110:0/2282489183 >> v2:172.21.15.110:3300/0 conn(0x7faa3c0c5ee0 0x7faa3c159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.491 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.489+0000 7faa3bfff640 1 -- 172.21.15.110:0/2282489183 >> v2:172.21.15.57:3300/0 conn(0x7faa3c159540 msgr2=0x7faa3c0ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.492 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.489+0000 7faa3bfff640 1 --2- 172.21.15.110:0/2282489183 >> v2:172.21.15.57:3300/0 conn(0x7faa3c159540 0x7faa3c0ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.492 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.489+0000 7faa3bfff640 1 -- 172.21.15.110:0/2282489183 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c15c8f0 con 0x7faa3c1532b0 2023-10-16T19:40:22.492 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.491+0000 7faa3bfff640 1 --2- 172.21.15.110:0/2282489183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 0x7faa3c0ca270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa3c06b0a0 tx=0x7faa2c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58de36e7e655f8d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.495 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.493+0000 7faa3b7fe640 1 -- 172.21.15.110:0/2282489183 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c031870 con 0x7faa3c1532b0 2023-10-16T19:40:22.496 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.495+0000 7faa3b7fe640 1 -- 172.21.15.110:0/2282489183 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c0319d0 con 0x7faa3c1532b0 2023-10-16T19:40:22.497 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.495+0000 7faa3b7fe640 1 -- 172.21.15.110:0/2282489183 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c031d60 con 0x7faa3c1532b0 2023-10-16T19:40:22.498 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 -- 172.21.15.110:0/2282489183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 msgr2=0x7faa3c0ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.499 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 --2- 172.21.15.110:0/2282489183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 0x7faa3c0ca270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa3c06b0a0 tx=0x7faa2c02b910 comp rx=0 tx=0).stop 2023-10-16T19:40:22.499 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 -- 172.21.15.110:0/2282489183 shutdown_connections 2023-10-16T19:40:22.499 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 --2- 172.21.15.110:0/2282489183 >> v2:172.21.15.110:3300/0 conn(0x7faa3c0c5ee0 0x7faa3c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 --2- 172.21.15.110:0/2282489183 >> v2:172.21.15.57:3300/0 conn(0x7faa3c159540 0x7faa3c0ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 --2- 172.21.15.110:0/2282489183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c1532b0 0x7faa3c0ca270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 -- 172.21.15.110:0/2282489183 >> 172.21.15.110:0/2282489183 conn(0x7faa3c06c7d0 msgr2=0x7faa3c06a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.501 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 -- 172.21.15.110:0/2282489183 shutdown_connections 2023-10-16T19:40:22.501 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.496+0000 7faa413d7640 1 -- 172.21.15.110:0/2282489183 wait complete. 2023-10-16T19:40:22.504 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.499+0000 7faa413d7640 1 Processor -- start 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.499+0000 7faa413d7640 1 -- start start 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.500+0000 7faa413d7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa3c0c5ee0 0x7faa3c151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.500+0000 7faa413d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa3c1532b0 0x7faa3c1edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.500+0000 7faa413d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 0x7faa3c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.500+0000 7faa413d7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0c28a0 con 0x7faa3c0c5ee0 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.500+0000 7faa413d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c149e80 con 0x7faa3c1532b0 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.500+0000 7faa413d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c14af80 con 0x7faa3c159540 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.501+0000 7faa40bd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 0x7faa3c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.502+0000 7faa33fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa3c1532b0 0x7faa3c1edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.502+0000 7faa40bd6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 0x7faa3c0c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50872/0 (socket says 172.21.15.110:50872) 2023-10-16T19:40:22.508 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.502+0000 7faa40bd6640 1 -- 172.21.15.110:0/2707068911 learned_addr learned my addr 172.21.15.110:0/2707068911 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:22.508 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.502+0000 7faa3bfff640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa3c0c5ee0 0x7faa3c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.505+0000 7faa40bd6640 1 -- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa3c1532b0 msgr2=0x7faa3c1edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.505+0000 7faa40bd6640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa3c1532b0 0x7faa3c1edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.506+0000 7faa40bd6640 1 -- 172.21.15.110:0/2707068911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa3c0c5ee0 msgr2=0x7faa3c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.506+0000 7faa40bd6640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa3c0c5ee0 0x7faa3c151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.506+0000 7faa40bd6640 1 -- 172.21.15.110:0/2707068911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0094d0 con 0x7faa3c159540 2023-10-16T19:40:22.510 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.508+0000 7faa40bd6640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 0x7faa3c0c1490 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa34007d80 tx=0x7faa3400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.514 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.512+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34014420 con 0x7faa3c159540 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.512+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34014580 con 0x7faa3c159540 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.512+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34014930 con 0x7faa3c159540 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.513+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3c149570 con 0x7faa3c159540 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.513+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c1497c0 con 0x7faa3c159540 2023-10-16T19:40:22.516 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.514+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c149fc0 con 0x7faa3c159540 2023-10-16T19:40:22.518 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.517+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa3401e460 con 0x7faa3c159540 2023-10-16T19:40:22.519 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.517+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7faa340288c0 con 0x7faa3c159540 2023-10-16T19:40:22.625 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:22.623+0000 7f2bed353040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T19:40:22.640 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.639+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7faa3c149fc0 con 0x7faa3c159540 2023-10-16T19:40:22.687 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:22.685+0000 7f2bed353040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T19:40:22.751 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:22.749+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "984d0dec-e008-4711-b7ac-72ced09a9125", "id": 3} v 0) v1 -- 0x7faa3c04e160 con 0x7faa3c159540 2023-10-16T19:40:22.807 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:22.804+0000 7f2bed353040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T19:40:23.117 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:23.115+0000 7fe26fa3a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T19:40:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.121+0000 7faa397fa640 1 -- 172.21.15.110:0/2707068911 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "984d0dec-e008-4711-b7ac-72ced09a9125", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa34028490 con 0x7faa3c159540 2023-10-16T19:40:23.123 INFO:teuthology.orchestra.run.smithi110.stdout:3 2023-10-16T19:40:23.125 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 msgr2=0x7faa3c0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.125 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 0x7faa3c0c1490 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa34007d80 tx=0x7faa3400e4b0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.125 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 shutdown_connections 2023-10-16T19:40:23.125 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa3c159540 0x7faa3c0c1490 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.126 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa3c1532b0 0x7faa3c1edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.126 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 --2- 172.21.15.110:0/2707068911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa3c0c5ee0 0x7faa3c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.126 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.123+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 >> 172.21.15.110:0/2707068911 conn(0x7faa3c06c7d0 msgr2=0x7faa3c1509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.127 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.124+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 shutdown_connections 2023-10-16T19:40:23.127 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.124+0000 7faa413d7640 1 -- 172.21.15.110:0/2707068911 wait complete. 2023-10-16T19:40:23.147 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new c17b04f5-36fe-4505-be9c-dbacbdb01376 4 2023-10-16T19:40:23.381 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.379+0000 7fe8a4ca3640 1 Processor -- start 2023-10-16T19:40:23.381 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.379+0000 7fe8a4ca3640 1 -- start start 2023-10-16T19:40:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.380+0000 7fe8a4ca3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8a0153250 0x7fe8a015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.380+0000 7fe8a4ca3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 0x7fe8a00c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.380+0000 7fe8a4ca3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00ca260 con 0x7fe8a00ce630 2023-10-16T19:40:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.380+0000 7fe8a4ca3640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a0153630 con 0x7fe8a0153250 2023-10-16T19:40:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.380+0000 7fe8a4ca3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00c9e50 con 0x7fe8a00c6100 2023-10-16T19:40:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.381+0000 7fe89effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 0x7fe8a00c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.381+0000 7fe89effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 0x7fe8a00c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50880/0 (socket says 172.21.15.110:50880) 2023-10-16T19:40:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.381+0000 7fe89effd640 1 -- 172.21.15.110:0/1689555515 learned_addr learned my addr 172.21.15.110:0/1689555515 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:23.385 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.383+0000 7fe89effd640 1 -- 172.21.15.110:0/1689555515 >> v2:172.21.15.57:3300/0 conn(0x7fe8a0153250 msgr2=0x7fe8a015cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:23.385 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.383+0000 7fe89effd640 1 --2- 172.21.15.110:0/1689555515 >> v2:172.21.15.57:3300/0 conn(0x7fe8a0153250 0x7fe8a015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.383+0000 7fe89effd640 1 -- 172.21.15.110:0/1689555515 >> v1:172.21.15.57:6789/0 conn(0x7fe8a00ce630 legacy=0x7fe8a0158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.383+0000 7fe89effd640 1 -- 172.21.15.110:0/1689555515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00c96a0 con 0x7fe8a00c6100 2023-10-16T19:40:23.388 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.386+0000 7fe89effd640 1 --2- 172.21.15.110:0/1689555515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 0x7fe8a00c66e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794961361bf6c1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.390 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.388+0000 7fe89e7fc640 1 -- 172.21.15.110:0/1689555515 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894030840 con 0x7fe8a00c6100 2023-10-16T19:40:23.391 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.390+0000 7fe89e7fc640 1 -- 172.21.15.110:0/1689555515 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8940309a0 con 0x7fe8a00c6100 2023-10-16T19:40:23.391 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.390+0000 7fe89e7fc640 1 -- 172.21.15.110:0/1689555515 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894030d30 con 0x7fe8a00c6100 2023-10-16T19:40:23.393 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/1689555515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 msgr2=0x7fe8a00c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.393 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/1689555515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 0x7fe8a00c66e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402b980 comp rx=0 tx=0).stop 2023-10-16T19:40:23.393 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/1689555515 shutdown_connections 2023-10-16T19:40:23.393 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/1689555515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00c6100 0x7fe8a00c66e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.394 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/1689555515 >> v2:172.21.15.57:3300/0 conn(0x7fe8a0153250 0x7fe8a015cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.394 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/1689555515 >> 172.21.15.110:0/1689555515 conn(0x7fe8a006c7a0 msgr2=0x7fe8a006a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.394 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/1689555515 shutdown_connections 2023-10-16T19:40:23.394 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.391+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/1689555515 wait complete. 2023-10-16T19:40:23.395 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.394+0000 7fe8a4ca3640 1 Processor -- start 2023-10-16T19:40:23.396 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.394+0000 7fe8a4ca3640 1 -- start start 2023-10-16T19:40:23.397 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.395+0000 7fe8a4ca3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a00c6100 0x7fe8a00c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.398 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.395+0000 7fe8a4ca3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 0x7fe8a0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.398 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.395+0000 7fe8a4ca3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a0153250 0x7fe8a015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.398 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.395+0000 7fe8a4ca3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00c1f90 con 0x7fe8a0153250 2023-10-16T19:40:23.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.395+0000 7fe8a4ca3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00c2330 con 0x7fe8a00c6100 2023-10-16T19:40:23.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.396+0000 7fe8a4ca3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00c25f0 con 0x7fe8a00ce630 2023-10-16T19:40:23.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.396+0000 7fe89effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 0x7fe8a0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.400 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.396+0000 7fe89effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 0x7fe8a0151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50882/0 (socket says 172.21.15.110:50882) 2023-10-16T19:40:23.400 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.396+0000 7fe89effd640 1 -- 172.21.15.110:0/4222622340 learned_addr learned my addr 172.21.15.110:0/4222622340 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:23.402 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.400+0000 7fe89effd640 1 -- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a00c6100 msgr2=0x7fe8a00c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.402 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.400+0000 7fe89effd640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a00c6100 0x7fe8a00c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.402 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.400+0000 7fe89effd640 1 -- 172.21.15.110:0/4222622340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a0153250 msgr2=0x7fe8a015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.403 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.400+0000 7fe89effd640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a0153250 0x7fe8a015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.403 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.400+0000 7fe89effd640 1 -- 172.21.15.110:0/4222622340 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940094d0 con 0x7fe8a00ce630 2023-10-16T19:40:23.407 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.406+0000 7fe89effd640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 0x7fe8a0151e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe894004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.411+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894039d60 con 0x7fe8a00ce630 2023-10-16T19:40:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.411+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894043400 con 0x7fe8a00ce630 2023-10-16T19:40:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.411+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940437b0 con 0x7fe8a00ce630 2023-10-16T19:40:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.411+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00c4030 con 0x7fe8a00ce630 2023-10-16T19:40:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.411+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a00c45f0 con 0x7fe8a00ce630 2023-10-16T19:40:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.413+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a004e160 con 0x7fe8a00ce630 2023-10-16T19:40:23.432 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.430+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7fe894043910 con 0x7fe8a00ce630 2023-10-16T19:40:23.433 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.431+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe89403e070 con 0x7fe8a00ce630 2023-10-16T19:40:23.470 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:23.468+0000 7fe26fa3a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T19:40:23.532 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:23.530+0000 7fe26fa3a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T19:40:23.552 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.550+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe894057430 con 0x7fe8a00ce630 2023-10-16T19:40:23.633 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.631+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c17b04f5-36fe-4505-be9c-dbacbdb01376", "id": 4} v 0) v1 -- 0x7fe8a015a000 con 0x7fe8a00ce630 2023-10-16T19:40:23.659 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-10-16T19:40:23.658+0000 7fe26fa3a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T19:40:23.988 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.986+0000 7fe887fff640 1 -- 172.21.15.110:0/4222622340 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c17b04f5-36fe-4505-be9c-dbacbdb01376", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe894034020 con 0x7fe8a00ce630 2023-10-16T19:40:23.989 INFO:teuthology.orchestra.run.smithi110.stdout:4 2023-10-16T19:40:23.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 msgr2=0x7fe8a0151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 0x7fe8a0151e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe894004730 comp rx=0 tx=0).stop 2023-10-16T19:40:23.990 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 shutdown_connections 2023-10-16T19:40:23.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a0153250 0x7fe8a015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8a00ce630 0x7fe8a0151e10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 --2- 172.21.15.110:0/4222622340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a00c6100 0x7fe8a00c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 >> 172.21.15.110:0/4222622340 conn(0x7fe8a006c7a0 msgr2=0x7fe8a00c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 shutdown_connections 2023-10-16T19:40:23.991 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:23.988+0000 7fe8a4ca3640 1 -- 172.21.15.110:0/4222622340 wait complete. 2023-10-16T19:40:24.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 3552ebce-4b2a-4228-bc88-d9a72abf1994 5 2023-10-16T19:40:24.214 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.212+0000 7fd97fd25640 1 Processor -- start 2023-10-16T19:40:24.214 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.212+0000 7fd97fd25640 1 -- start start 2023-10-16T19:40:24.216 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.214+0000 7fd97fd25640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9780c40b0 0x7fd978155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.216 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.214+0000 7fd97fd25640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd978156000 con 0x7fd97814fd00 2023-10-16T19:40:24.216 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.214+0000 7fd97fd25640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9780c5af0 con 0x7fd9780c5620 2023-10-16T19:40:24.216 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.214+0000 7fd97fd25640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9780c5dd0 con 0x7fd9780c40b0 2023-10-16T19:40:24.217 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.215+0000 7fd97e2c2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9780c40b0 0x7fd978155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.217 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.215+0000 7fd97d2c0640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd9780c5620 0x7fd978069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46822/0 (socket says 172.21.15.110:46822) 2023-10-16T19:40:24.217 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.215+0000 7fd97d2c0640 1 -- 172.21.15.110:0/4222381230 learned_addr learned my addr 172.21.15.110:0/4222381230 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-16T19:40:24.221 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.219+0000 7fd97e2c2640 1 -- 172.21.15.110:0/4222381230 >> v1:172.21.15.110:6789/0 conn(0x7fd9780c5620 legacy=0x7fd978069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.221 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.219+0000 7fd97e2c2640 1 -- 172.21.15.110:0/4222381230 >> v1:172.21.15.57:6789/0 conn(0x7fd97814fd00 legacy=0x7fd9780c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:24.221 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.219+0000 7fd97e2c2640 1 -- 172.21.15.110:0/4222381230 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780c60b0 con 0x7fd9780c40b0 2023-10-16T19:40:24.228 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.227+0000 7fd97e2c2640 1 --2- 172.21.15.110:0/4222381230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9780c40b0 0x7fd978155ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd970009d90 tx=0x7fd97002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a478b6f050846745 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.233 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.231+0000 7fd97cabf640 1 -- 172.21.15.110:0/4222381230 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97002ccf0 con 0x7fd9780c40b0 2023-10-16T19:40:24.233 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.231+0000 7fd97cabf640 1 -- 172.21.15.110:0/4222381230 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97002ce50 con 0x7fd9780c40b0 2023-10-16T19:40:24.233 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.231+0000 7fd97cabf640 1 -- 172.21.15.110:0/4222381230 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970034660 con 0x7fd9780c40b0 2023-10-16T19:40:24.234 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 -- 172.21.15.110:0/4222381230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9780c40b0 msgr2=0x7fd978155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.234 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 --2- 172.21.15.110:0/4222381230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9780c40b0 0x7fd978155ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd970009d90 tx=0x7fd97002bf40 comp rx=0 tx=0).stop 2023-10-16T19:40:24.235 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 -- 172.21.15.110:0/4222381230 shutdown_connections 2023-10-16T19:40:24.235 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 --2- 172.21.15.110:0/4222381230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9780c40b0 0x7fd978155ac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.235 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 -- 172.21.15.110:0/4222381230 >> 172.21.15.110:0/4222381230 conn(0x7fd9780c6ea0 msgr2=0x7fd9780c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.235 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 -- 172.21.15.110:0/4222381230 shutdown_connections 2023-10-16T19:40:24.235 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.232+0000 7fd97fd25640 1 -- 172.21.15.110:0/4222381230 wait complete. 2023-10-16T19:40:24.236 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.234+0000 7fd97fd25640 1 Processor -- start 2023-10-16T19:40:24.236 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.235+0000 7fd97fd25640 1 -- start start 2023-10-16T19:40:24.237 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97fd25640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9780c40b0 0x7fd978148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.238 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97fd25640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9780c5620 0x7fd978154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.238 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97fd25640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 0x7fd97806d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.238 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97fd25640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9781ee830 con 0x7fd9780c40b0 2023-10-16T19:40:24.238 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97fd25640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd978149450 con 0x7fd97814fd00 2023-10-16T19:40:24.239 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97fd25640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd978153c90 con 0x7fd9780c5620 2023-10-16T19:40:24.239 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97d2c0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9780c5620 0x7fd978154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.239 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.236+0000 7fd97e2c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 0x7fd97806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.240 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.237+0000 7fd97e2c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 0x7fd97806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53152/0 (socket says 172.21.15.110:53152) 2023-10-16T19:40:24.240 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.237+0000 7fd97e2c2640 1 -- 172.21.15.110:0/3606845076 learned_addr learned my addr 172.21.15.110:0/3606845076 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:24.242 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.240+0000 7fd97e2c2640 1 -- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9780c5620 msgr2=0x7fd978154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.242 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.240+0000 7fd97e2c2640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9780c5620 0x7fd978154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.242 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.240+0000 7fd97e2c2640 1 -- 172.21.15.110:0/3606845076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9780c40b0 msgr2=0x7fd978148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.243 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.240+0000 7fd97e2c2640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9780c40b0 0x7fd978148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.243 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.240+0000 7fd97e2c2640 1 -- 172.21.15.110:0/3606845076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009a70 con 0x7fd97814fd00 2023-10-16T19:40:24.243 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.240+0000 7fd97d2c0640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9780c5620 0x7fd978154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:24.245 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.243+0000 7fd97e2c2640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 0x7fd97806d060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd970009d90 tx=0x7fd970004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.249 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.247+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97003f680 con 0x7fd97814fd00 2023-10-16T19:40:24.249 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.247+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97003f7e0 con 0x7fd97814fd00 2023-10-16T19:40:24.250 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.247+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97003fb90 con 0x7fd97814fd00 2023-10-16T19:40:24.250 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.247+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd978153f70 con 0x7fd97814fd00 2023-10-16T19:40:24.250 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.248+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9781ee4c0 con 0x7fd97814fd00 2023-10-16T19:40:24.250 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.249+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9781ee650 con 0x7fd97814fd00 2023-10-16T19:40:24.260 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.259+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7fd97003b040 con 0x7fd97814fd00 2023-10-16T19:40:24.262 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.260+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd97003c770 con 0x7fd97814fd00 2023-10-16T19:40:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.376+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd97003fcf0 con 0x7fd97814fd00 2023-10-16T19:40:24.465 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:24.463+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3552ebce-4b2a-4228-bc88-d9a72abf1994", "id": 5} v 0) v1 -- 0x7fd9780c3860 con 0x7fd97814fd00 2023-10-16T19:40:25.441 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.439+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 3) v1 ==== 88940+0+0 (secure 0 0 0) 0x7fd970054480 con 0x7fd97814fd00 2023-10-16T19:40:25.912 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.910+0000 7fd96e7fc640 1 -- 172.21.15.110:0/3606845076 <== mon.1 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3552ebce-4b2a-4228-bc88-d9a72abf1994", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd970065510 con 0x7fd97814fd00 2023-10-16T19:40:25.912 INFO:teuthology.orchestra.run.smithi110.stdout:5 2023-10-16T19:40:25.914 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 msgr2=0x7fd97806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.914 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 0x7fd97806d060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd970009d90 tx=0x7fd970004a40 comp rx=0 tx=0).stop 2023-10-16T19:40:25.914 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 shutdown_connections 2023-10-16T19:40:25.914 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97814fd00 0x7fd97806d060 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.915 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9780c5620 0x7fd978154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.915 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 --2- 172.21.15.110:0/3606845076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9780c40b0 0x7fd978148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.915 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 >> 172.21.15.110:0/3606845076 conn(0x7fd9780c6ea0 msgr2=0x7fd9780c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:25.915 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 shutdown_connections 2023-10-16T19:40:25.916 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:25.912+0000 7fd97fd25640 1 -- 172.21.15.110:0/3606845076 wait complete. 2023-10-16T19:40:25.934 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new bce9b4db-90e0-44b0-942a-66d8019dd00b 6 2023-10-16T19:40:26.130 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.128+0000 7f54f12c2640 1 Processor -- start 2023-10-16T19:40:26.131 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.129+0000 7f54f12c2640 1 -- start start 2023-10-16T19:40:26.132 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.130+0000 7f54f12c2640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54ec070e50 0x7f54ec14f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.130+0000 7f54f12c2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.131+0000 7f54f12c2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec06dcf0 con 0x7f54ec155d40 2023-10-16T19:40:26.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.131+0000 7f54f12c2640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec06a4f0 con 0x7f54ec070e50 2023-10-16T19:40:26.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.131+0000 7f54f12c2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec06df40 con 0x7f54ec0c53b0 2023-10-16T19:40:26.144 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.142+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.144 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.143+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50898/0 (socket says 172.21.15.110:50898) 2023-10-16T19:40:26.145 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.143+0000 7f54eb7fe640 1 -- 172.21.15.110:0/1127142436 learned_addr learned my addr 172.21.15.110:0/1127142436 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:26.148 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.146+0000 7f54eb7fe640 1 -- 172.21.15.110:0/1127142436 >> v2:172.21.15.57:3300/0 conn(0x7f54ec070e50 msgr2=0x7f54ec14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:26.149 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.147+0000 7f54eb7fe640 1 --2- 172.21.15.110:0/1127142436 >> v2:172.21.15.57:3300/0 conn(0x7f54ec070e50 0x7f54ec14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.149 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.147+0000 7f54eb7fe640 1 -- 172.21.15.110:0/1127142436 >> v1:172.21.15.110:6789/0 conn(0x7f54ec155d40 legacy=0x7f54ec069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:26.149 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.147+0000 7f54eb7fe640 1 -- 172.21.15.110:0/1127142436 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec06e220 con 0x7f54ec0c53b0 2023-10-16T19:40:26.152 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.151+0000 7f54eb7fe640 1 --2- 172.21.15.110:0/1127142436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec06d060 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009e50 tx=0x7f54e402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba524ef3fa3fc36 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.159 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.158+0000 7f54ea7fc640 1 -- 172.21.15.110:0/1127142436 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e402cb00 con 0x7f54ec0c53b0 2023-10-16T19:40:26.160 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.158+0000 7f54ea7fc640 1 -- 172.21.15.110:0/1127142436 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e402cc60 con 0x7f54ec0c53b0 2023-10-16T19:40:26.160 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.158+0000 7f54ea7fc640 1 -- 172.21.15.110:0/1127142436 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40343f0 con 0x7f54ec0c53b0 2023-10-16T19:40:26.160 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 -- 172.21.15.110:0/1127142436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 msgr2=0x7f54ec06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.161 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1127142436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec06d060 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009e50 tx=0x7f54e402bf60 comp rx=0 tx=0).stop 2023-10-16T19:40:26.161 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 -- 172.21.15.110:0/1127142436 shutdown_connections 2023-10-16T19:40:26.162 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1127142436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec06d060 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.162 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1127142436 >> v2:172.21.15.57:3300/0 conn(0x7f54ec070e50 0x7f54ec14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.162 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 -- 172.21.15.110:0/1127142436 >> 172.21.15.110:0/1127142436 conn(0x7f54ec0c6ea0 msgr2=0x7f54ec0c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.162 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 -- 172.21.15.110:0/1127142436 shutdown_connections 2023-10-16T19:40:26.162 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.159+0000 7f54f12c2640 1 -- 172.21.15.110:0/1127142436 wait complete. 2023-10-16T19:40:26.163 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.162+0000 7f54f12c2640 1 Processor -- start 2023-10-16T19:40:26.164 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.162+0000 7f54f12c2640 1 -- start start 2023-10-16T19:40:26.165 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.163+0000 7f54f12c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec070e50 0x7f54ec1ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.165 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.163+0000 7f54f12c2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec14dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.166 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.163+0000 7f54f12c2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ec155d40 0x7f54ec14e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.166 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.163+0000 7f54f12c2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec155680 con 0x7f54ec155d40 2023-10-16T19:40:26.166 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.163+0000 7f54f12c2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec14a5b0 con 0x7f54ec070e50 2023-10-16T19:40:26.166 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.163+0000 7f54f12c2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec1edfe0 con 0x7f54ec0c53b0 2023-10-16T19:40:26.167 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.165+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec14dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.167 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.165+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec14dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:50912/0 (socket says 172.21.15.110:50912) 2023-10-16T19:40:26.167 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.165+0000 7f54e3fff640 1 -- 172.21.15.110:0/1531213233 learned_addr learned my addr 172.21.15.110:0/1531213233 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:26.170 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.169+0000 7f54eaffd640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec070e50 0x7f54ec1ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.175 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.173+0000 7f54eaffd640 1 -- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 msgr2=0x7f54ec14dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.175 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.173+0000 7f54eaffd640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec14dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.176 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.173+0000 7f54eaffd640 1 -- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ec155d40 msgr2=0x7f54ec14e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.176 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.173+0000 7f54eaffd640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ec155d40 0x7f54ec14e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.176 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.174+0000 7f54eaffd640 1 -- 172.21.15.110:0/1531213233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4009b30 con 0x7f54ec070e50 2023-10-16T19:40:26.178 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.177+0000 7f54eaffd640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec070e50 0x7f54ec1ed4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00b440 tx=0x7f54dc00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.216+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc011830 con 0x7f54ec070e50 2023-10-16T19:40:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.216+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc011990 con 0x7f54ec070e50 2023-10-16T19:40:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.216+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec154de0 con 0x7f54ec070e50 2023-10-16T19:40:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.216+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc011d40 con 0x7f54ec070e50 2023-10-16T19:40:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.217+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec1553a0 con 0x7f54ec070e50 2023-10-16T19:40:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.218+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec04e160 con 0x7f54ec070e50 2023-10-16T19:40:26.419 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.417+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 3) v1 ==== 88940+0+0 (secure 0 0 0) 0x7f54dc01b460 con 0x7f54ec070e50 2023-10-16T19:40:26.437 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.435+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f54dc059120 con 0x7f54ec070e50 2023-10-16T19:40:26.437 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.435+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f54dc054d60 con 0x7f54ec070e50 2023-10-16T19:40:26.527 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:26.525+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bce9b4db-90e0-44b0-942a-66d8019dd00b", "id": 6} v 0) v1 -- 0x7f54ec0c1b40 con 0x7f54ec070e50 2023-10-16T19:40:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.057+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f54dc054810 con 0x7f54ec070e50 2023-10-16T19:40:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.058+0000 7f54e37fe640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f54cc06bef0 0x7f54cc06e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.059+0000 7f54e3fff640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f54cc06bef0 0x7f54cc06e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.060+0000 7f54e3fff640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f54cc06bef0 0x7f54cc06e2e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54ec06cc90 tx=0x7f54d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.172 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:27.169+0000 7f2b8ee69640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T19:40:27.333 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T19:40:27.331+0000 7f2b8ee69640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T19:40:27.859 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.857+0000 7f54e37fe640 1 -- 172.21.15.110:0/1531213233 <== mon.1 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bce9b4db-90e0-44b0-942a-66d8019dd00b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54dc0414d0 con 0x7f54ec070e50 2023-10-16T19:40:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:6 2023-10-16T19:40:27.861 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f54cc06bef0 msgr2=0x7f54cc06e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.861 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f54cc06bef0 0x7f54cc06e2e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54ec06cc90 tx=0x7f54d4009040 comp rx=0 tx=0).stop 2023-10-16T19:40:27.861 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec070e50 msgr2=0x7f54ec1ed4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.862 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec070e50 0x7f54ec1ed4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00b440 tx=0x7f54dc00b900 comp rx=0 tx=0).stop 2023-10-16T19:40:27.862 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 shutdown_connections 2023-10-16T19:40:27.862 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f54cc06bef0 0x7f54cc06e2e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.862 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ec155d40 0x7f54ec14e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.862 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54ec0c53b0 0x7f54ec14dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.863 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 --2- 172.21.15.110:0/1531213233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54ec070e50 0x7f54ec1ed4e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.863 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 >> 172.21.15.110:0/1531213233 conn(0x7f54ec0c6ea0 msgr2=0x7f54ec0c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:27.863 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 shutdown_connections 2023-10-16T19:40:27.863 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:27.859+0000 7f54f12c2640 1 -- 172.21.15.110:0/1531213233 wait complete. 2023-10-16T19:40:27.881 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 32e73410-d9ed-4c19-aba2-4e858be5f271 7 2023-10-16T19:40:28.079 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.077+0000 7f46630e1640 1 Processor -- start 2023-10-16T19:40:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.077+0000 7f46630e1640 1 -- start start 2023-10-16T19:40:28.081 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.079+0000 7f46630e1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f465c0c40b0 0x7f465c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.081 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.079+0000 7f46630e1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c156000 con 0x7f465c14fd00 2023-10-16T19:40:28.081 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.079+0000 7f46630e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0c5af0 con 0x7f465c0c5620 2023-10-16T19:40:28.082 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.079+0000 7f46630e1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0c5dd0 con 0x7f465c0c40b0 2023-10-16T19:40:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.080+0000 7f466167e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f465c0c40b0 0x7f465c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.080+0000 7f465bfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f465c0c5620 0x7f465c069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:53642/0 (socket says 172.21.15.110:53642) 2023-10-16T19:40:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.080+0000 7f465bfff640 1 -- 172.21.15.110:0/2491754783 learned_addr learned my addr 172.21.15.110:0/2491754783 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-10-16T19:40:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.084+0000 7f466167e640 1 -- 172.21.15.110:0/2491754783 >> v1:172.21.15.110:6789/0 conn(0x7f465c0c5620 legacy=0x7f465c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.084+0000 7f466167e640 1 -- 172.21.15.110:0/2491754783 >> v1:172.21.15.57:6789/0 conn(0x7f465c14fd00 legacy=0x7f465c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:28.087 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.084+0000 7f466167e640 1 -- 172.21.15.110:0/2491754783 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0c60b0 con 0x7f465c0c40b0 2023-10-16T19:40:28.097 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.095+0000 7f466167e640 1 --2- 172.21.15.110:0/2491754783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0c40b0 0x7f465c155ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4654009d90 tx=0x7f465402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205f8aad3f954183 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.188 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.186+0000 7f465b7fe640 1 -- 172.21.15.110:0/2491754783 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465402cd00 con 0x7f465c0c40b0 2023-10-16T19:40:28.189 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.186+0000 7f465b7fe640 1 -- 172.21.15.110:0/2491754783 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465402ce60 con 0x7f465c0c40b0 2023-10-16T19:40:28.189 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.186+0000 7f465b7fe640 1 -- 172.21.15.110:0/2491754783 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654034660 con 0x7f465c0c40b0 2023-10-16T19:40:28.191 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 -- 172.21.15.110:0/2491754783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0c40b0 msgr2=0x7f465c155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.191 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 --2- 172.21.15.110:0/2491754783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0c40b0 0x7f465c155ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4654009d90 tx=0x7f465402bf50 comp rx=0 tx=0).stop 2023-10-16T19:40:28.191 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 -- 172.21.15.110:0/2491754783 shutdown_connections 2023-10-16T19:40:28.192 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 --2- 172.21.15.110:0/2491754783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0c40b0 0x7f465c155ac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.192 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 -- 172.21.15.110:0/2491754783 >> 172.21.15.110:0/2491754783 conn(0x7f465c0c6ea0 msgr2=0x7f465c0c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.192 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 -- 172.21.15.110:0/2491754783 shutdown_connections 2023-10-16T19:40:28.193 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.187+0000 7f46630e1640 1 -- 172.21.15.110:0/2491754783 wait complete. 2023-10-16T19:40:28.194 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.191+0000 7f46630e1640 1 Processor -- start 2023-10-16T19:40:28.194 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.192+0000 7f46630e1640 1 -- start start 2023-10-16T19:40:28.196 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.194+0000 7f46630e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 0x7f465c1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.196 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.194+0000 7f46630e1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0c5620 0x7f465c13a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.196 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.194+0000 7f46630e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c14fd00 0x7f465c1376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.196 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.194+0000 7f46630e1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c147050 con 0x7f465c0c5620 2023-10-16T19:40:28.197 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.194+0000 7f46630e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1ef8b0 con 0x7f465c14fd00 2023-10-16T19:40:28.197 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.194+0000 7f46630e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1ef2e0 con 0x7f465c0c40b0 2023-10-16T19:40:28.198 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.195+0000 7f4660e7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 0x7f465c1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.198 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.195+0000 7f466167e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c14fd00 0x7f465c1376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.198 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.195+0000 7f4660e7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 0x7f465c1550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43890/0 (socket says 172.21.15.110:43890) 2023-10-16T19:40:28.199 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.195+0000 7f4660e7d640 1 -- 172.21.15.110:0/2423477098 learned_addr learned my addr 172.21.15.110:0/2423477098 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-10-16T19:40:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.200+0000 7f4660e7d640 1 -- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c14fd00 msgr2=0x7f465c1376e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.200+0000 7f4660e7d640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c14fd00 0x7f465c1376e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.200+0000 7f4660e7d640 1 -- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0c5620 msgr2=0x7f465c13a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.200+0000 7f4660e7d640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0c5620 0x7f465c13a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.200+0000 7f4660e7d640 1 -- 172.21.15.110:0/2423477098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654009a70 con 0x7f465c0c40b0 2023-10-16T19:40:28.207 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.205+0000 7f4660e7d640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 0x7f465c1550d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f465000b3e0 tx=0x7f465000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.211+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650011830 con 0x7f465c0c40b0 2023-10-16T19:40:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.211+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500119b0 con 0x7f465c0c40b0 2023-10-16T19:40:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.211+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650011d60 con 0x7f465c0c40b0 2023-10-16T19:40:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.211+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c138900 con 0x7f465c0c40b0 2023-10-16T19:40:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.211+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c138ba0 con 0x7f465c0c40b0 2023-10-16T19:40:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.212+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c04e160 con 0x7f465c0c40b0 2023-10-16T19:40:28.244 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.242+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f465001a400 con 0x7f465c0c40b0 2023-10-16T19:40:28.245 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.243+0000 7f46597fa640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f464006ae60 0x7f464006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.245 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.244+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4650088ad0 con 0x7f465c0c40b0 2023-10-16T19:40:28.246 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.244+0000 7f465bfff640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f464006ae60 0x7f464006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.247 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.246+0000 7f465bfff640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f464006ae60 0x7f464006d320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f465c139a10 tx=0x7f4648007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.538 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.536+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4650054d00 con 0x7f465c0c40b0 2023-10-16T19:40:28.752 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:28.750+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "32e73410-d9ed-4c19-aba2-4e858be5f271", "id": 7} v 0) v1 -- 0x7f465c0caee0 con 0x7f465c0c40b0 2023-10-16T19:40:29.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.069+0000 7f46597fa640 1 -- 172.21.15.110:0/2423477098 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32e73410-d9ed-4c19-aba2-4e858be5f271", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4650015070 con 0x7f465c0c40b0 2023-10-16T19:40:29.072 INFO:teuthology.orchestra.run.smithi110.stdout:7 2023-10-16T19:40:29.074 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f464006ae60 msgr2=0x7f464006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.075 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f464006ae60 0x7f464006d320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f465c139a10 tx=0x7f4648007a40 comp rx=0 tx=0).stop 2023-10-16T19:40:29.075 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 msgr2=0x7f465c1550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.075 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 0x7f465c1550d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f465000b3e0 tx=0x7f465000b8a0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.075 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 shutdown_connections 2023-10-16T19:40:29.075 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f464006ae60 0x7f464006d320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.076 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c14fd00 0x7f465c1376e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.076 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.072+0000 7f46630e1640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0c5620 0x7f465c13a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.076 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.073+0000 7f46630e1640 1 --2- 172.21.15.110:0/2423477098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f465c0c40b0 0x7f465c1550d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.076 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.073+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 >> 172.21.15.110:0/2423477098 conn(0x7f465c0c6ea0 msgr2=0x7f465c145930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.076 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.073+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 shutdown_connections 2023-10-16T19:40:29.077 INFO:teuthology.orchestra.run.smithi110.stderr:2023-10-16T19:40:29.073+0000 7f46630e1640 1 -- 172.21.15.110:0/2423477098 wait complete. 2023-10-16T19:40:29.095 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T19:40:29.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-10-16T19:40:29.105 INFO:tasks.ceph.osd.0:Started 2023-10-16T19:40:29.105 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T19:40:29.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-10-16T19:40:29.113 INFO:tasks.ceph.osd.1:Started 2023-10-16T19:40:29.114 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T19:40:29.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-10-16T19:40:29.122 INFO:tasks.ceph.osd.2:Started 2023-10-16T19:40:29.123 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T19:40:29.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-10-16T19:40:29.130 INFO:tasks.ceph.osd.3:Started 2023-10-16T19:40:29.130 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T19:40:29.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-10-16T19:40:29.139 INFO:tasks.ceph.osd.4:Started 2023-10-16T19:40:29.140 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T19:40:29.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-10-16T19:40:29.147 INFO:tasks.ceph.osd.5:Started 2023-10-16T19:40:29.148 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T19:40:29.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-10-16T19:40:29.158 INFO:tasks.ceph.osd.6:Started 2023-10-16T19:40:29.159 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T19:40:29.159 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-10-16T19:40:29.164 INFO:tasks.ceph.osd.7:Started 2023-10-16T19:40:29.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.407+0000 7fc542890640 1 Processor -- start 2023-10-16T19:40:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.408+0000 7fc542890640 1 -- start start 2023-10-16T19:40:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.409+0000 7fc542890640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.409+0000 7fc542890640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc53c06b440 0x7fc53c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.409+0000 7fc542890640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c070a40 con 0x7fc53c065ee0 2023-10-16T19:40:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.409+0000 7fc542890640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c159560 con 0x7fc53c06b440 2023-10-16T19:40:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.409+0000 7fc542890640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0c19a0 con 0x7fc53c06b060 2023-10-16T19:40:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.410+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.411+0000 7fc540e2d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc53c065ee0 0x7fc53c1531d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:43914/0 (socket says 172.21.15.57:43914) 2023-10-16T19:40:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.411+0000 7fc540e2d640 1 -- 172.21.15.57:0/248542941 learned_addr learned my addr 172.21.15.57:0/248542941 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:29.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.411+0000 7fc533fff640 1 --2- 172.21.15.57:0/248542941 >> v2:172.21.15.110:3300/0 conn(0x7fc53c06b440 0x7fc53c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.416+0000 7fc53bfff640 1 -- 172.21.15.57:0/248542941 >> v2:172.21.15.110:3300/0 conn(0x7fc53c06b440 msgr2=0x7fc53c152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.416+0000 7fc53bfff640 1 --2- 172.21.15.57:0/248542941 >> v2:172.21.15.110:3300/0 conn(0x7fc53c06b440 0x7fc53c152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.416+0000 7fc53bfff640 1 -- 172.21.15.57:0/248542941 >> v1:172.21.15.110:6789/0 conn(0x7fc53c065ee0 legacy=0x7fc53c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.416+0000 7fc53bfff640 1 -- 172.21.15.57:0/248542941 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0c1700 con 0x7fc53c06b060 2023-10-16T19:40:29.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.419+0000 7fc53bfff640 1 --2- 172.21.15.57:0/248542941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c159020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0097a0 tx=0x7fc52c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdc89ed50547b86e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.424+0000 7fc53b7fe640 1 -- 172.21.15.57:0/248542941 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c031830 con 0x7fc53c06b060 2023-10-16T19:40:29.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.424+0000 7fc53b7fe640 1 -- 172.21.15.57:0/248542941 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c031990 con 0x7fc53c06b060 2023-10-16T19:40:29.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.424+0000 7fc53b7fe640 1 -- 172.21.15.57:0/248542941 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c031d20 con 0x7fc53c06b060 2023-10-16T19:40:29.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 -- 172.21.15.57:0/248542941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 msgr2=0x7fc53c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 --2- 172.21.15.57:0/248542941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c159020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0097a0 tx=0x7fc52c02b8d0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 -- 172.21.15.57:0/248542941 shutdown_connections 2023-10-16T19:40:29.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 --2- 172.21.15.57:0/248542941 >> v2:172.21.15.110:3300/0 conn(0x7fc53c06b440 0x7fc53c152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 --2- 172.21.15.57:0/248542941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c159020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 -- 172.21.15.57:0/248542941 >> 172.21.15.57:0/248542941 conn(0x7fc53c0c7780 msgr2=0x7fc53c0c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 -- 172.21.15.57:0/248542941 shutdown_connections 2023-10-16T19:40:29.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.425+0000 7fc542890640 1 -- 172.21.15.57:0/248542941 wait complete. 2023-10-16T19:40:29.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.427+0000 7fc542890640 1 Processor -- start 2023-10-16T19:40:29.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.427+0000 7fc542890640 1 -- start start 2023-10-16T19:40:29.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.428+0000 7fc542890640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 0x7fc53c13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.428+0000 7fc542890640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c1e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.428+0000 7fc542890640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc53c06b440 0x7fc53c1e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.428+0000 7fc542890640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c144060 con 0x7fc53c065ee0 2023-10-16T19:40:29.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.428+0000 7fc542890640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c140410 con 0x7fc53c06b440 2023-10-16T19:40:29.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.428+0000 7fc542890640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c145dd0 con 0x7fc53c06b060 2023-10-16T19:40:29.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.429+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 0x7fc53c13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.429+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 0x7fc53c13fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51524/0 (socket says 172.21.15.57:51524) 2023-10-16T19:40:29.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.429+0000 7fc53bfff640 1 -- 172.21.15.57:0/3178220397 learned_addr learned my addr 172.21.15.57:0/3178220397 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:29.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.429+0000 7fc533fff640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c1e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.433+0000 7fc53bfff640 1 -- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 msgr2=0x7fc53c1e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.433+0000 7fc53bfff640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c1e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.433+0000 7fc53bfff640 1 -- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc53c06b440 msgr2=0x7fc53c1e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.433+0000 7fc53bfff640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc53c06b440 0x7fc53c1e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.433+0000 7fc53bfff640 1 -- 172.21.15.57:0/3178220397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c009400 con 0x7fc53c065ee0 2023-10-16T19:40:29.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.436+0000 7fc53bfff640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 0x7fc53c13fed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc52c02bee0 tx=0x7fc52c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.440+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c03b9f0 con 0x7fc53c065ee0 2023-10-16T19:40:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.440+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c03bb70 con 0x7fc53c065ee0 2023-10-16T19:40:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.440+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0453f0 con 0x7fc53c065ee0 2023-10-16T19:40:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.440+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c148f80 con 0x7fc53c065ee0 2023-10-16T19:40:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.440+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0c4df0 con 0x7fc53c065ee0 2023-10-16T19:40:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.441+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c04e1d0 con 0x7fc53c065ee0 2023-10-16T19:40:29.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.467+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc52c04e450 con 0x7fc53c065ee0 2023-10-16T19:40:29.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.468+0000 7fc5397fa640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc51c06ade0 0x7fc51c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.468+0000 7fc533fff640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc51c06ade0 0x7fc51c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.469+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc52c07af70 con 0x7fc53c065ee0 2023-10-16T19:40:29.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.469+0000 7fc533fff640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc51c06ade0 0x7fc51c06d2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0ca980 tx=0x7fc524009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.761+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc52c076bb0 con 0x7fc53c065ee0 2023-10-16T19:40:29.824 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-16T19:40:29.822+0000 7f97084cf500 -1 Falling back to public interface 2023-10-16T19:40:29.858 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-16T19:40:29.857+0000 7ff62000c500 -1 Falling back to public interface 2023-10-16T19:40:29.862 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-16T19:40:29.860+0000 7fc89f4f8500 -1 Falling back to public interface 2023-10-16T19:40:29.873 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-16T19:40:29.872+0000 7f475c594500 -1 Falling back to public interface 2023-10-16T19:40:29.874 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-16T19:40:29.873+0000 7f13e9b1a500 -1 Falling back to public interface 2023-10-16T19:40:29.879 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-16T19:40:29.877+0000 7f1627c12500 -1 Falling back to public interface 2023-10-16T19:40:29.882 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-16T19:40:29.880+0000 7f74c8614500 -1 Falling back to public interface 2023-10-16T19:40:29.884 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-16T19:40:29.883+0000 7fad6ca14500 -1 Falling back to public interface 2023-10-16T19:40:29.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:29.979+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc53c1491b0 con 0x7fc53c065ee0 2023-10-16T19:40:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.036+0000 7fc5397fa640 1 -- 172.21.15.57:0/3178220397 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc52c035090 con 0x7fc53c065ee0 2023-10-16T19:40:30.038 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:30.038 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:40:28.823925+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:30.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.039+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc51c06ade0 msgr2=0x7fc51c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.039+0000 7fc542890640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc51c06ade0 0x7fc51c06d2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0ca980 tx=0x7fc524009190 comp rx=0 tx=0).stop 2023-10-16T19:40:30.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.039+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 msgr2=0x7fc53c13fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.039+0000 7fc542890640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 0x7fc53c13fed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc52c02bee0 tx=0x7fc52c0046c0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 shutdown_connections 2023-10-16T19:40:30.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc51c06ade0 0x7fc51c06d2a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc53c06b440 0x7fc53c1e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc53c06b060 0x7fc53c1e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 --2- 172.21.15.57:0/3178220397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc53c065ee0 0x7fc53c13fed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 >> 172.21.15.57:0/3178220397 conn(0x7fc53c0c7780 msgr2=0x7fc53c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 shutdown_connections 2023-10-16T19:40:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:30.040+0000 7fc542890640 1 -- 172.21.15.57:0/3178220397 wait complete. 2023-10-16T19:40:30.059 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T19:40:30.060 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T19:40:30.866 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:31.070 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.069+0000 7f7bb7e56640 1 Processor -- start 2023-10-16T19:40:31.071 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.069+0000 7f7bb7e56640 1 -- start start 2023-10-16T19:40:31.072 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.070+0000 7f7bb7e56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7bb014f600 0x7f7bb006fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:31.072 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.070+0000 7f7bb7e56640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bb0071330 0x7f7bb00c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:31.072 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.070+0000 7f7bb7e56640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb00c7740 con 0x7f7bb00c5380 2023-10-16T19:40:31.073 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.070+0000 7f7bb7e56640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00c22a0 con 0x7f7bb0071330 2023-10-16T19:40:31.073 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.070+0000 7f7bb7e56640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb006c7d0 con 0x7f7bb014f600 2023-10-16T19:40:31.073 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.071+0000 7f7bb53f1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bb0071330 0x7f7bb00c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:31.074 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.072+0000 7f7bb53f1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bb0071330 0x7f7bb00c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51536/0 (socket says 172.21.15.57:51536) 2023-10-16T19:40:31.074 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.072+0000 7f7bb53f1640 1 -- 172.21.15.57:0/220661936 learned_addr learned my addr 172.21.15.57:0/220661936 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:31.074 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.072+0000 7f7bb5bf2640 1 --2- 172.21.15.57:0/220661936 >> v2:172.21.15.110:3300/0 conn(0x7f7bb014f600 0x7f7bb006fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:31.076 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.075+0000 7f7bb53f1640 1 -- 172.21.15.57:0/220661936 >> v2:172.21.15.110:3300/0 conn(0x7f7bb014f600 msgr2=0x7f7bb006fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:31.076 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.075+0000 7f7bb53f1640 1 --2- 172.21.15.57:0/220661936 >> v2:172.21.15.110:3300/0 conn(0x7f7bb014f600 0x7f7bb006fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.077 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.075+0000 7f7bb53f1640 1 -- 172.21.15.57:0/220661936 >> v1:172.21.15.110:6789/0 conn(0x7f7bb00c5380 legacy=0x7f7bb01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:31.077 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.075+0000 7f7bb53f1640 1 -- 172.21.15.57:0/220661936 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb006ca70 con 0x7f7bb0071330 2023-10-16T19:40:31.078 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.077+0000 7f7bb53f1640 1 --2- 172.21.15.57:0/220661936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb0071330 0x7f7bb00c66c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0071750 tx=0x7f7ba402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b817f21577e9ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:31.084 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.083+0000 7f7bb4bf0640 1 -- 172.21.15.57:0/220661936 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4031870 con 0x7f7bb0071330 2023-10-16T19:40:31.085 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.083+0000 7f7bb4bf0640 1 -- 172.21.15.57:0/220661936 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba40319d0 con 0x7f7bb0071330 2023-10-16T19:40:31.085 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.083+0000 7f7bb4bf0640 1 -- 172.21.15.57:0/220661936 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4031d60 con 0x7f7bb0071330 2023-10-16T19:40:31.086 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.083+0000 7f7bb7e56640 1 -- 172.21.15.57:0/220661936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb0071330 msgr2=0x7f7bb00c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:31.086 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.083+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/220661936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb0071330 0x7f7bb00c66c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0071750 tx=0x7f7ba402b910 comp rx=0 tx=0).stop 2023-10-16T19:40:31.086 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.084+0000 7f7bb7e56640 1 -- 172.21.15.57:0/220661936 shutdown_connections 2023-10-16T19:40:31.087 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.084+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/220661936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb0071330 0x7f7bb00c66c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.087 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.084+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/220661936 >> v2:172.21.15.110:3300/0 conn(0x7f7bb014f600 0x7f7bb006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.087 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.084+0000 7f7bb7e56640 1 -- 172.21.15.57:0/220661936 >> 172.21.15.57:0/220661936 conn(0x7f7bb006d5e0 msgr2=0x7f7bb006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:31.087 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.084+0000 7f7bb7e56640 1 -- 172.21.15.57:0/220661936 shutdown_connections 2023-10-16T19:40:31.087 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.084+0000 7f7bb7e56640 1 -- 172.21.15.57:0/220661936 wait complete. 2023-10-16T19:40:31.088 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.086+0000 7f7bb7e56640 1 Processor -- start 2023-10-16T19:40:31.089 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.086+0000 7f7bb7e56640 1 -- start start 2023-10-16T19:40:31.089 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.087+0000 7f7bb7e56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bb0071330 0x7f7bb00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:31.089 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.087+0000 7f7bb7e56640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 0x7f7bb0145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:31.089 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.087+0000 7f7bb7e56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bb014f600 0x7f7bb0146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:31.090 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.087+0000 7f7bb7e56640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb014ee90 con 0x7f7bb00c5380 2023-10-16T19:40:31.090 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.087+0000 7f7bb7e56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb014e030 con 0x7f7bb014f600 2023-10-16T19:40:31.090 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.087+0000 7f7bb7e56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb014e310 con 0x7f7bb0071330 2023-10-16T19:40:31.091 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.088+0000 7f7bb53f1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 0x7f7bb0145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:31.091 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.088+0000 7f7bb53f1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 0x7f7bb0145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51548/0 (socket says 172.21.15.57:51548) 2023-10-16T19:40:31.091 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.088+0000 7f7bb53f1640 1 -- 172.21.15.57:0/1532933689 learned_addr learned my addr 172.21.15.57:0/1532933689 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:31.091 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.088+0000 7f7bb63f3640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bb014f600 0x7f7bb0146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:31.092 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.089+0000 7f7bb5bf2640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bb0071330 0x7f7bb00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:31.093 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.092+0000 7f7bb53f1640 1 -- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bb0071330 msgr2=0x7f7bb00709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:31.094 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.092+0000 7f7bb53f1640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bb0071330 0x7f7bb00709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.094 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.092+0000 7f7bb53f1640 1 -- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bb014f600 msgr2=0x7f7bb0146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:31.094 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.092+0000 7f7bb53f1640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bb014f600 0x7f7bb0146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.094 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.092+0000 7f7bb53f1640 1 -- 172.21.15.57:0/1532933689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40094d0 con 0x7f7bb00c5380 2023-10-16T19:40:31.096 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.094+0000 7f7bb53f1640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 0x7f7bb0145f20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4000c00 tx=0x7f7ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:31.100 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.098+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba403abe0 con 0x7f7bb00c5380 2023-10-16T19:40:31.100 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.098+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb014e5f0 con 0x7f7bb00c5380 2023-10-16T19:40:31.100 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.099+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb014ebb0 con 0x7f7bb00c5380 2023-10-16T19:40:31.101 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.100+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb0145c40 con 0x7f7bb00c5380 2023-10-16T19:40:31.373 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.372+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba404d450 con 0x7f7bb00c5380 2023-10-16T19:40:31.374 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.372+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba404d7c0 con 0x7f7bb00c5380 2023-10-16T19:40:31.377 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.376+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f7ba404d9e0 con 0x7f7bb00c5380 2023-10-16T19:40:31.379 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.377+0000 7f7bae7fc640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f7b9c06ade0 0x7f7b9c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:31.380 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.378+0000 7f7bb5bf2640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f7b9c06ade0 0x7f7b9c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:31.381 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.380+0000 7f7bb5bf2640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f7b9c06ade0 0x7f7b9c06d2a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0003b80 tx=0x7f7ba0009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:31.396 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.394+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7ba402d040 con 0x7f7bb00c5380 2023-10-16T19:40:31.397 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.395+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ba4077080 con 0x7f7bb00c5380 2023-10-16T19:40:31.622 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.621+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bb0145c40 con 0x7f7bb00c5380 2023-10-16T19:40:31.672 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.670+0000 7f7bae7fc640 1 -- 172.21.15.57:0/1532933689 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7bb0145c40 con 0x7f7bb00c5380 2023-10-16T19:40:31.672 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-16T19:40:31.673 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:40:28.823925+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:31.675 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f7b9c06ade0 msgr2=0x7f7b9c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:31.675 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f7b9c06ade0 0x7f7b9c06d2a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0003b80 tx=0x7f7ba0009880 comp rx=0 tx=0).stop 2023-10-16T19:40:31.675 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 msgr2=0x7f7bb0145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:31.676 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 0x7f7bb0145f20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4000c00 tx=0x7f7ba40046c0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.676 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 shutdown_connections 2023-10-16T19:40:31.676 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f7b9c06ade0 0x7f7b9c06d2a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.676 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bb014f600 0x7f7bb0146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.676 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bb00c5380 0x7f7bb0145f20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.677 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 --2- 172.21.15.57:0/1532933689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bb0071330 0x7f7bb00709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:31.677 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.673+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 >> 172.21.15.57:0/1532933689 conn(0x7f7bb006d5e0 msgr2=0x7f7bb00c32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:31.677 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.674+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 shutdown_connections 2023-10-16T19:40:31.677 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:31.674+0000 7f7bb7e56640 1 -- 172.21.15.57:0/1532933689 wait complete. 2023-10-16T19:40:31.691 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T19:40:33.363 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-16T19:40:33.362+0000 7f97084cf500 -1 osd.1 0 log_to_monitors true 2023-10-16T19:40:33.395 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-16T19:40:33.394+0000 7fc89f4f8500 -1 osd.4 0 log_to_monitors true 2023-10-16T19:40:33.441 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-16T19:40:33.439+0000 7f13e9b1a500 -1 osd.5 0 log_to_monitors true 2023-10-16T19:40:33.482 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-16T19:40:33.480+0000 7f74c8614500 -1 osd.6 0 log_to_monitors true 2023-10-16T19:40:33.496 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-16T19:40:33.494+0000 7f1627c12500 -1 osd.7 0 log_to_monitors true 2023-10-16T19:40:33.501 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-16T19:40:33.500+0000 7f475c594500 -1 osd.0 0 log_to_monitors true 2023-10-16T19:40:33.683 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-16T19:40:33.682+0000 7ff62000c500 -1 osd.2 0 log_to_monitors true 2023-10-16T19:40:33.714 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-16T19:40:33.713+0000 7fad6ca14500 -1 osd.3 0 log_to_monitors true 2023-10-16T19:40:36.120 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-16T19:40:36.118+0000 7f970445b640 -1 osd.1 0 waiting for initial osdmap 2023-10-16T19:40:36.202 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-16T19:40:36.200+0000 7f96fc27b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:36.222 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-16T19:40:36.221+0000 7fc89bc9a640 -1 osd.4 0 waiting for initial osdmap 2023-10-16T19:40:36.264 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-16T19:40:36.262+0000 7fc8932a4640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:37.201 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-16T19:40:37.200+0000 7f4758520640 -1 osd.0 0 waiting for initial osdmap 2023-10-16T19:40:37.204 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-16T19:40:37.202+0000 7ff61ba8b640 -1 osd.2 0 waiting for initial osdmap 2023-10-16T19:40:37.230 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-16T19:40:37.229+0000 7fad68b8b640 -1 osd.3 0 waiting for initial osdmap 2023-10-16T19:40:37.244 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-16T19:40:37.242+0000 7f13e62bc640 -1 osd.5 0 waiting for initial osdmap 2023-10-16T19:40:37.269 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-16T19:40:37.267+0000 7f1623e83640 -1 osd.7 0 waiting for initial osdmap 2023-10-16T19:40:37.270 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-16T19:40:37.269+0000 7f74c4812640 -1 osd.6 0 waiting for initial osdmap 2023-10-16T19:40:37.288 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-16T19:40:37.286+0000 7fad60195640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:37.289 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-16T19:40:37.287+0000 7f161b48d640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:37.299 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-16T19:40:37.297+0000 7f4750340640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:37.299 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-16T19:40:37.297+0000 7ff6138ab640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:37.303 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-16T19:40:37.301+0000 7f74bbe1c640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:37.310 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-16T19:40:37.309+0000 7f13dd8c6640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:40:38.498 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:38.738 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.737+0000 7fc83b535640 1 Processor -- start 2023-10-16T19:40:38.739 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.737+0000 7fc83b535640 1 -- start start 2023-10-16T19:40:38.740 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.739+0000 7fc83b535640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc834152b60 0x7fc834152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.740 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.739+0000 7fc83b535640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340c5c70 con 0x7fc83406b1b0 2023-10-16T19:40:38.741 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.739+0000 7fc83b535640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340c5f50 con 0x7fc834158e30 2023-10-16T19:40:38.741 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.739+0000 7fc83b535640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c6bd0 con 0x7fc834152b60 2023-10-16T19:40:38.742 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.741+0000 7fc83ad34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc834152b60 0x7fc834152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.742 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.741+0000 7fc839d32640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc834158e30 0x7fc8340c6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:57828/0 (socket says 172.21.15.57:57828) 2023-10-16T19:40:38.742 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.741+0000 7fc839d32640 1 -- 172.21.15.57:0/1663231466 learned_addr learned my addr 172.21.15.57:0/1663231466 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:38.750 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.749+0000 7fc83ad34640 1 -- 172.21.15.57:0/1663231466 >> v1:172.21.15.110:6789/0 conn(0x7fc834158e30 legacy=0x7fc8340c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.751 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.749+0000 7fc83ad34640 1 -- 172.21.15.57:0/1663231466 >> v1:172.21.15.57:6789/0 conn(0x7fc83406b1b0 legacy=0x7fc83406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:38.751 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.749+0000 7fc83ad34640 1 -- 172.21.15.57:0/1663231466 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340c6230 con 0x7fc834152b60 2023-10-16T19:40:38.756 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.755+0000 7fc83ad34640 1 --2- 172.21.15.57:0/1663231466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc834152b60 0x7fc834152ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009df0 tx=0x7fc82c02bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8eba164a7bacf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.768 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.766+0000 7fc839531640 1 -- 172.21.15.57:0/1663231466 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c02ccb0 con 0x7fc834152b60 2023-10-16T19:40:38.768 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.766+0000 7fc839531640 1 -- 172.21.15.57:0/1663231466 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c02ce10 con 0x7fc834152b60 2023-10-16T19:40:38.768 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.766+0000 7fc839531640 1 -- 172.21.15.57:0/1663231466 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c034660 con 0x7fc834152b60 2023-10-16T19:40:38.769 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.767+0000 7fc83b535640 1 -- 172.21.15.57:0/1663231466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc834152b60 msgr2=0x7fc834152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.769 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.767+0000 7fc83b535640 1 --2- 172.21.15.57:0/1663231466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc834152b60 0x7fc834152ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009df0 tx=0x7fc82c02bf00 comp rx=0 tx=0).stop 2023-10-16T19:40:38.770 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.767+0000 7fc83b535640 1 -- 172.21.15.57:0/1663231466 shutdown_connections 2023-10-16T19:40:38.770 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.767+0000 7fc83b535640 1 --2- 172.21.15.57:0/1663231466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc834152b60 0x7fc834152ff0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.770 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.767+0000 7fc83b535640 1 -- 172.21.15.57:0/1663231466 >> 172.21.15.57:0/1663231466 conn(0x7fc8340caf40 msgr2=0x7fc8340cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.770 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.768+0000 7fc83b535640 1 -- 172.21.15.57:0/1663231466 shutdown_connections 2023-10-16T19:40:38.770 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.768+0000 7fc83b535640 1 -- 172.21.15.57:0/1663231466 wait complete. 2023-10-16T19:40:38.772 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.770+0000 7fc83b535640 1 Processor -- start 2023-10-16T19:40:38.772 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.771+0000 7fc83b535640 1 -- start start 2023-10-16T19:40:38.774 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.772+0000 7fc83b535640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 0x7fc8340ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.774 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.772+0000 7fc83b535640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc834152b60 0x7fc8340cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.774 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.772+0000 7fc83b535640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc834158e30 0x7fc83414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.774 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.772+0000 7fc83b535640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83414b080 con 0x7fc834158e30 2023-10-16T19:40:38.774 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.772+0000 7fc83b535640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8341520e0 con 0x7fc834152b60 2023-10-16T19:40:38.775 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.772+0000 7fc83b535640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8341523b0 con 0x7fc83406b1b0 2023-10-16T19:40:38.775 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.774+0000 7fc83a533640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 0x7fc8340ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.776 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.775+0000 7fc83a533640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 0x7fc8340ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45158/0 (socket says 172.21.15.57:45158) 2023-10-16T19:40:38.776 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.775+0000 7fc83a533640 1 -- 172.21.15.57:0/945298488 learned_addr learned my addr 172.21.15.57:0/945298488 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:38.781 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.779+0000 7fc839d32640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc834152b60 0x7fc8340cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.785 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.784+0000 7fc83a533640 1 -- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc834152b60 msgr2=0x7fc8340cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.784+0000 7fc83a533640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc834152b60 0x7fc8340cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.784+0000 7fc83a533640 1 -- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc834158e30 msgr2=0x7fc83414b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.784+0000 7fc83a533640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc834158e30 0x7fc83414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.784+0000 7fc83a533640 1 -- 172.21.15.57:0/945298488 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c009a70 con 0x7fc83406b1b0 2023-10-16T19:40:38.791 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.790+0000 7fc83a533640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 0x7fc8340ccc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c410 tx=0x7fc83000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.803 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.801+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300035f0 con 0x7fc83406b1b0 2023-10-16T19:40:38.804 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.801+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830003750 con 0x7fc83406b1b0 2023-10-16T19:40:38.804 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.801+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830003b40 con 0x7fc83406b1b0 2023-10-16T19:40:38.804 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.801+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc834150e20 con 0x7fc83406b1b0 2023-10-16T19:40:38.805 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.801+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8341513e0 con 0x7fc83406b1b0 2023-10-16T19:40:38.805 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:38.803+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8340cda50 con 0x7fc83406b1b0 2023-10-16T19:40:39.152 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.150+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc830003ca0 con 0x7fc83406b1b0 2023-10-16T19:40:39.153 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.152+0000 7fc82affd640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc81806ae60 0x7fc81806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.154 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.152+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7fc8300884b0 con 0x7fc83406b1b0 2023-10-16T19:40:39.154 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.153+0000 7fc839d32640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc81806ae60 0x7fc81806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.155 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.154+0000 7fc839d32640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc81806ae60 0x7fc81806d320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8340b3e50 tx=0x7fc824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.163 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.162+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8300541f0 con 0x7fc83406b1b0 2023-10-16T19:40:39.392 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.391+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc83404e160 con 0x7fc83406b1b0 2023-10-16T19:40:39.927 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.925+0000 7fc82affd640 1 -- 172.21.15.57:0/945298488 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12704 (secure 0 0 0) 0x7fc830017020 con 0x7fc83406b1b0 2023-10-16T19:40:39.928 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-16T19:40:39.928 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":15,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:40:38.554307+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:39.932 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.930+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc81806ae60 msgr2=0x7fc81806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.932 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.930+0000 7fc83b535640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc81806ae60 0x7fc81806d320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8340b3e50 tx=0x7fc824009040 comp rx=0 tx=0).stop 2023-10-16T19:40:39.933 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.930+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 msgr2=0x7fc8340ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.933 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.930+0000 7fc83b535640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 0x7fc8340ccc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c410 tx=0x7fc83000c8d0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.933 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 shutdown_connections 2023-10-16T19:40:39.933 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc81806ae60 0x7fc81806d320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.933 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc834158e30 0x7fc83414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.934 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc834152b60 0x7fc8340cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.934 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 --2- 172.21.15.57:0/945298488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc83406b1b0 0x7fc8340ccc60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.934 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 >> 172.21.15.57:0/945298488 conn(0x7fc8340caf40 msgr2=0x7fc83406b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.935 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 shutdown_connections 2023-10-16T19:40:39.935 INFO:teuthology.misc.health.smithi057.stderr:2023-10-16T19:40:39.931+0000 7fc83b535640 1 -- 172.21.15.57:0/945298488 wait complete. 2023-10-16T19:40:39.953 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T19:40:39.954 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T19:40:39.954 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-16T19:40:39.955 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T19:40:39.955 DEBUG:teuthology.orchestra.run.smithi057:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-10-16T19:40:39.960 INFO:tasks.ceph.mds.a:Started 2023-10-16T19:40:39.960 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-16T19:40:39.961 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T19:40:39.961 DEBUG:teuthology.orchestra.run.smithi057:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-10-16T19:40:39.966 INFO:tasks.ceph.mds.c:Started 2023-10-16T19:40:39.966 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-16T19:40:39.967 INFO:tasks.ceph.mds.e:Restarting daemon 2023-10-16T19:40:39.967 DEBUG:teuthology.orchestra.run.smithi057:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-10-16T19:40:39.972 INFO:tasks.ceph.mds.e:Started 2023-10-16T19:40:39.974 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-16T19:40:39.975 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T19:40:39.975 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-10-16T19:40:39.984 INFO:tasks.ceph.mds.b:Started 2023-10-16T19:40:39.985 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-16T19:40:39.985 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T19:40:39.985 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-10-16T19:40:39.994 INFO:tasks.ceph.mds.d:Started 2023-10-16T19:40:39.994 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-16T19:40:39.994 INFO:tasks.ceph.mds.f:Restarting daemon 2023-10-16T19:40:39.995 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-10-16T19:40:40.000 INFO:tasks.ceph.mds.f:Started 2023-10-16T19:40:40.000 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T19:40:40.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.195+0000 7f1ab32c6640 1 Processor -- start 2023-10-16T19:40:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.195+0000 7f1ab32c6640 1 -- start start 2023-10-16T19:40:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.196+0000 7f1ab32c6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1aac153110 0x7f1aac159a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.196+0000 7f1ab32c6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac15cd30 con 0x7f1aac0c52e0 2023-10-16T19:40:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.196+0000 7f1ab32c6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0c78f0 con 0x7f1aac15d1c0 2023-10-16T19:40:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.196+0000 7f1ab32c6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0c6250 con 0x7f1aac153110 2023-10-16T19:40:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.198+0000 7f1ab0861640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1aac15d1c0 0x7f1aac0bc190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:57844/0 (socket says 172.21.15.57:57844) 2023-10-16T19:40:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.198+0000 7f1ab0861640 1 -- 172.21.15.57:0/729356520 learned_addr learned my addr 172.21.15.57:0/729356520 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:40.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.289+0000 7f1ab1062640 1 --2- 172.21.15.57:0/729356520 >> v2:172.21.15.57:3300/0 conn(0x7f1aac153110 0x7f1aac159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.302+0000 7f1ab1062640 1 -- 172.21.15.57:0/729356520 >> v1:172.21.15.110:6789/0 conn(0x7f1aac15d1c0 legacy=0x7f1aac0bc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.302+0000 7f1ab1062640 1 -- 172.21.15.57:0/729356520 >> v1:172.21.15.57:6789/0 conn(0x7f1aac0c52e0 legacy=0x7f1aac0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.302+0000 7f1ab1062640 1 -- 172.21.15.57:0/729356520 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0c5c90 con 0x7f1aac153110 2023-10-16T19:40:40.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.311+0000 7f1ab1062640 1 --2- 172.21.15.57:0/729356520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac153110 0x7f1aac159a10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80097a0 tx=0x7f1aa802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ab8a371f528004 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.444+0000 7f1aa3fff640 1 -- 172.21.15.57:0/729356520 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa802f810 con 0x7f1aac153110 2023-10-16T19:40:40.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.445+0000 7f1aa3fff640 1 -- 172.21.15.57:0/729356520 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa802f970 con 0x7f1aac153110 2023-10-16T19:40:40.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.445+0000 7f1aa3fff640 1 -- 172.21.15.57:0/729356520 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa802fd00 con 0x7f1aac153110 2023-10-16T19:40:40.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 -- 172.21.15.57:0/729356520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac153110 msgr2=0x7f1aac159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/729356520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac153110 0x7f1aac159a10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80097a0 tx=0x7f1aa802b9f0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 -- 172.21.15.57:0/729356520 shutdown_connections 2023-10-16T19:40:40.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/729356520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac153110 0x7f1aac159a10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 -- 172.21.15.57:0/729356520 >> 172.21.15.57:0/729356520 conn(0x7f1aac06c430 msgr2=0x7f1aac069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 -- 172.21.15.57:0/729356520 shutdown_connections 2023-10-16T19:40:40.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.446+0000 7f1ab32c6640 1 -- 172.21.15.57:0/729356520 wait complete. 2023-10-16T19:40:40.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.449+0000 7f1ab32c6640 1 Processor -- start 2023-10-16T19:40:40.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.449+0000 7f1ab32c6640 1 -- start start 2023-10-16T19:40:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.450+0000 7f1ab32c6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aac0c52e0 0x7f1aac15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.451+0000 7f1ab32c6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aac153110 0x7f1aac1eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.451+0000 7f1ab32c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 0x7f1aac1ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.451+0000 7f1ab32c6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac146ec0 con 0x7f1aac15d1c0 2023-10-16T19:40:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.451+0000 7f1ab32c6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac1ee6f0 con 0x7f1aac153110 2023-10-16T19:40:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.451+0000 7f1ab32c6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac15ad60 con 0x7f1aac0c52e0 2023-10-16T19:40:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.452+0000 7f1ab1863640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 0x7f1aac1ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.452+0000 7f1ab1863640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 0x7f1aac1ef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60422/0 (socket says 172.21.15.57:60422) 2023-10-16T19:40:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.452+0000 7f1ab1863640 1 -- 172.21.15.57:0/3771016219 learned_addr learned my addr 172.21.15.57:0/3771016219 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.459+0000 7f1ab1863640 1 -- 172.21.15.57:0/3771016219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aac0c52e0 msgr2=0x7f1aac15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.459+0000 7f1ab1863640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aac0c52e0 0x7f1aac15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.459+0000 7f1ab1863640 1 -- 172.21.15.57:0/3771016219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aac153110 msgr2=0x7f1aac1eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.459+0000 7f1ab1863640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aac153110 0x7f1aac1eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.459+0000 7f1ab1863640 1 -- 172.21.15.57:0/3771016219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa8009400 con 0x7f1aac15d1c0 2023-10-16T19:40:40.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.463+0000 7f1ab1863640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 0x7f1aac1ef040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c7d0 tx=0x7f1aa400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.475+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4003b70 con 0x7f1aac15d1c0 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.475+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4003cd0 con 0x7f1aac15d1c0 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.475+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400aa90 con 0x7f1aac15d1c0 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.475+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac146990 con 0x7f1aac15d1c0 2023-10-16T19:40:40.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.475+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac15a550 con 0x7f1aac15d1c0 2023-10-16T19:40:40.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.477+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac04e1d0 con 0x7f1aac15d1c0 2023-10-16T19:40:40.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.887+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f1aa400abf0 con 0x7f1aac15d1c0 2023-10-16T19:40:40.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.888+0000 7f1aa1ffb640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1a9006ae60 0x7f1a9006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.889+0000 7f1ab1062640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1a9006ae60 0x7f1a9006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.889+0000 7f1ab1062640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1a9006ae60 0x7f1a9006d320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8036000 tx=0x7f1aa8039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.903+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f1aa4059340 con 0x7f1aac15d1c0 2023-10-16T19:40:40.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:40.905+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1aa4054f80 con 0x7f1aac15d1c0 2023-10-16T19:40:41.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.126+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aac15c990 con 0x7f1aac15d1c0 2023-10-16T19:40:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.249+0000 7f1aa1ffb640 1 -- 172.21.15.57:0/3771016219 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12704 (secure 0 0 0) 0x7f1aa40585a0 con 0x7f1aac15d1c0 2023-10-16T19:40:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:41.251 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:40:38.554307+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1a9006ae60 msgr2=0x7f1a9006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1a9006ae60 0x7f1a9006d320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8036000 tx=0x7f1aa8039040 comp rx=0 tx=0).stop 2023-10-16T19:40:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 msgr2=0x7f1aac1ef040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 0x7f1aac1ef040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c7d0 tx=0x7f1aa400cc90 comp rx=0 tx=0).stop 2023-10-16T19:40:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 shutdown_connections 2023-10-16T19:40:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1a9006ae60 0x7f1a9006d320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1aac15d1c0 0x7f1aac1ef040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aac153110 0x7f1aac1eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 --2- 172.21.15.57:0/3771016219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aac0c52e0 0x7f1aac15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 >> 172.21.15.57:0/3771016219 conn(0x7f1aac06c430 msgr2=0x7f1aac069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 shutdown_connections 2023-10-16T19:40:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.252+0000 7f1ab32c6640 1 -- 172.21.15.57:0/3771016219 wait complete. 2023-10-16T19:40:41.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:40:38.255594+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:40:41.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.475+0000 7f115b0b4640 1 Processor -- start 2023-10-16T19:40:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.476+0000 7f115b0b4640 1 -- start start 2023-10-16T19:40:41.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.477+0000 7f115b0b4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f115406e130 0x7f115406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.477+0000 7f115b0b4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 0x7f11540c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.477+0000 7f115b0b4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1154157160 con 0x7f1154150fa0 2023-10-16T19:40:41.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.477+0000 7f115b0b4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11540c4f30 con 0x7f115406e130 2023-10-16T19:40:41.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.477+0000 7f115b0b4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c51f0 con 0x7f11540c3a40 2023-10-16T19:40:41.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.545+0000 7f1159651640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 0x7f11540c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.547+0000 7f1159651640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 0x7f11540c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45166/0 (socket says 172.21.15.57:45166) 2023-10-16T19:40:41.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.547+0000 7f1159651640 1 -- 172.21.15.57:0/1772078696 learned_addr learned my addr 172.21.15.57:0/1772078696 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:41.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.553+0000 7f1159651640 1 -- 172.21.15.57:0/1772078696 >> v2:172.21.15.110:3300/0 conn(0x7f115406e130 msgr2=0x7f115406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:41.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.553+0000 7f1159651640 1 --2- 172.21.15.57:0/1772078696 >> v2:172.21.15.110:3300/0 conn(0x7f115406e130 0x7f115406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.553+0000 7f1159651640 1 -- 172.21.15.57:0/1772078696 >> v1:172.21.15.110:6789/0 conn(0x7f1154150fa0 legacy=0x7f11541575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:41.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.553+0000 7f1159651640 1 -- 172.21.15.57:0/1772078696 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154156df0 con 0x7f11540c3a40 2023-10-16T19:40:41.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.557+0000 7f1159651640 1 --2- 172.21.15.57:0/1772078696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 0x7f11540c3ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f114c009e50 tx=0x7f114c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc03409f83051aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.562+0000 7f11537fe640 1 -- 172.21.15.57:0/1772078696 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c02cb00 con 0x7f11540c3a40 2023-10-16T19:40:41.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.563+0000 7f11537fe640 1 -- 172.21.15.57:0/1772078696 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c02cc60 con 0x7f11540c3a40 2023-10-16T19:40:41.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.563+0000 7f11537fe640 1 -- 172.21.15.57:0/1772078696 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0343f0 con 0x7f11540c3a40 2023-10-16T19:40:41.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 -- 172.21.15.57:0/1772078696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 msgr2=0x7f11540c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 --2- 172.21.15.57:0/1772078696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 0x7f11540c3ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f114c009e50 tx=0x7f114c02bf60 comp rx=0 tx=0).stop 2023-10-16T19:40:41.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 -- 172.21.15.57:0/1772078696 shutdown_connections 2023-10-16T19:40:41.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 --2- 172.21.15.57:0/1772078696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11540c3a40 0x7f11540c3ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 --2- 172.21.15.57:0/1772078696 >> v2:172.21.15.110:3300/0 conn(0x7f115406e130 0x7f115406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 -- 172.21.15.57:0/1772078696 >> 172.21.15.57:0/1772078696 conn(0x7f11540ca430 msgr2=0x7f11540ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 -- 172.21.15.57:0/1772078696 shutdown_connections 2023-10-16T19:40:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.564+0000 7f115b0b4640 1 -- 172.21.15.57:0/1772078696 wait complete. 2023-10-16T19:40:41.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.566+0000 7f115b0b4640 1 Processor -- start 2023-10-16T19:40:41.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.567+0000 7f115b0b4640 1 -- start start 2023-10-16T19:40:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.567+0000 7f115b0b4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 0x7f1154155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.567+0000 7f115b0b4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11540c3a40 0x7f1154158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.567+0000 7f115b0b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1154150fa0 0x7f1154158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.567+0000 7f115b0b4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541efd80 con 0x7f11540c3a40 2023-10-16T19:40:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.567+0000 7f115b0b4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541ef820 con 0x7f1154150fa0 2023-10-16T19:40:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.568+0000 7f115b0b4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11541efaa0 con 0x7f115406e130 2023-10-16T19:40:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.568+0000 7f1158e50640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 0x7f1154155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.568+0000 7f1153fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11540c3a40 0x7f1154158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.569+0000 7f1158e50640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 0x7f1154155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45182/0 (socket says 172.21.15.57:45182) 2023-10-16T19:40:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.569+0000 7f1158e50640 1 -- 172.21.15.57:0/2177662639 learned_addr learned my addr 172.21.15.57:0/2177662639 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:41.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.573+0000 7f1158e50640 1 -- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1154150fa0 msgr2=0x7f1154158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.573+0000 7f1158e50640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1154150fa0 0x7f1154158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.573+0000 7f1158e50640 1 -- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11540c3a40 msgr2=0x7f1154158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.573+0000 7f1158e50640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11540c3a40 0x7f1154158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.573+0000 7f1158e50640 1 -- 172.21.15.57:0/2177662639 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c009b30 con 0x7f115406e130 2023-10-16T19:40:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.576+0000 7f1158e50640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 0x7f1154155ab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f114800b3e0 tx=0x7f114800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.584+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148011830 con 0x7f115406e130 2023-10-16T19:40:41.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.584+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11480119b0 con 0x7f115406e130 2023-10-16T19:40:41.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.584+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148011d60 con 0x7f115406e130 2023-10-16T19:40:41.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.584+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1154156610 con 0x7f115406e130 2023-10-16T19:40:41.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.584+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11540c03d0 con 0x7f115406e130 2023-10-16T19:40:41.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.586+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11540c6140 con 0x7f115406e130 2023-10-16T19:40:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.908+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f114801a400 con 0x7f115406e130 2023-10-16T19:40:41.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.910+0000 7f11517fa640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f113806ae30 0x7f113806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.910+0000 7f1153fff640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f113806ae30 0x7f113806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.912+0000 7f1153fff640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f113806ae30 0x7f113806d2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11400098e0 tx=0x7f1140009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.913+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1148059100 con 0x7f115406e130 2023-10-16T19:40:41.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:41.932+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1148054d40 con 0x7f115406e130 2023-10-16T19:40:42.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.317+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f115415ab20 con 0x7f115406e130 2023-10-16T19:40:42.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.450+0000 7f11517fa640 1 -- 172.21.15.57:0/2177662639 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1148015020 con 0x7f115406e130 2023-10-16T19:40:42.452 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-16T19:40:42.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f113806ae30 msgr2=0x7f113806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f113806ae30 0x7f113806d2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11400098e0 tx=0x7f1140009060 comp rx=0 tx=0).stop 2023-10-16T19:40:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 msgr2=0x7f1154155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 0x7f1154155ab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f114800b3e0 tx=0x7f114800b8a0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 shutdown_connections 2023-10-16T19:40:42.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f113806ae30 0x7f113806d2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1154150fa0 0x7f1154158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11540c3a40 0x7f1154158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 --2- 172.21.15.57:0/2177662639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f115406e130 0x7f1154155ab0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f114800b3e0 tx=0x7f114800b8a0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.455+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 >> 172.21.15.57:0/2177662639 conn(0x7f11540ca430 msgr2=0x7f11540c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.456+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 shutdown_connections 2023-10-16T19:40:42.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.456+0000 7f115b0b4640 1 -- 172.21.15.57:0/2177662639 wait complete. 2023-10-16T19:40:42.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:42.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.712+0000 7fc73933c640 1 Processor -- start 2023-10-16T19:40:42.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.712+0000 7fc73933c640 1 -- start start 2023-10-16T19:40:42.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.714+0000 7fc73933c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc734151190 0x7fc7340c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.715+0000 7fc73933c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7340c12f0 0x7fc7340c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.715+0000 7fc73933c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc734151570 con 0x7fc73406d5d0 2023-10-16T19:40:42.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.715+0000 7fc73933c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340c4010 con 0x7fc734151190 2023-10-16T19:40:42.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.715+0000 7fc73933c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340c1ce0 con 0x7fc7340c12f0 2023-10-16T19:40:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.753+0000 7fc732ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc734151190 0x7fc7340c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.755+0000 7fc732ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc734151190 0x7fc7340c2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60440/0 (socket says 172.21.15.57:60440) 2023-10-16T19:40:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.755+0000 7fc732ffd640 1 -- 172.21.15.57:0/46193474 learned_addr learned my addr 172.21.15.57:0/46193474 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.768+0000 7fc732ffd640 1 -- 172.21.15.57:0/46193474 >> v2:172.21.15.110:3300/0 conn(0x7fc7340c12f0 msgr2=0x7fc7340c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.768+0000 7fc732ffd640 1 --2- 172.21.15.57:0/46193474 >> v2:172.21.15.110:3300/0 conn(0x7fc7340c12f0 0x7fc7340c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.768+0000 7fc732ffd640 1 -- 172.21.15.57:0/46193474 >> v1:172.21.15.110:6789/0 conn(0x7fc73406d5d0 legacy=0x7fc73406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.768+0000 7fc732ffd640 1 -- 172.21.15.57:0/46193474 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340c5530 con 0x7fc734151190 2023-10-16T19:40:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.771+0000 7fc732ffd640 1 --2- 172.21.15.57:0/46193474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc734151190 0x7fc7340c2560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc734072140 tx=0x7fc72402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1100e272de22a156 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.775+0000 7fc731ffb640 1 -- 172.21.15.57:0/46193474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724031870 con 0x7fc734151190 2023-10-16T19:40:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.778+0000 7fc731ffb640 1 -- 172.21.15.57:0/46193474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7240319d0 con 0x7fc734151190 2023-10-16T19:40:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.778+0000 7fc731ffb640 1 -- 172.21.15.57:0/46193474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724031d60 con 0x7fc734151190 2023-10-16T19:40:42.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.778+0000 7fc73933c640 1 -- 172.21.15.57:0/46193474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc734151190 msgr2=0x7fc7340c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.778+0000 7fc73933c640 1 --2- 172.21.15.57:0/46193474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc734151190 0x7fc7340c2560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc734072140 tx=0x7fc72402b910 comp rx=0 tx=0).stop 2023-10-16T19:40:42.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.779+0000 7fc73933c640 1 -- 172.21.15.57:0/46193474 shutdown_connections 2023-10-16T19:40:42.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.779+0000 7fc73933c640 1 --2- 172.21.15.57:0/46193474 >> v2:172.21.15.110:3300/0 conn(0x7fc7340c12f0 0x7fc7340c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.779+0000 7fc73933c640 1 --2- 172.21.15.57:0/46193474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc734151190 0x7fc7340c2560 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.779+0000 7fc73933c640 1 -- 172.21.15.57:0/46193474 >> 172.21.15.57:0/46193474 conn(0x7fc73406c430 msgr2=0x7fc734069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.779+0000 7fc73933c640 1 -- 172.21.15.57:0/46193474 shutdown_connections 2023-10-16T19:40:42.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.779+0000 7fc73933c640 1 -- 172.21.15.57:0/46193474 wait complete. 2023-10-16T19:40:42.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.782+0000 7fc73933c640 1 Processor -- start 2023-10-16T19:40:42.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.782+0000 7fc73933c640 1 -- start start 2023-10-16T19:40:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.784+0000 7fc73933c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc73406d5d0 0x7fc73414bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.785+0000 7fc73933c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7340c12f0 0x7fc73414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.786+0000 7fc73933c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc734151190 0x7fc7340ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.786+0000 7fc73933c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7341587f0 con 0x7fc7340c12f0 2023-10-16T19:40:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.786+0000 7fc73933c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73414f210 con 0x7fc73406d5d0 2023-10-16T19:40:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.786+0000 7fc73933c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73414f4f0 con 0x7fc734151190 2023-10-16T19:40:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.786+0000 7fc7327fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7340c12f0 0x7fc73414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.787+0000 7fc7327fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7340c12f0 0x7fc73414ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60450/0 (socket says 172.21.15.57:60450) 2023-10-16T19:40:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.787+0000 7fc7327fc640 1 -- 172.21.15.57:0/631075119 learned_addr learned my addr 172.21.15.57:0/631075119 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.789+0000 7fc7337fe640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc734151190 0x7fc7340ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.791+0000 7fc732ffd640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc73406d5d0 0x7fc73414bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.794+0000 7fc7337fe640 1 -- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc73406d5d0 msgr2=0x7fc73414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.794+0000 7fc7337fe640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc73406d5d0 0x7fc73414bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.795+0000 7fc7337fe640 1 -- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7340c12f0 msgr2=0x7fc73414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.795+0000 7fc7337fe640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7340c12f0 0x7fc73414ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.795+0000 7fc7337fe640 1 -- 172.21.15.57:0/631075119 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240094d0 con 0x7fc734151190 2023-10-16T19:40:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.801+0000 7fc7337fe640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc734151190 0x7fc7340ca080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00be20 tx=0x7fc72c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.811+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00ce70 con 0x7fc734151190 2023-10-16T19:40:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.811+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c014440 con 0x7fc734151190 2023-10-16T19:40:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.811+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0147f0 con 0x7fc734151190 2023-10-16T19:40:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.811+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73414f7d0 con 0x7fc734151190 2023-10-16T19:40:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.811+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7340c9b60 con 0x7fc734151190 2023-10-16T19:40:42.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:42.812+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7340c9d80 con 0x7fc734151190 2023-10-16T19:40:42.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:42.991 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:43.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.102+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc72c003970 con 0x7fc734151190 2023-10-16T19:40:43.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.104+0000 7fc71b7fe640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc72006ae60 0x7fc72006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.104+0000 7fc732ffd640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc72006ae60 0x7fc72006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.105+0000 7fc732ffd640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc72006ae60 0x7fc72006d320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc724036000 tx=0x7fc72403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.108+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc72c058300 con 0x7fc734151190 2023-10-16T19:40:43.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.122+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc72c0580d0 con 0x7fc734151190 2023-10-16T19:40:43.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.385+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc73404e1d0 con 0x7fc734151190 2023-10-16T19:40:43.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.411+0000 7fc71b7fe640 1 -- 172.21.15.57:0/631075119 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fc72c019020 con 0x7fc734151190 2023-10-16T19:40:43.414 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:43.414 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-16T19:40:43.415 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 1 2023-10-16T19:40:43.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc72006ae60 msgr2=0x7fc72006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc72006ae60 0x7fc72006d320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc724036000 tx=0x7fc72403c040 comp rx=0 tx=0).stop 2023-10-16T19:40:43.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc734151190 msgr2=0x7fc7340ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc734151190 0x7fc7340ca080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00be20 tx=0x7fc72c00bf10 comp rx=0 tx=0).stop 2023-10-16T19:40:43.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 shutdown_connections 2023-10-16T19:40:43.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc72006ae60 0x7fc72006d320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc734151190 0x7fc7340ca080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7340c12f0 0x7fc73414ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 --2- 172.21.15.57:0/631075119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc73406d5d0 0x7fc73414bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 >> 172.21.15.57:0/631075119 conn(0x7fc73406c430 msgr2=0x7fc73414cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 shutdown_connections 2023-10-16T19:40:43.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:43.414+0000 7fc73933c640 1 -- 172.21.15.57:0/631075119 wait complete. 2023-10-16T19:40:45.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.717+0000 7f0567539640 1 Processor -- start 2023-10-16T19:40:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.719+0000 7f0567539640 1 -- start start 2023-10-16T19:40:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.721+0000 7f0567539640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05600c5930 0x7f05601571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.721+0000 7f0567539640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f0560157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.721+0000 7f0567539640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05601618b0 con 0x7f05600c5550 2023-10-16T19:40:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.721+0000 7f0567539640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0560160d30 con 0x7f05600c5930 2023-10-16T19:40:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.721+0000 7f0567539640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0560161010 con 0x7f056006fe70 2023-10-16T19:40:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.722+0000 7f0565ad6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f0560157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.723+0000 7f0565ad6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f0560157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45218/0 (socket says 172.21.15.57:45218) 2023-10-16T19:40:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.723+0000 7f0565ad6640 1 -- 172.21.15.57:0/1005845312 learned_addr learned my addr 172.21.15.57:0/1005845312 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.726+0000 7f0565ad6640 1 -- 172.21.15.57:0/1005845312 >> v2:172.21.15.57:3300/0 conn(0x7f05600c5930 msgr2=0x7f05601571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.726+0000 7f0565ad6640 1 --2- 172.21.15.57:0/1005845312 >> v2:172.21.15.57:3300/0 conn(0x7f05600c5930 0x7f05601571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.726+0000 7f0565ad6640 1 -- 172.21.15.57:0/1005845312 >> v1:172.21.15.57:6789/0 conn(0x7f05600c5550 legacy=0x7f056015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.726+0000 7f0565ad6640 1 -- 172.21.15.57:0/1005845312 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05601612f0 con 0x7f056006fe70 2023-10-16T19:40:45.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.729+0000 7f0565ad6640 1 --2- 172.21.15.57:0/1005845312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f0560157700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0558009e50 tx=0x7f055802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ec17db2875418c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.734+0000 7f0553fff640 1 -- 172.21.15.57:0/1005845312 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055802ca80 con 0x7f056006fe70 2023-10-16T19:40:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.734+0000 7f0553fff640 1 -- 172.21.15.57:0/1005845312 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055802cbe0 con 0x7f056006fe70 2023-10-16T19:40:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.734+0000 7f0553fff640 1 -- 172.21.15.57:0/1005845312 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580343f0 con 0x7f056006fe70 2023-10-16T19:40:45.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 -- 172.21.15.57:0/1005845312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 msgr2=0x7f0560157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 --2- 172.21.15.57:0/1005845312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f0560157700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0558009e50 tx=0x7f055802bee0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 -- 172.21.15.57:0/1005845312 shutdown_connections 2023-10-16T19:40:45.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 --2- 172.21.15.57:0/1005845312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f0560157700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 --2- 172.21.15.57:0/1005845312 >> v2:172.21.15.57:3300/0 conn(0x7f05600c5930 0x7f05601571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 -- 172.21.15.57:0/1005845312 >> 172.21.15.57:0/1005845312 conn(0x7f056006c430 msgr2=0x7f0560069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 -- 172.21.15.57:0/1005845312 shutdown_connections 2023-10-16T19:40:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.735+0000 7f0567539640 1 -- 172.21.15.57:0/1005845312 wait complete. 2023-10-16T19:40:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.738+0000 7f0567539640 1 Processor -- start 2023-10-16T19:40:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.738+0000 7f0567539640 1 -- start start 2023-10-16T19:40:45.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f0567539640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f05600cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f0567539640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05600c5550 0x7f05600c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f0567539640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05600c5930 0x7f05601516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f0567539640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601f2c70 con 0x7f05600c5930 2023-10-16T19:40:45.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f0567539640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c4b10 con 0x7f05600c5550 2023-10-16T19:40:45.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f0567539640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05601f3100 con 0x7f056006fe70 2023-10-16T19:40:45.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.740+0000 7f05652d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f05600cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.741+0000 7f05652d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f05600cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45222/0 (socket says 172.21.15.57:45222) 2023-10-16T19:40:45.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.741+0000 7f05652d5640 1 -- 172.21.15.57:0/3164637587 learned_addr learned my addr 172.21.15.57:0/3164637587 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:45.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.741+0000 7f0564ad4640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05600c5550 0x7f05600c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.745+0000 7f05652d5640 1 -- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05600c5550 msgr2=0x7f05600c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.745+0000 7f05652d5640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05600c5550 0x7f05600c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.745+0000 7f05652d5640 1 -- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05600c5930 msgr2=0x7f05601516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.745+0000 7f05652d5640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05600c5930 0x7f05601516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.745+0000 7f05652d5640 1 -- 172.21.15.57:0/3164637587 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558009b30 con 0x7f056006fe70 2023-10-16T19:40:45.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.748+0000 7f05652d5640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f05600cac10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f055400c410 tx=0x7f055400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.752+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540035f0 con 0x7f056006fe70 2023-10-16T19:40:45.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.752+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554003750 con 0x7f056006fe70 2023-10-16T19:40:45.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.752+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554003b40 con 0x7f056006fe70 2023-10-16T19:40:45.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.753+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05600c4830 con 0x7f056006fe70 2023-10-16T19:40:45.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.753+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05601f2620 con 0x7f056006fe70 2023-10-16T19:40:45.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:45.754+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056004e1d0 con 0x7f056006fe70 2023-10-16T19:40:46.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.038+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0554003ca0 con 0x7f056006fe70 2023-10-16T19:40:46.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.040+0000 7f0551ffb640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f054406aec0 0x7f054406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.040+0000 7f0564ad4640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f054406aec0 0x7f054406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.042+0000 7f0564ad4640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f054406aec0 0x7f054406d380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0560070a20 tx=0x7f055c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.045+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05540010c0 con 0x7f056006fe70 2023-10-16T19:40:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.064+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0554054260 con 0x7f056006fe70 2023-10-16T19:40:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.298+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f056015d140 con 0x7f056006fe70 2023-10-16T19:40:46.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.573+0000 7f0551ffb640 1 -- 172.21.15.57:0/3164637587 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f0554017030 con 0x7f056006fe70 2023-10-16T19:40:46.576 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:46.576 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-16T19:40:46.576 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 1 2023-10-16T19:40:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f054406aec0 msgr2=0x7f054406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f054406aec0 0x7f054406d380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0560070a20 tx=0x7f055c009060 comp rx=0 tx=0).stop 2023-10-16T19:40:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 msgr2=0x7f05600cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f05600cac10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f055400c410 tx=0x7f055400c8d0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 shutdown_connections 2023-10-16T19:40:46.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f054406aec0 0x7f054406d380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05600c5930 0x7f05601516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05600c5550 0x7f05600c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 --2- 172.21.15.57:0/3164637587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056006fe70 0x7f05600cac10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.577+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 >> 172.21.15.57:0/3164637587 conn(0x7f056006c430 msgr2=0x7f05600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.578+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 shutdown_connections 2023-10-16T19:40:46.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:46.578+0000 7f0567539640 1 -- 172.21.15.57:0/3164637587 wait complete. 2023-10-16T19:40:47.408 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-10-16T19:40:47.427 INFO:tasks.ceph.mds.f.smithi110.stdout:starting mds.f at 2023-10-16T19:40:47.474 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-10-16T19:40:47.527 INFO:tasks.ceph.mds.e.smithi057.stdout:starting mds.e at 2023-10-16T19:40:47.548 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-16T19:40:47.724 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-16T19:40:48.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:48.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.823+0000 7f49de5ff640 1 Processor -- start 2023-10-16T19:40:48.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.823+0000 7f49de5ff640 1 -- start start 2023-10-16T19:40:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.825+0000 7f49de5ff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49d8153240 0x7f49d80c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.825+0000 7f49de5ff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.825+0000 7f49de5ff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d806bbe0 con 0x7f49d80c68a0 2023-10-16T19:40:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.825+0000 7f49de5ff640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d8159990 con 0x7f49d8153240 2023-10-16T19:40:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.825+0000 7f49de5ff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80701d0 con 0x7f49d806e070 2023-10-16T19:40:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.827+0000 7f49dddfe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.828+0000 7f49dddfe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8070f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:55234/0 (socket says 172.21.15.57:55234) 2023-10-16T19:40:48.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.828+0000 7f49dddfe640 1 -- 172.21.15.57:0/455755982 learned_addr learned my addr 172.21.15.57:0/455755982 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:48.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.829+0000 7f49dd5fd640 1 --2- 172.21.15.57:0/455755982 >> v2:172.21.15.57:3300/0 conn(0x7f49d8153240 0x7f49d80c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.834+0000 7f49dddfe640 1 -- 172.21.15.57:0/455755982 >> v2:172.21.15.57:3300/0 conn(0x7f49d8153240 msgr2=0x7f49d80c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.834+0000 7f49dddfe640 1 --2- 172.21.15.57:0/455755982 >> v2:172.21.15.57:3300/0 conn(0x7f49d8153240 0x7f49d80c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.834+0000 7f49dddfe640 1 -- 172.21.15.57:0/455755982 >> v1:172.21.15.57:6789/0 conn(0x7f49d80c68a0 legacy=0x7f49d815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.835+0000 7f49dddfe640 1 -- 172.21.15.57:0/455755982 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80704b0 con 0x7f49d806e070 2023-10-16T19:40:48.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.841+0000 7f49dddfe640 1 --2- 172.21.15.57:0/455755982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8070f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009e50 tx=0x7f49d002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5ff1f4808ece3b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.852+0000 7f49cffff640 1 -- 172.21.15.57:0/455755982 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d002cb90 con 0x7f49d806e070 2023-10-16T19:40:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.853+0000 7f49cffff640 1 -- 172.21.15.57:0/455755982 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d002ccf0 con 0x7f49d806e070 2023-10-16T19:40:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.853+0000 7f49cffff640 1 -- 172.21.15.57:0/455755982 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0034610 con 0x7f49d806e070 2023-10-16T19:40:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 -- 172.21.15.57:0/455755982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 msgr2=0x7f49d8070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 --2- 172.21.15.57:0/455755982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8070f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009e50 tx=0x7f49d002bff0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 -- 172.21.15.57:0/455755982 shutdown_connections 2023-10-16T19:40:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 --2- 172.21.15.57:0/455755982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8070f90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 --2- 172.21.15.57:0/455755982 >> v2:172.21.15.57:3300/0 conn(0x7f49d8153240 0x7f49d80c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 -- 172.21.15.57:0/455755982 >> 172.21.15.57:0/455755982 conn(0x7f49d80c6f00 msgr2=0x7f49d80c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 -- 172.21.15.57:0/455755982 shutdown_connections 2023-10-16T19:40:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.854+0000 7f49de5ff640 1 -- 172.21.15.57:0/455755982 wait complete. 2023-10-16T19:40:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.858+0000 7f49de5ff640 1 Processor -- start 2023-10-16T19:40:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.858+0000 7f49de5ff640 1 -- start start 2023-10-16T19:40:48.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.860+0000 7f49de5ff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.860+0000 7f49de5ff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49d80c68a0 0x7f49d814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.860+0000 7f49de5ff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8153240 0x7f49d81503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.860+0000 7f49de5ff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d814f9d0 con 0x7f49d80c68a0 2023-10-16T19:40:48.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.860+0000 7f49de5ff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d814ee00 con 0x7f49d8153240 2023-10-16T19:40:48.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.860+0000 7f49de5ff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d814f0a0 con 0x7f49d806e070 2023-10-16T19:40:48.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.862+0000 7f49dd5fd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.863+0000 7f49dd5fd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:55250/0 (socket says 172.21.15.57:55250) 2023-10-16T19:40:48.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.863+0000 7f49dd5fd640 1 -- 172.21.15.57:0/140382179 learned_addr learned my addr 172.21.15.57:0/140382179 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:48.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.873+0000 7f49dd5fd640 1 -- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8153240 msgr2=0x7f49d81503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.873+0000 7f49dd5fd640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8153240 0x7f49d81503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.873+0000 7f49dd5fd640 1 -- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49d80c68a0 msgr2=0x7f49d814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.873+0000 7f49dd5fd640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49d80c68a0 0x7f49d814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.873+0000 7f49dd5fd640 1 -- 172.21.15.57:0/140382179 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009b30 con 0x7f49d806e070 2023-10-16T19:40:48.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.881+0000 7f49dd5fd640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8148520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49d400d5f0 tx=0x7f49d400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.892+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40125f0 con 0x7f49d806e070 2023-10-16T19:40:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.893+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4012750 con 0x7f49d806e070 2023-10-16T19:40:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.893+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4012b00 con 0x7f49d806e070 2023-10-16T19:40:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.893+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d814f380 con 0x7f49d806e070 2023-10-16T19:40:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.893+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d8148bd0 con 0x7f49d806e070 2023-10-16T19:40:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:48.894+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d804e160 con 0x7f49d806e070 2023-10-16T19:40:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.308+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f49d4012c60 con 0x7f49d806e070 2023-10-16T19:40:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.311+0000 7f49cdffb640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f49bc06aef0 0x7f49bc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.311+0000 7f49dcdfc640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f49bc06aef0 0x7f49bc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.313+0000 7f49dcdfc640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f49bc06aef0 0x7f49bc06d3b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49c8000fd0 tx=0x7f49c8007950 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.318+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f49d4059970 con 0x7f49d806e070 2023-10-16T19:40:49.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.349+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49d40555b0 con 0x7f49d806e070 2023-10-16T19:40:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.663+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49d8071090 con 0x7f49d806e070 2023-10-16T19:40:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.963+0000 7f49cdffb640 1 -- 172.21.15.57:0/140382179 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5274 (secure 0 0 0) 0x7f49d4058bd0 con 0x7f49d806e070 2023-10-16T19:40:49.965 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:49.965 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T19:40:49.966 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2023-10-16T19:40:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f49bc06aef0 msgr2=0x7f49bc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f49bc06aef0 0x7f49bc06d3b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49c8000fd0 tx=0x7f49c8007950 comp rx=0 tx=0).stop 2023-10-16T19:40:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 msgr2=0x7f49d8148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8148520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49d400d5f0 tx=0x7f49d400dab0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 shutdown_connections 2023-10-16T19:40:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f49bc06aef0 0x7f49bc06d3b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8153240 0x7f49d81503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49d80c68a0 0x7f49d814fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 --2- 172.21.15.57:0/140382179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d806e070 0x7f49d8148520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 >> 172.21.15.57:0/140382179 conn(0x7f49d80c6f00 msgr2=0x7f49d814e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.966+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 shutdown_connections 2023-10-16T19:40:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:49.967+0000 7f49de5ff640 1 -- 172.21.15.57:0/140382179 wait complete. 2023-10-16T19:40:49.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:50.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.188+0000 7fde3f632640 1 Processor -- start 2023-10-16T19:40:50.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.188+0000 7fde3f632640 1 -- start start 2023-10-16T19:40:50.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.190+0000 7fde3f632640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde3814ff50 0x7fde380711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.190+0000 7fde3f632640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fde38071930 0x7fde380c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.190+0000 7fde3f632640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde38150330 con 0x7fde38071d80 2023-10-16T19:40:50.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.190+0000 7fde3f632640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde380c2b80 con 0x7fde3814ff50 2023-10-16T19:40:50.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.190+0000 7fde3f632640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde380c66d0 con 0x7fde38071930 2023-10-16T19:40:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.191+0000 7fde3d3ce640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde3814ff50 0x7fde380711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.191+0000 7fde3d3ce640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde3814ff50 0x7fde380711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48752/0 (socket says 172.21.15.57:48752) 2023-10-16T19:40:50.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.191+0000 7fde3d3ce640 1 -- 172.21.15.57:0/3315689023 learned_addr learned my addr 172.21.15.57:0/3315689023 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:50.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.192+0000 7fde3cbcd640 1 --2- 172.21.15.57:0/3315689023 >> v2:172.21.15.110:3300/0 conn(0x7fde38071930 0x7fde380c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.194+0000 7fde3d3ce640 1 -- 172.21.15.57:0/3315689023 >> v2:172.21.15.110:3300/0 conn(0x7fde38071930 msgr2=0x7fde380c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.194+0000 7fde3d3ce640 1 --2- 172.21.15.57:0/3315689023 >> v2:172.21.15.110:3300/0 conn(0x7fde38071930 0x7fde380c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.194+0000 7fde3d3ce640 1 -- 172.21.15.57:0/3315689023 >> v1:172.21.15.110:6789/0 conn(0x7fde38071d80 legacy=0x7fde38155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.194+0000 7fde3d3ce640 1 -- 172.21.15.57:0/3315689023 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3815a110 con 0x7fde3814ff50 2023-10-16T19:40:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.197+0000 7fde3d3ce640 1 --2- 172.21.15.57:0/3315689023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde3814ff50 0x7fde380711f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde380c8310 tx=0x7fde3402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f5c63c317da3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.201+0000 7fde2ffff640 1 -- 172.21.15.57:0/3315689023 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34030860 con 0x7fde3814ff50 2023-10-16T19:40:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.201+0000 7fde2ffff640 1 -- 172.21.15.57:0/3315689023 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde340309c0 con 0x7fde3814ff50 2023-10-16T19:40:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.201+0000 7fde2ffff640 1 -- 172.21.15.57:0/3315689023 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34030d50 con 0x7fde3814ff50 2023-10-16T19:40:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.202+0000 7fde3f632640 1 -- 172.21.15.57:0/3315689023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde3814ff50 msgr2=0x7fde380711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.202+0000 7fde3f632640 1 --2- 172.21.15.57:0/3315689023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde3814ff50 0x7fde380711f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde380c8310 tx=0x7fde3402b9a0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.203+0000 7fde3f632640 1 -- 172.21.15.57:0/3315689023 shutdown_connections 2023-10-16T19:40:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.203+0000 7fde3f632640 1 --2- 172.21.15.57:0/3315689023 >> v2:172.21.15.110:3300/0 conn(0x7fde38071930 0x7fde380c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.203+0000 7fde3f632640 1 --2- 172.21.15.57:0/3315689023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde3814ff50 0x7fde380711f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.203+0000 7fde3f632640 1 -- 172.21.15.57:0/3315689023 >> 172.21.15.57:0/3315689023 conn(0x7fde3806c430 msgr2=0x7fde38069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.203+0000 7fde3f632640 1 -- 172.21.15.57:0/3315689023 shutdown_connections 2023-10-16T19:40:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.203+0000 7fde3f632640 1 -- 172.21.15.57:0/3315689023 wait complete. 2023-10-16T19:40:50.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.204+0000 7fde3f632640 1 Processor -- start 2023-10-16T19:40:50.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.205+0000 7fde3f632640 1 -- start start 2023-10-16T19:40:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3f632640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde38071930 0x7fde381344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3f632640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde3814ff50 0x7fde381eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3f632640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 0x7fde381ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3f632640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde381ec820 con 0x7fde38134e10 2023-10-16T19:40:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3f632640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3813c450 con 0x7fde3814ff50 2023-10-16T19:40:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3f632640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3813bbb0 con 0x7fde38071930 2023-10-16T19:40:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.206+0000 7fde3dbcf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 0x7fde381ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.207+0000 7fde3dbcf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 0x7fde381ed1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48762/0 (socket says 172.21.15.57:48762) 2023-10-16T19:40:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.207+0000 7fde3dbcf640 1 -- 172.21.15.57:0/2696453432 learned_addr learned my addr 172.21.15.57:0/2696453432 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:50.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.207+0000 7fde3d3ce640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde38071930 0x7fde381344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.207+0000 7fde3cbcd640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde3814ff50 0x7fde381eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.211+0000 7fde3dbcf640 1 -- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde38071930 msgr2=0x7fde381344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.211+0000 7fde3dbcf640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde38071930 0x7fde381344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.211+0000 7fde3dbcf640 1 -- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde3814ff50 msgr2=0x7fde381eccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.211+0000 7fde3dbcf640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde3814ff50 0x7fde381eccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.211+0000 7fde3dbcf640 1 -- 172.21.15.57:0/2696453432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340094d0 con 0x7fde38134e10 2023-10-16T19:40:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.213+0000 7fde3dbcf640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 0x7fde381ed1f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde3000c780 tx=0x7fde3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.218+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30004b60 con 0x7fde38134e10 2023-10-16T19:40:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.218+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3000ce90 con 0x7fde38134e10 2023-10-16T19:40:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.218+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3000a850 con 0x7fde38134e10 2023-10-16T19:40:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.218+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3813be90 con 0x7fde38134e10 2023-10-16T19:40:50.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.219+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde38134a00 con 0x7fde38134e10 2023-10-16T19:40:50.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.220+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde38149fd0 con 0x7fde38134e10 2023-10-16T19:40:50.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.534+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde30006b50 con 0x7fde38134e10 2023-10-16T19:40:50.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.537+0000 7fde2dffb640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fde1c06aec0 0x7fde1c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.537+0000 7fde3d3ce640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fde1c06aec0 0x7fde1c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.539+0000 7fde3d3ce640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fde1c06aec0 0x7fde1c06d380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde34036000 tx=0x7fde34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.581+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde30058be0 con 0x7fde38134e10 2023-10-16T19:40:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.582+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde30054f20 con 0x7fde38134e10 2023-10-16T19:40:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.790+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde3804e1d0 con 0x7fde38134e10 2023-10-16T19:40:50.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.860+0000 7fde2dffb640 1 -- 172.21.15.57:0/2696453432 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fde30059e60 con 0x7fde38134e10 2023-10-16T19:40:50.863 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:50.863 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:40:42.438693+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:50.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.863+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fde1c06aec0 msgr2=0x7fde1c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.863+0000 7fde3f632640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fde1c06aec0 0x7fde1c06d380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde34036000 tx=0x7fde34008030 comp rx=0 tx=0).stop 2023-10-16T19:40:50.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.863+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 msgr2=0x7fde381ed1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.863+0000 7fde3f632640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 0x7fde381ed1f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde3000c780 tx=0x7fde3000cc40 comp rx=0 tx=0).stop 2023-10-16T19:40:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 shutdown_connections 2023-10-16T19:40:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fde1c06aec0 0x7fde1c06d380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde38134e10 0x7fde381ed1f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde3814ff50 0x7fde381eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 --2- 172.21.15.57:0/2696453432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde38071930 0x7fde381344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 >> 172.21.15.57:0/2696453432 conn(0x7fde3806c430 msgr2=0x7fde3813d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 shutdown_connections 2023-10-16T19:40:50.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:50.864+0000 7fde3f632640 1 -- 172.21.15.57:0/2696453432 wait complete. 2023-10-16T19:40:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:40:38.255594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:40:50.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:51.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.107+0000 7f9cc7fcc640 1 Processor -- start 2023-10-16T19:40:51.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.107+0000 7f9cc7fcc640 1 -- start start 2023-10-16T19:40:51.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.109+0000 7f9cc7fcc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9cc0150fa0 0x7f9cc006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.109+0000 7f9cc7fcc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 0x7f9cc00c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.109+0000 7f9cc7fcc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc0157160 con 0x7f9cc006e130 2023-10-16T19:40:51.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.109+0000 7f9cc7fcc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc00c4f30 con 0x7f9cc0150fa0 2023-10-16T19:40:51.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.109+0000 7f9cc7fcc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00c51f0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.111+0000 7f9cc6569640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 0x7f9cc00c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.111+0000 7f9cc5d68640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9cc0150fa0 0x7f9cc006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.111+0000 7f9cc6569640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 0x7f9cc00c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:55276/0 (socket says 172.21.15.57:55276) 2023-10-16T19:40:51.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.111+0000 7f9cc6569640 1 -- 172.21.15.57:0/4168746263 learned_addr learned my addr 172.21.15.57:0/4168746263 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:51.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.118+0000 7f9cc6569640 1 -- 172.21.15.57:0/4168746263 >> v2:172.21.15.110:3300/0 conn(0x7f9cc0150fa0 msgr2=0x7f9cc006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:51.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.118+0000 7f9cc6569640 1 --2- 172.21.15.57:0/4168746263 >> v2:172.21.15.110:3300/0 conn(0x7f9cc0150fa0 0x7f9cc006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.118+0000 7f9cc6569640 1 -- 172.21.15.57:0/4168746263 >> v1:172.21.15.110:6789/0 conn(0x7f9cc006e130 legacy=0x7f9cc01575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.118+0000 7f9cc6569640 1 -- 172.21.15.57:0/4168746263 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0156df0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.124+0000 7f9cc6569640 1 --2- 172.21.15.57:0/4168746263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 0x7f9cc00c3ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009e50 tx=0x7f9cb802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97973224308baea server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.130+0000 7f9cc4d66640 1 -- 172.21.15.57:0/4168746263 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb802cb90 con 0x7f9cc00c3a40 2023-10-16T19:40:51.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.135+0000 7f9cc4d66640 1 -- 172.21.15.57:0/4168746263 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb802ccf0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.135+0000 7f9cc4d66640 1 -- 172.21.15.57:0/4168746263 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8034610 con 0x7f9cc00c3a40 2023-10-16T19:40:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.135+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4168746263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 msgr2=0x7f9cc00c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.135+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4168746263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 0x7f9cc00c3ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009e50 tx=0x7f9cb802bff0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.136+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4168746263 shutdown_connections 2023-10-16T19:40:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.136+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4168746263 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc00c3a40 0x7f9cc00c3ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.136+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4168746263 >> v2:172.21.15.110:3300/0 conn(0x7f9cc0150fa0 0x7f9cc006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.136+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4168746263 >> 172.21.15.57:0/4168746263 conn(0x7f9cc00ca430 msgr2=0x7f9cc00ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.136+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4168746263 shutdown_connections 2023-10-16T19:40:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.136+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4168746263 wait complete. 2023-10-16T19:40:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.138+0000 7f9cc7fcc640 1 Processor -- start 2023-10-16T19:40:51.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.138+0000 7f9cc7fcc640 1 -- start start 2023-10-16T19:40:51.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.139+0000 7f9cc7fcc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc006e130 0x7f9cc00c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.139+0000 7f9cc7fcc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 0x7f9cc0069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.139+0000 7f9cc7fcc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc0150fa0 0x7f9cc006a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.139+0000 7f9cc7fcc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00c1eb0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.139+0000 7f9cc7fcc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00c18d0 con 0x7f9cc006e130 2023-10-16T19:40:51.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.139+0000 7f9cc7fcc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0141c90 con 0x7f9cc0150fa0 2023-10-16T19:40:51.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.140+0000 7f9cc5567640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 0x7f9cc0069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.140+0000 7f9cc5567640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 0x7f9cc0069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48770/0 (socket says 172.21.15.57:48770) 2023-10-16T19:40:51.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.140+0000 7f9cc5567640 1 -- 172.21.15.57:0/4014454161 learned_addr learned my addr 172.21.15.57:0/4014454161 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:51.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.141+0000 7f9cc5d68640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc006e130 0x7f9cc00c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.141+0000 7f9cc6569640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc0150fa0 0x7f9cc006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.145+0000 7f9cc5567640 1 -- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc0150fa0 msgr2=0x7f9cc006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.145+0000 7f9cc5567640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc0150fa0 0x7f9cc006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.145+0000 7f9cc5567640 1 -- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc006e130 msgr2=0x7f9cc00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.145+0000 7f9cc5567640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc006e130 0x7f9cc00c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.145+0000 7f9cc5567640 1 -- 172.21.15.57:0/4014454161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009b30 con 0x7f9cc00c3a40 2023-10-16T19:40:51.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.148+0000 7f9cc5567640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 0x7f9cc0069de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c400 tx=0x7f9cb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.154+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00052d0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.154+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0005430 con 0x7f9cc00c3a40 2023-10-16T19:40:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.154+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0003830 con 0x7f9cc00c3a40 2023-10-16T19:40:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.154+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc0154ae0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.155+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01545c0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.156+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc00c6140 con 0x7f9cc00c3a40 2023-10-16T19:40:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.199+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9cb0003990 con 0x7f9cc00c3a40 2023-10-16T19:40:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.201+0000 7f9cb67fc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9ca406aec0 0x7f9ca406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.202+0000 7f9cc5d68640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9ca406aec0 0x7f9ca406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.203+0000 7f9cc5d68640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9ca406aec0 0x7f9ca406d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009aa0 tx=0x7f9cbc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.541+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cb0057dd0 con 0x7f9cc00c3a40 2023-10-16T19:40:51.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.541+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cb0054110 con 0x7f9cc00c3a40 2023-10-16T19:40:51.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.752+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cc0070290 con 0x7f9cc00c3a40 2023-10-16T19:40:51.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.833+0000 7f9cb67fc640 1 -- 172.21.15.57:0/4014454161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cb0017020 con 0x7f9cc00c3a40 2023-10-16T19:40:51.835 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-16T19:40:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9ca406aec0 msgr2=0x7f9ca406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9ca406aec0 0x7f9ca406d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009aa0 tx=0x7f9cbc009190 comp rx=0 tx=0).stop 2023-10-16T19:40:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 msgr2=0x7f9cc0069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 0x7f9cc0069de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c400 tx=0x7f9cb000c8c0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 shutdown_connections 2023-10-16T19:40:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9ca406aec0 0x7f9ca406d380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cc0150fa0 0x7f9cc006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cc00c3a40 0x7f9cc0069de0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.837+0000 7f9cc7fcc640 1 --2- 172.21.15.57:0/4014454161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc006e130 0x7f9cc00c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.838+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 >> 172.21.15.57:0/4014454161 conn(0x7f9cc00ca430 msgr2=0x7f9cc00c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.838+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 shutdown_connections 2023-10-16T19:40:51.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:51.838+0000 7f9cc7fcc640 1 -- 172.21.15.57:0/4014454161 wait complete. 2023-10-16T19:40:51.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T19:40:52.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.075+0000 7fdc7e490640 1 Processor -- start 2023-10-16T19:40:52.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.076+0000 7fdc7e490640 1 -- start start 2023-10-16T19:40:52.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.078+0000 7fdc7e490640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc780c77c0 0x7fdc780c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.078+0000 7fdc7e490640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7806a7b0 con 0x7fdc780c7c10 2023-10-16T19:40:52.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.078+0000 7fdc7e490640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc78071db0 con 0x7fdc78150f50 2023-10-16T19:40:52.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.078+0000 7fdc7e490640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc78072090 con 0x7fdc780c77c0 2023-10-16T19:40:52.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.080+0000 7fdc77fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdc78150f50 0x7fdc78071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:36350/0 (socket says 172.21.15.57:36350) 2023-10-16T19:40:52.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.080+0000 7fdc77fff640 1 -- 172.21.15.57:0/752153598 learned_addr learned my addr 172.21.15.57:0/752153598 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:52.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.081+0000 7fdc777fe640 1 --2- 172.21.15.57:0/752153598 >> v2:172.21.15.110:3300/0 conn(0x7fdc780c77c0 0x7fdc780c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.090+0000 7fdc777fe640 1 -- 172.21.15.57:0/752153598 >> v1:172.21.15.110:6789/0 conn(0x7fdc78150f50 legacy=0x7fdc78071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.090+0000 7fdc777fe640 1 -- 172.21.15.57:0/752153598 >> v1:172.21.15.57:6789/0 conn(0x7fdc780c7c10 legacy=0x7fdc78156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.090+0000 7fdc777fe640 1 -- 172.21.15.57:0/752153598 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc78069e80 con 0x7fdc780c77c0 2023-10-16T19:40:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.101+0000 7fdc777fe640 1 --2- 172.21.15.57:0/752153598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc780c4c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0097a0 tx=0x7fdc6c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2420ad752bf0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.112+0000 7fdc76ffd640 1 -- 172.21.15.57:0/752153598 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c030610 con 0x7fdc780c77c0 2023-10-16T19:40:52.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.112+0000 7fdc76ffd640 1 -- 172.21.15.57:0/752153598 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c030770 con 0x7fdc780c77c0 2023-10-16T19:40:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.112+0000 7fdc76ffd640 1 -- 172.21.15.57:0/752153598 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c030b00 con 0x7fdc780c77c0 2023-10-16T19:40:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.113+0000 7fdc7e490640 1 -- 172.21.15.57:0/752153598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 msgr2=0x7fdc780c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.113+0000 7fdc7e490640 1 --2- 172.21.15.57:0/752153598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc780c4c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0097a0 tx=0x7fdc6c02b960 comp rx=0 tx=0).stop 2023-10-16T19:40:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.114+0000 7fdc7e490640 1 -- 172.21.15.57:0/752153598 shutdown_connections 2023-10-16T19:40:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.114+0000 7fdc7e490640 1 --2- 172.21.15.57:0/752153598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc780c4c40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.114+0000 7fdc7e490640 1 -- 172.21.15.57:0/752153598 >> 172.21.15.57:0/752153598 conn(0x7fdc7806e970 msgr2=0x7fdc7806ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.114+0000 7fdc7e490640 1 -- 172.21.15.57:0/752153598 shutdown_connections 2023-10-16T19:40:52.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.114+0000 7fdc7e490640 1 -- 172.21.15.57:0/752153598 wait complete. 2023-10-16T19:40:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.117+0000 7fdc7e490640 1 Processor -- start 2023-10-16T19:40:52.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.117+0000 7fdc7e490640 1 -- start start 2023-10-16T19:40:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.119+0000 7fdc7e490640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc7814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.119+0000 7fdc7e490640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc780c7c10 0x7fdc781464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.119+0000 7fdc7e490640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc78150f50 0x7fdc78150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.119+0000 7fdc7e490640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780c3f10 con 0x7fdc78150f50 2023-10-16T19:40:52.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.119+0000 7fdc7e490640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7814fba0 con 0x7fdc780c77c0 2023-10-16T19:40:52.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.119+0000 7fdc7e490640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7814ae60 con 0x7fdc780c7c10 2023-10-16T19:40:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.120+0000 7fdc77fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc7814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.120+0000 7fdc777fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc780c7c10 0x7fdc781464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.121+0000 7fdc77fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc7814a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:45180/0 (socket says 172.21.15.57:45180) 2023-10-16T19:40:52.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.121+0000 7fdc77fff640 1 -- 172.21.15.57:0/2578892236 learned_addr learned my addr 172.21.15.57:0/2578892236 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.130+0000 7fdc77fff640 1 -- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc780c7c10 msgr2=0x7fdc781464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.130+0000 7fdc77fff640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc780c7c10 0x7fdc781464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.130+0000 7fdc77fff640 1 -- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc78150f50 msgr2=0x7fdc78150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.130+0000 7fdc77fff640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc78150f50 0x7fdc78150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.130+0000 7fdc77fff640 1 -- 172.21.15.57:0/2578892236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009400 con 0x7fdc780c77c0 2023-10-16T19:40:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.138+0000 7fdc77fff640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc7814a920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c4b0 tx=0x7fdc6800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.151+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68005ce0 con 0x7fdc780c77c0 2023-10-16T19:40:52.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.151+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc68005e40 con 0x7fdc780c77c0 2023-10-16T19:40:52.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.151+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68007270 con 0x7fdc780c77c0 2023-10-16T19:40:52.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.151+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc780c4160 con 0x7fdc780c77c0 2023-10-16T19:40:52.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.151+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc780c4720 con 0x7fdc780c77c0 2023-10-16T19:40:52.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.153+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7804e1d0 con 0x7fdc780c77c0 2023-10-16T19:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.575+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdc680073d0 con 0x7fdc780c77c0 2023-10-16T19:40:52.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.578+0000 7fdc74ff9640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdc6406aec0 0x7fdc6406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.579+0000 7fdc777fe640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdc6406aec0 0x7fdc6406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.581+0000 7fdc777fe640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdc6406aec0 0x7fdc6406d380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c036000 tx=0x7fdc6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.589+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc68057d90 con 0x7fdc780c77c0 2023-10-16T19:40:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.622+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc680540d0 con 0x7fdc780c77c0 2023-10-16T19:40:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.839+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc781546d0 con 0x7fdc780c77c0 2023-10-16T19:40:52.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.911+0000 7fdc74ff9640 1 -- 172.21.15.57:0/2578892236 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdc680576f0 con 0x7fdc780c77c0 2023-10-16T19:40:52.913 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:40:52.914 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-10-16T19:40:52.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-16T19:40:52.914 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-10-16T19:40:52.914 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-10-16T19:40:52.915 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-16T19:40:52.915 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-10-16T19:40:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdc6406aec0 msgr2=0x7fdc6406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdc6406aec0 0x7fdc6406d380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c036000 tx=0x7fdc6c008030 comp rx=0 tx=0).stop 2023-10-16T19:40:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 msgr2=0x7fdc7814a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc7814a920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c4b0 tx=0x7fdc6800c970 comp rx=0 tx=0).stop 2023-10-16T19:40:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 shutdown_connections 2023-10-16T19:40:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdc6406aec0 0x7fdc6406d380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc78150f50 0x7fdc78150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc780c7c10 0x7fdc781464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 --2- 172.21.15.57:0/2578892236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc780c77c0 0x7fdc7814a920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 >> 172.21.15.57:0/2578892236 conn(0x7fdc7806e970 msgr2=0x7fdc78157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.916+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 shutdown_connections 2023-10-16T19:40:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:52.917+0000 7fdc7e490640 1 -- 172.21.15.57:0/2578892236 wait complete. 2023-10-16T19:40:52.940 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T19:40:52.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T19:40:53.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.161+0000 7f732759e640 1 Processor -- start 2023-10-16T19:40:53.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.161+0000 7f732759e640 1 -- start start 2023-10-16T19:40:53.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.162+0000 7f732759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f7328158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.162+0000 7f732759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73280cec30 0x7f73280c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.162+0000 7f732759e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280c66e0 con 0x7f7328152d80 2023-10-16T19:40:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.162+0000 7f732759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280c69c0 con 0x7f73280cec30 2023-10-16T19:40:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.162+0000 7f732759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c6ca0 con 0x7f73280ce850 2023-10-16T19:40:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.164+0000 7f732659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f7328158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.165+0000 7f732659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f7328158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:55298/0 (socket says 172.21.15.57:55298) 2023-10-16T19:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.165+0000 7f732659c640 1 -- 172.21.15.57:0/2700526391 learned_addr learned my addr 172.21.15.57:0/2700526391 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.165+0000 7f7325d9b640 1 --2- 172.21.15.57:0/2700526391 >> v2:172.21.15.110:3300/0 conn(0x7f73280cec30 0x7f73280c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.171+0000 7f732659c640 1 -- 172.21.15.57:0/2700526391 >> v2:172.21.15.110:3300/0 conn(0x7f73280cec30 msgr2=0x7f73280c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.171+0000 7f732659c640 1 --2- 172.21.15.57:0/2700526391 >> v2:172.21.15.110:3300/0 conn(0x7f73280cec30 0x7f73280c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.171+0000 7f732659c640 1 -- 172.21.15.57:0/2700526391 >> v1:172.21.15.110:6789/0 conn(0x7f7328152d80 legacy=0x7f732815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.171+0000 7f732659c640 1 -- 172.21.15.57:0/2700526391 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280c6f80 con 0x7f73280ce850 2023-10-16T19:40:53.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.177+0000 7f732659c640 1 --2- 172.21.15.57:0/2700526391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f7328158ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7318009e50 tx=0x7f731802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9816a5eb904ead server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.188+0000 7f732559a640 1 -- 172.21.15.57:0/2700526391 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731802cb90 con 0x7f73280ce850 2023-10-16T19:40:53.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.188+0000 7f732559a640 1 -- 172.21.15.57:0/2700526391 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731802ccf0 con 0x7f73280ce850 2023-10-16T19:40:53.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.188+0000 7f732559a640 1 -- 172.21.15.57:0/2700526391 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318034610 con 0x7f73280ce850 2023-10-16T19:40:53.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 -- 172.21.15.57:0/2700526391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 msgr2=0x7f7328158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 --2- 172.21.15.57:0/2700526391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f7328158ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7318009e50 tx=0x7f731802bff0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 -- 172.21.15.57:0/2700526391 shutdown_connections 2023-10-16T19:40:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 --2- 172.21.15.57:0/2700526391 >> v2:172.21.15.110:3300/0 conn(0x7f73280cec30 0x7f73280c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 --2- 172.21.15.57:0/2700526391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f7328158ec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 -- 172.21.15.57:0/2700526391 >> 172.21.15.57:0/2700526391 conn(0x7f732806c920 msgr2=0x7f732806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 -- 172.21.15.57:0/2700526391 shutdown_connections 2023-10-16T19:40:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.189+0000 7f732759e640 1 -- 172.21.15.57:0/2700526391 wait complete. 2023-10-16T19:40:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.191+0000 7f732759e640 1 Processor -- start 2023-10-16T19:40:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.191+0000 7f732759e640 1 -- start start 2023-10-16T19:40:53.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.192+0000 7f732759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f73280b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.193+0000 7f732759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73280cec30 0x7f73280b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.193+0000 7f732759e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 0x7f73281efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.193+0000 7f732759e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328152270 con 0x7f7328152d80 2023-10-16T19:40:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.193+0000 7f732759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c1af0 con 0x7f73280cec30 2023-10-16T19:40:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.193+0000 7f732759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c1dd0 con 0x7f73280ce850 2023-10-16T19:40:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.194+0000 7f7326d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 0x7f73281efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.194+0000 7f7326d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 0x7f73281efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48792/0 (socket says 172.21.15.57:48792) 2023-10-16T19:40:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.194+0000 7f7326d9d640 1 -- 172.21.15.57:0/550903934 learned_addr learned my addr 172.21.15.57:0/550903934 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.194+0000 7f732659c640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f73280b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.194+0000 7f7325d9b640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73280cec30 0x7f73280b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.199+0000 7f7326d9d640 1 -- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 msgr2=0x7f73280b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.199+0000 7f7326d9d640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f73280b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.199+0000 7f7326d9d640 1 -- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73280cec30 msgr2=0x7f73280b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.199+0000 7f7326d9d640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73280cec30 0x7f73280b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.199+0000 7f7326d9d640 1 -- 172.21.15.57:0/550903934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009b30 con 0x7f7328152d80 2023-10-16T19:40:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.202+0000 7f7326d9d640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 0x7f73281efb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f732000c390 tx=0x7f732000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.208+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200052d0 con 0x7f7328152d80 2023-10-16T19:40:53.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.208+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320005430 con 0x7f7328152d80 2023-10-16T19:40:53.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.208+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320003810 con 0x7f7328152d80 2023-10-16T19:40:53.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.209+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73281eea80 con 0x7f7328152d80 2023-10-16T19:40:53.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.209+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73281ef5f0 con 0x7f7328152d80 2023-10-16T19:40:53.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.210+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73281eefa0 con 0x7f7328152d80 2023-10-16T19:40:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.262+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7320003970 con 0x7f7328152d80 2023-10-16T19:40:53.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.264+0000 7f7316ffd640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f730806aec0 0x7f730806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.265+0000 7f732659c640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f730806aec0 0x7f730806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.267+0000 7f732659c640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f730806aec0 0x7f730806d380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7318035000 tx=0x7f7318030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.270+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7320057b50 con 0x7f7328152d80 2023-10-16T19:40:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.590+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7320053e90 con 0x7f7328152d80 2023-10-16T19:40:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:53.840+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f73281ef810 con 0x7f7328152d80 2023-10-16T19:40:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.176+0000 7f7316ffd640 1 -- 172.21.15.57:0/550903934 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f73200574b0 con 0x7f7328152d80 2023-10-16T19:40:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-10-16T19:40:55.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.179+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f730806aec0 msgr2=0x7f730806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.179+0000 7f732759e640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f730806aec0 0x7f730806d380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7318035000 tx=0x7f7318030000 comp rx=0 tx=0).stop 2023-10-16T19:40:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 msgr2=0x7f73281efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 0x7f73281efb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f732000c390 tx=0x7f732000c850 comp rx=0 tx=0).stop 2023-10-16T19:40:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 shutdown_connections 2023-10-16T19:40:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f730806aec0 0x7f730806d380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7328152d80 0x7f73281efb10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73280cec30 0x7f73280b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 --2- 172.21.15.57:0/550903934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73280ce850 0x7f73280b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 >> 172.21.15.57:0/550903934 conn(0x7f732806c920 msgr2=0x7f7328158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 shutdown_connections 2023-10-16T19:40:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.180+0000 7f732759e640 1 -- 172.21.15.57:0/550903934 wait complete. 2023-10-16T19:40:55.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T19:40:55.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.447+0000 7fd86f797640 1 Processor -- start 2023-10-16T19:40:55.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.447+0000 7fd86f797640 1 -- start start 2023-10-16T19:40:55.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.449+0000 7fd86f797640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8680c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.449+0000 7fd86f797640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86806aa30 con 0x7fd86806a1c0 2023-10-16T19:40:55.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.449+0000 7fd86f797640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8680705f0 con 0x7fd868069de0 2023-10-16T19:40:55.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.449+0000 7fd86f797640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd868158df0 con 0x7fd868159930 2023-10-16T19:40:55.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.450+0000 7fd86cd32640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd86806a1c0 0x7fd868159220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47448/0 (socket says 172.21.15.57:47448) 2023-10-16T19:40:55.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.450+0000 7fd86cd32640 1 -- 172.21.15.57:0/2006450207 learned_addr learned my addr 172.21.15.57:0/2006450207 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:55.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.451+0000 7fd86dd34640 1 --2- 172.21.15.57:0/2006450207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8680c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.453+0000 7fd85ffff640 1 -- 172.21.15.57:0/2006450207 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293869813 0 0) 0x7fd858001110 con 0x7fd86806a1c0 2023-10-16T19:40:55.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.453+0000 7fd85ffff640 1 -- 172.21.15.57:0/2006450207 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd854003520 con 0x7fd86806a1c0 2023-10-16T19:40:55.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.460+0000 7fd86dd34640 1 -- 172.21.15.57:0/2006450207 >> v1:172.21.15.110:6789/0 conn(0x7fd868069de0 legacy=0x7fd86806fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:55.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.460+0000 7fd86dd34640 1 -- 172.21.15.57:0/2006450207 >> v1:172.21.15.57:6789/0 conn(0x7fd86806a1c0 legacy=0x7fd868159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.460+0000 7fd86dd34640 1 -- 172.21.15.57:0/2006450207 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8681534f0 con 0x7fd868159930 2023-10-16T19:40:55.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.466+0000 7fd86dd34640 1 --2- 172.21.15.57:0/2006450207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8680c6170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd860009dc0 tx=0x7fd86002be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a295e12bb4cd26 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:55.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.477+0000 7fd85ffff640 1 -- 172.21.15.57:0/2006450207 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86002cc30 con 0x7fd868159930 2023-10-16T19:40:55.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.477+0000 7fd85ffff640 1 -- 172.21.15.57:0/2006450207 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86002cd90 con 0x7fd868159930 2023-10-16T19:40:55.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.477+0000 7fd85ffff640 1 -- 172.21.15.57:0/2006450207 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860034660 con 0x7fd868159930 2023-10-16T19:40:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 -- 172.21.15.57:0/2006450207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 msgr2=0x7fd8680c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 --2- 172.21.15.57:0/2006450207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8680c6170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd860009dc0 tx=0x7fd86002be80 comp rx=0 tx=0).stop 2023-10-16T19:40:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 -- 172.21.15.57:0/2006450207 shutdown_connections 2023-10-16T19:40:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 --2- 172.21.15.57:0/2006450207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8680c6170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 -- 172.21.15.57:0/2006450207 >> 172.21.15.57:0/2006450207 conn(0x7fd8680c6ea0 msgr2=0x7fd8680c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:55.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 -- 172.21.15.57:0/2006450207 shutdown_connections 2023-10-16T19:40:55.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.478+0000 7fd86f797640 1 -- 172.21.15.57:0/2006450207 wait complete. 2023-10-16T19:40:55.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.480+0000 7fd86f797640 1 Processor -- start 2023-10-16T19:40:55.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.480+0000 7fd86f797640 1 -- start start 2023-10-16T19:40:55.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.482+0000 7fd86f797640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868069de0 0x7fd86815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.482+0000 7fd86f797640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd86806a1c0 0x7fd8681ee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.482+0000 7fd86f797640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8681eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.482+0000 7fd86f797640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815b080 con 0x7fd868069de0 2023-10-16T19:40:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.482+0000 7fd86f797640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868147fa0 con 0x7fd86806a1c0 2023-10-16T19:40:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.482+0000 7fd86f797640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815d330 con 0x7fd868159930 2023-10-16T19:40:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.484+0000 7fd86dd34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8681eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.484+0000 7fd86cd32640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd86806a1c0 0x7fd8681ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.485+0000 7fd86dd34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8681eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:55324/0 (socket says 172.21.15.57:55324) 2023-10-16T19:40:55.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.485+0000 7fd86dd34640 1 -- 172.21.15.57:0/1325674888 learned_addr learned my addr 172.21.15.57:0/1325674888 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.499+0000 7fd86cd32640 1 -- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 msgr2=0x7fd8681eeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.499+0000 7fd86cd32640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8681eeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.499+0000 7fd86cd32640 1 -- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868069de0 msgr2=0x7fd86815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.499+0000 7fd86cd32640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868069de0 0x7fd86815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.499+0000 7fd86cd32640 1 -- 172.21.15.57:0/1325674888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009a70 con 0x7fd86806a1c0 2023-10-16T19:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.499+0000 7fd86dd34640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8681eeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:55.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.508+0000 7fd86cd32640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd86806a1c0 0x7fd8681ee760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c790 tx=0x7fd85800cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.523+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858005ab0 con 0x7fd86806a1c0 2023-10-16T19:40:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.523+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858005c10 con 0x7fd86806a1c0 2023-10-16T19:40:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.523+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858001d30 con 0x7fd86806a1c0 2023-10-16T19:40:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.523+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86815d050 con 0x7fd86806a1c0 2023-10-16T19:40:55.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.523+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86815a9c0 con 0x7fd86806a1c0 2023-10-16T19:40:55.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.525+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86804e160 con 0x7fd86806a1c0 2023-10-16T19:40:55.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.583+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd858007070 con 0x7fd86806a1c0 2023-10-16T19:40:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.585+0000 7fd85dffb640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd84c06aec0 0x7fd84c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.586+0000 7fd86d533640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd84c06aec0 0x7fd84c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.587+0000 7fd86d533640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd84c06aec0 0x7fd84c06d380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd864001560 tx=0x7fd864007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:55.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.588+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd858057ba0 con 0x7fd86806a1c0 2023-10-16T19:40:55.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:55.897+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd858057970 con 0x7fd86806a1c0 2023-10-16T19:40:56.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:56.125+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd8680703d0 con 0x7fd86806a1c0 2023-10-16T19:40:57.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.698+0000 7fd85dffb640 1 -- 172.21.15.57:0/1325674888 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd8580170d0 con 0x7fd86806a1c0 2023-10-16T19:40:57.700 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-10-16T19:40:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.701+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd84c06aec0 msgr2=0x7fd84c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.701+0000 7fd86f797640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd84c06aec0 0x7fd84c06d380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd864001560 tx=0x7fd864007990 comp rx=0 tx=0).stop 2023-10-16T19:40:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.701+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd86806a1c0 msgr2=0x7fd8681ee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.701+0000 7fd86f797640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd86806a1c0 0x7fd8681ee760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c790 tx=0x7fd85800cc50 comp rx=0 tx=0).stop 2023-10-16T19:40:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 shutdown_connections 2023-10-16T19:40:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd84c06aec0 0x7fd84c06d380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd868159930 0x7fd8681eeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd86806a1c0 0x7fd8681ee760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 --2- 172.21.15.57:0/1325674888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868069de0 0x7fd86815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 >> 172.21.15.57:0/1325674888 conn(0x7fd8680c6ea0 msgr2=0x7fd8680c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 shutdown_connections 2023-10-16T19:40:57.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.702+0000 7fd86f797640 1 -- 172.21.15.57:0/1325674888 wait complete. 2023-10-16T19:40:57.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T19:40:57.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.938+0000 7fcd54490640 1 Processor -- start 2023-10-16T19:40:57.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.938+0000 7fcd54490640 1 -- start start 2023-10-16T19:40:57.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.940+0000 7fcd54490640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd4c153210 0x7fcd4c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.940+0000 7fcd54490640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0ce800 0x7fcd4c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.940+0000 7fcd54490640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c1535f0 con 0x7fcd4c0c9710 2023-10-16T19:40:57.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.940+0000 7fcd54490640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c0c4420 con 0x7fcd4c153210 2023-10-16T19:40:57.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.940+0000 7fcd54490640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c159680 con 0x7fcd4c0ce800 2023-10-16T19:40:57.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.942+0000 7fcd51a2b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcd4c0c9710 0x7fcd4c0c4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:52258/0 (socket says 172.21.15.57:52258) 2023-10-16T19:40:57.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.942+0000 7fcd51a2b640 1 -- 172.21.15.57:0/3826842378 learned_addr learned my addr 172.21.15.57:0/3826842378 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:40:57.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.942+0000 7fcd52a2d640 1 --2- 172.21.15.57:0/3826842378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0ce800 0x7fcd4c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.950+0000 7fcd5122a640 1 -- 172.21.15.57:0/3826842378 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121775853 0 0) 0x7fcd4c1535f0 con 0x7fcd4c0c9710 2023-10-16T19:40:57.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.950+0000 7fcd5122a640 1 -- 172.21.15.57:0/3826842378 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd38003520 con 0x7fcd4c0c9710 2023-10-16T19:40:57.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.950+0000 7fcd52a2d640 1 -- 172.21.15.57:0/3826842378 >> v2:172.21.15.57:3300/0 conn(0x7fcd4c153210 msgr2=0x7fcd4c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:57.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.950+0000 7fcd52a2d640 1 --2- 172.21.15.57:0/3826842378 >> v2:172.21.15.57:3300/0 conn(0x7fcd4c153210 0x7fcd4c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.950+0000 7fcd52a2d640 1 -- 172.21.15.57:0/3826842378 >> v1:172.21.15.110:6789/0 conn(0x7fcd4c0c9710 legacy=0x7fcd4c0c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.950+0000 7fcd52a2d640 1 -- 172.21.15.57:0/3826842378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c159960 con 0x7fcd4c0ce800 2023-10-16T19:40:57.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.957+0000 7fcd52a2d640 1 --2- 172.21.15.57:0/3826842378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0ce800 0x7fcd4c0cec90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009d90 tx=0x7fcd4402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c53111ca9c4d1ecb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:57.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.963+0000 7fcd5122a640 1 -- 172.21.15.57:0/3826842378 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4402cc50 con 0x7fcd4c0ce800 2023-10-16T19:40:57.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.963+0000 7fcd5122a640 1 -- 172.21.15.57:0/3826842378 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4402cdb0 con 0x7fcd4c0ce800 2023-10-16T19:40:57.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.963+0000 7fcd5122a640 1 -- 172.21.15.57:0/3826842378 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44034660 con 0x7fcd4c0ce800 2023-10-16T19:40:57.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.964+0000 7fcd54490640 1 -- 172.21.15.57:0/3826842378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0ce800 msgr2=0x7fcd4c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.964+0000 7fcd54490640 1 --2- 172.21.15.57:0/3826842378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0ce800 0x7fcd4c0cec90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009d90 tx=0x7fcd4402bea0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.964+0000 7fcd54490640 1 -- 172.21.15.57:0/3826842378 shutdown_connections 2023-10-16T19:40:57.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.964+0000 7fcd54490640 1 --2- 172.21.15.57:0/3826842378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0ce800 0x7fcd4c0cec90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.964+0000 7fcd54490640 1 --2- 172.21.15.57:0/3826842378 >> v2:172.21.15.57:3300/0 conn(0x7fcd4c153210 0x7fcd4c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.964+0000 7fcd54490640 1 -- 172.21.15.57:0/3826842378 >> 172.21.15.57:0/3826842378 conn(0x7fcd4c06ac80 msgr2=0x7fcd4c06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:57.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.965+0000 7fcd54490640 1 -- 172.21.15.57:0/3826842378 shutdown_connections 2023-10-16T19:40:57.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.965+0000 7fcd54490640 1 -- 172.21.15.57:0/3826842378 wait complete. 2023-10-16T19:40:57.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.967+0000 7fcd54490640 1 Processor -- start 2023-10-16T19:40:57.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.967+0000 7fcd54490640 1 -- start start 2023-10-16T19:40:57.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.968+0000 7fcd54490640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 0x7fcd4c148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.968+0000 7fcd54490640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd4c0ce800 0x7fcd4c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.968+0000 7fcd54490640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4c153210 0x7fcd4c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.968+0000 7fcd54490640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1f2630 con 0x7fcd4c0ce800 2023-10-16T19:40:57.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.968+0000 7fcd54490640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c144270 con 0x7fcd4c153210 2023-10-16T19:40:57.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.968+0000 7fcd54490640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c144530 con 0x7fcd4c0c9710 2023-10-16T19:40:57.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.969+0000 7fcd5222c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 0x7fcd4c148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.969+0000 7fcd52a2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4c153210 0x7fcd4c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.970+0000 7fcd5222c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 0x7fcd4c148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:41894/0 (socket says 172.21.15.57:41894) 2023-10-16T19:40:57.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.970+0000 7fcd5222c640 1 -- 172.21.15.57:0/1088959949 learned_addr learned my addr 172.21.15.57:0/1088959949 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:40:57.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.978+0000 7fcd5222c640 1 -- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4c153210 msgr2=0x7fcd4c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.978+0000 7fcd5222c640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4c153210 0x7fcd4c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.978+0000 7fcd5222c640 1 -- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd4c0ce800 msgr2=0x7fcd4c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.978+0000 7fcd5222c640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd4c0ce800 0x7fcd4c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.978+0000 7fcd5222c640 1 -- 172.21.15.57:0/1088959949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44009a70 con 0x7fcd4c0c9710 2023-10-16T19:40:57.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.982+0000 7fcd5222c640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 0x7fcd4c148820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800b410 tx=0x7fcd4800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:57.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.988+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011830 con 0x7fcd4c0c9710 2023-10-16T19:40:57.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.988+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd480119b0 con 0x7fcd4c0c9710 2023-10-16T19:40:57.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.988+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011d60 con 0x7fcd4c0c9710 2023-10-16T19:40:57.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.988+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c1f1a20 con 0x7fcd4c0c9710 2023-10-16T19:40:57.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.988+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c1f1fe0 con 0x7fcd4c0c9710 2023-10-16T19:40:57.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:57.989+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c04e160 con 0x7fcd4c0c9710 2023-10-16T19:40:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.293+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd4801a400 con 0x7fcd4c0c9710 2023-10-16T19:40:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.296+0000 7fcd42ffd640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcd3006aef0 0x7fcd3006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.296+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcd48089ca0 con 0x7fcd4c0c9710 2023-10-16T19:40:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.297+0000 7fcd51a2b640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcd3006aef0 0x7fcd3006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.298+0000 7fcd51a2b640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcd3006aef0 0x7fcd3006d3b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0c9650 tx=0x7fcd3c007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.302+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd48089e60 con 0x7fcd4c0c9710 2023-10-16T19:40:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:40:58.557+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcd4c0c5600 con 0x7fcd4c0c9710 2023-10-16T19:41:00.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.612+0000 7fcd42ffd640 1 -- 172.21.15.57:0/1088959949 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcd480150c0 con 0x7fcd4c0c9710 2023-10-16T19:41:00.614 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T19:41:00.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.616+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcd3006aef0 msgr2=0x7fcd3006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.616+0000 7fcd54490640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcd3006aef0 0x7fcd3006d3b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0c9650 tx=0x7fcd3c007930 comp rx=0 tx=0).stop 2023-10-16T19:41:00.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.616+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 msgr2=0x7fcd4c148820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.616+0000 7fcd54490640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 0x7fcd4c148820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800b410 tx=0x7fcd4800b8d0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 shutdown_connections 2023-10-16T19:41:00.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcd3006aef0 0x7fcd3006d3b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4c153210 0x7fcd4c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd4c0ce800 0x7fcd4c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 --2- 172.21.15.57:0/1088959949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd4c0c9710 0x7fcd4c148820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 >> 172.21.15.57:0/1088959949 conn(0x7fcd4c06ac80 msgr2=0x7fcd4c151630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:00.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 shutdown_connections 2023-10-16T19:41:00.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.617+0000 7fcd54490640 1 -- 172.21.15.57:0/1088959949 wait complete. 2023-10-16T19:41:00.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:00.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.843+0000 7f650c84b640 1 Processor -- start 2023-10-16T19:41:00.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.844+0000 7f650c84b640 1 -- start start 2023-10-16T19:41:00.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.845+0000 7f650c84b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65080c6910 0x7f6508164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.845+0000 7f650c84b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080c5d70 con 0x7f6508156760 2023-10-16T19:41:00.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.845+0000 7f650c84b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080c9a30 con 0x7f6508159bf0 2023-10-16T19:41:00.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.845+0000 7f650c84b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080c9cd0 con 0x7f65080c6910 2023-10-16T19:41:00.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.846+0000 7f6506d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65080c6910 0x7f6508164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.847+0000 7f6506d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65080c6910 0x7f6508164a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58542/0 (socket says 172.21.15.57:58542) 2023-10-16T19:41:00.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.847+0000 7f6506d9d640 1 -- 172.21.15.57:0/4051248786 learned_addr learned my addr 172.21.15.57:0/4051248786 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:00.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.850+0000 7f6506d9d640 1 -- 172.21.15.57:0/4051248786 >> v1:172.21.15.110:6789/0 conn(0x7f6508159bf0 legacy=0x7f65080c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:00.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.850+0000 7f6506d9d640 1 -- 172.21.15.57:0/4051248786 >> v1:172.21.15.57:6789/0 conn(0x7f6508156760 legacy=0x7f65080c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.850+0000 7f6506d9d640 1 -- 172.21.15.57:0/4051248786 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080c8c50 con 0x7f65080c6910 2023-10-16T19:41:00.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.853+0000 7f6506d9d640 1 --2- 172.21.15.57:0/4051248786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65080c6910 0x7f6508164a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6500009e50 tx=0x7f650002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a434e7ae89dbf991 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:00.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.860+0000 7f650559a640 1 -- 172.21.15.57:0/4051248786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650002cbb0 con 0x7f65080c6910 2023-10-16T19:41:00.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650559a640 1 -- 172.21.15.57:0/4051248786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650002cd10 con 0x7f65080c6910 2023-10-16T19:41:00.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650559a640 1 -- 172.21.15.57:0/4051248786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500034610 con 0x7f65080c6910 2023-10-16T19:41:00.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650c84b640 1 -- 172.21.15.57:0/4051248786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65080c6910 msgr2=0x7f6508164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650c84b640 1 --2- 172.21.15.57:0/4051248786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65080c6910 0x7f6508164a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6500009e50 tx=0x7f650002c010 comp rx=0 tx=0).stop 2023-10-16T19:41:00.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650c84b640 1 -- 172.21.15.57:0/4051248786 shutdown_connections 2023-10-16T19:41:00.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650c84b640 1 --2- 172.21.15.57:0/4051248786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65080c6910 0x7f6508164a20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650c84b640 1 -- 172.21.15.57:0/4051248786 >> 172.21.15.57:0/4051248786 conn(0x7f65080c78f0 msgr2=0x7f65080c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:00.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.861+0000 7f650c84b640 1 -- 172.21.15.57:0/4051248786 shutdown_connections 2023-10-16T19:41:00.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.862+0000 7f650c84b640 1 -- 172.21.15.57:0/4051248786 wait complete. 2023-10-16T19:41:00.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.863+0000 7f650c84b640 1 Processor -- start 2023-10-16T19:41:00.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.863+0000 7f650c84b640 1 -- start start 2023-10-16T19:41:00.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.864+0000 7f650c84b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65080c6910 0x7f650814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.864+0000 7f650c84b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 0x7f65081501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.864+0000 7f650c84b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6508159bf0 0x7f65081f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.864+0000 7f650c84b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081f2b30 con 0x7f6508156760 2023-10-16T19:41:00.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.864+0000 7f650c84b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65080acb90 con 0x7f6508159bf0 2023-10-16T19:41:00.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.864+0000 7f650c84b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65081f09d0 con 0x7f65080c6910 2023-10-16T19:41:00.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.865+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 0x7f65081501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.866+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 0x7f65081501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58546/0 (socket says 172.21.15.57:58546) 2023-10-16T19:41:00.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.866+0000 7f6505d9b640 1 -- 172.21.15.57:0/2561786158 learned_addr learned my addr 172.21.15.57:0/2561786158 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.871+0000 7f6505d9b640 1 -- 172.21.15.57:0/2561786158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65080c6910 msgr2=0x7f650814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.871+0000 7f6505d9b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65080c6910 0x7f650814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.871+0000 7f6505d9b640 1 -- 172.21.15.57:0/2561786158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6508159bf0 msgr2=0x7f65081f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.871+0000 7f6505d9b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6508159bf0 0x7f65081f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.871+0000 7f6505d9b640 1 -- 172.21.15.57:0/2561786158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500009b30 con 0x7f6508156760 2023-10-16T19:41:00.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.875+0000 7f6505d9b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 0x7f65081501c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b3e0 tx=0x7f64fc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:00.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.880+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011830 con 0x7f6508156760 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.880+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0119b0 con 0x7f6508156760 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.880+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011d60 con 0x7f6508156760 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.880+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65080c4ea0 con 0x7f6508156760 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.880+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65081f0660 con 0x7f6508156760 2023-10-16T19:41:00.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.881+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65081f04c0 con 0x7f6508156760 2023-10-16T19:41:00.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.904+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f64fc01a400 con 0x7f6508156760 2023-10-16T19:41:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.905+0000 7f64f6ffd640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f64e806aec0 0x7f64e806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.905+0000 7f650659c640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f64e806aec0 0x7f64e806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.906+0000 7f650659c640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f64e806aec0 0x7f64e806d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64f8000f60 tx=0x7f64f80079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:00.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:00.908+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64fc00f2e0 con 0x7f6508156760 2023-10-16T19:41:01.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.346+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64fc054ca0 con 0x7f6508156760 2023-10-16T19:41:01.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.564+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65081f04c0 con 0x7f6508156760 2023-10-16T19:41:01.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.670+0000 7f64f6ffd640 1 -- 172.21.15.57:0/2561786158 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f65081f04c0 con 0x7f6508156760 2023-10-16T19:41:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:01.673 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:00.442991+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.673+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f64e806aec0 msgr2=0x7f64e806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.673+0000 7f650c84b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f64e806aec0 0x7f64e806d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64f8000f60 tx=0x7f64f80079d0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.673+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 msgr2=0x7f65081501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.673+0000 7f650c84b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 0x7f65081501c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b3e0 tx=0x7f64fc00b8a0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 shutdown_connections 2023-10-16T19:41:01.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f64e806aec0 0x7f64e806d380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6508159bf0 0x7f65081f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6508156760 0x7f65081501c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 --2- 172.21.15.57:0/2561786158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65080c6910 0x7f650814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 >> 172.21.15.57:0/2561786158 conn(0x7f65080c78f0 msgr2=0x7f65080c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 shutdown_connections 2023-10-16T19:41:01.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.674+0000 7f650c84b640 1 -- 172.21.15.57:0/2561786158 wait complete. 2023-10-16T19:41:01.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:01.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.897+0000 7fb746e10640 1 Processor -- start 2023-10-16T19:41:01.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.898+0000 7fb746e10640 1 -- start start 2023-10-16T19:41:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.899+0000 7fb746e10640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb740153310 0x7fb740159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.899+0000 7fb746e10640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb74015c5e0 0x7fb7400c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.899+0000 7fb746e10640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74006a540 con 0x7fb740159d90 2023-10-16T19:41:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.900+0000 7fb746e10640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400c7e30 con 0x7fb74015c5e0 2023-10-16T19:41:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.900+0000 7fb746e10640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb740159070 con 0x7fb740153310 2023-10-16T19:41:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.900+0000 7fb7453ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb74015c5e0 0x7fb7400c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.901+0000 7fb7453ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb74015c5e0 0x7fb7400c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58552/0 (socket says 172.21.15.57:58552) 2023-10-16T19:41:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.901+0000 7fb7453ad640 1 -- 172.21.15.57:0/371709034 learned_addr learned my addr 172.21.15.57:0/371709034 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.901+0000 7fb744bac640 1 --2- 172.21.15.57:0/371709034 >> v2:172.21.15.110:3300/0 conn(0x7fb740153310 0x7fb740159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.905+0000 7fb7453ad640 1 -- 172.21.15.57:0/371709034 >> v2:172.21.15.110:3300/0 conn(0x7fb740153310 msgr2=0x7fb740159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.905+0000 7fb7453ad640 1 --2- 172.21.15.57:0/371709034 >> v2:172.21.15.110:3300/0 conn(0x7fb740153310 0x7fb740159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.905+0000 7fb7453ad640 1 -- 172.21.15.57:0/371709034 >> v1:172.21.15.57:6789/0 conn(0x7fb740159d90 legacy=0x7fb74006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.905+0000 7fb7453ad640 1 -- 172.21.15.57:0/371709034 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74015cad0 con 0x7fb74015c5e0 2023-10-16T19:41:01.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.910+0000 7fb7453ad640 1 --2- 172.21.15.57:0/371709034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb74015c5e0 0x7fb7400c6fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb7400663a0 tx=0x7fb73802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc523239bfa1232 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.916+0000 7fb73f7fe640 1 -- 172.21.15.57:0/371709034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73802f850 con 0x7fb74015c5e0 2023-10-16T19:41:01.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.916+0000 7fb73f7fe640 1 -- 172.21.15.57:0/371709034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73802f9b0 con 0x7fb74015c5e0 2023-10-16T19:41:01.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.916+0000 7fb73f7fe640 1 -- 172.21.15.57:0/371709034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73802fd40 con 0x7fb74015c5e0 2023-10-16T19:41:01.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.917+0000 7fb746e10640 1 -- 172.21.15.57:0/371709034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb74015c5e0 msgr2=0x7fb7400c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.917+0000 7fb746e10640 1 --2- 172.21.15.57:0/371709034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb74015c5e0 0x7fb7400c6fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb7400663a0 tx=0x7fb73802ba30 comp rx=0 tx=0).stop 2023-10-16T19:41:01.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.917+0000 7fb746e10640 1 -- 172.21.15.57:0/371709034 shutdown_connections 2023-10-16T19:41:01.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.918+0000 7fb746e10640 1 --2- 172.21.15.57:0/371709034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb74015c5e0 0x7fb7400c6fe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.918+0000 7fb746e10640 1 --2- 172.21.15.57:0/371709034 >> v2:172.21.15.110:3300/0 conn(0x7fb740153310 0x7fb740159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.918+0000 7fb746e10640 1 -- 172.21.15.57:0/371709034 >> 172.21.15.57:0/371709034 conn(0x7fb7400cb610 msgr2=0x7fb7400cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.918+0000 7fb746e10640 1 -- 172.21.15.57:0/371709034 shutdown_connections 2023-10-16T19:41:01.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.918+0000 7fb746e10640 1 -- 172.21.15.57:0/371709034 wait complete. 2023-10-16T19:41:01.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.920+0000 7fb746e10640 1 Processor -- start 2023-10-16T19:41:01.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.920+0000 7fb746e10640 1 -- start start 2023-10-16T19:41:01.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.922+0000 7fb746e10640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb740153310 0x7fb740144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.922+0000 7fb746e10640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 0x7fb7400c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.922+0000 7fb746e10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74015c5e0 0x7fb7400c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.922+0000 7fb746e10640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c25d0 con 0x7fb740159d90 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.922+0000 7fb746e10640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c4130 con 0x7fb740153310 2023-10-16T19:41:01.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.922+0000 7fb746e10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb740158de0 con 0x7fb74015c5e0 2023-10-16T19:41:01.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.933+0000 7fb7453ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74015c5e0 0x7fb7400c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.934+0000 7fb744bac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb740153310 0x7fb740144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.934+0000 7fb73ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 0x7fb7400c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.935+0000 7fb73ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 0x7fb7400c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58558/0 (socket says 172.21.15.57:58558) 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.935+0000 7fb73ffff640 1 -- 172.21.15.57:0/3431521388 learned_addr learned my addr 172.21.15.57:0/3431521388 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:01.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.939+0000 7fb73ffff640 1 -- 172.21.15.57:0/3431521388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74015c5e0 msgr2=0x7fb7400c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.939+0000 7fb73ffff640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74015c5e0 0x7fb7400c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.939+0000 7fb73ffff640 1 -- 172.21.15.57:0/3431521388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb740153310 msgr2=0x7fb740144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.939+0000 7fb73ffff640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb740153310 0x7fb740144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.939+0000 7fb73ffff640 1 -- 172.21.15.57:0/3431521388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380094d0 con 0x7fb740159d90 2023-10-16T19:41:01.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.942+0000 7fb73ffff640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 0x7fb7400c45c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c430 tx=0x7fb72c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.948+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0052d0 con 0x7fb740159d90 2023-10-16T19:41:01.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.948+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c005430 con 0x7fb740159d90 2023-10-16T19:41:01.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.948+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c003830 con 0x7fb740159d90 2023-10-16T19:41:01.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.948+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7400c9ea0 con 0x7fb740159d90 2023-10-16T19:41:01.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.949+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7400c2820 con 0x7fb740159d90 2023-10-16T19:41:01.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:01.950+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74004e1d0 con 0x7fb740159d90 2023-10-16T19:41:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.320+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb72c003990 con 0x7fb740159d90 2023-10-16T19:41:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.323+0000 7fb73d7fa640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb72406aef0 0x7fb72406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.323+0000 7fb744bac640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb72406aef0 0x7fb72406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.325+0000 7fb744bac640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb72406aef0 0x7fb72406d3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7340073f0 tx=0x7fb73400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.365+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb72c058500 con 0x7fb740159d90 2023-10-16T19:41:02.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.367+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb72c054140 con 0x7fb740159d90 2023-10-16T19:41:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.581+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7400c4270 con 0x7fb740159d90 2023-10-16T19:41:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.660+0000 7fb73d7fa640 1 -- 172.21.15.57:0/3431521388 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fb72c057760 con 0x7fb740159d90 2023-10-16T19:41:02.663 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:02.663 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:00.442991+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.664+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb72406aef0 msgr2=0x7fb72406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.664+0000 7fb746e10640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb72406aef0 0x7fb72406d3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7340073f0 tx=0x7fb73400b040 comp rx=0 tx=0).stop 2023-10-16T19:41:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.664+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 msgr2=0x7fb7400c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.664+0000 7fb746e10640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 0x7fb7400c45c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c430 tx=0x7fb72c00c8f0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 shutdown_connections 2023-10-16T19:41:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb72406aef0 0x7fb72406d3b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74015c5e0 0x7fb7400c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb740159d90 0x7fb7400c45c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 --2- 172.21.15.57:0/3431521388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb740153310 0x7fb740144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 >> 172.21.15.57:0/3431521388 conn(0x7fb7400cb610 msgr2=0x7fb7400c6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 shutdown_connections 2023-10-16T19:41:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.665+0000 7fb746e10640 1 -- 172.21.15.57:0/3431521388 wait complete. 2023-10-16T19:41:02.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T19:41:02.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.911+0000 7fa0a67ae640 1 Processor -- start 2023-10-16T19:41:02.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.912+0000 7fa0a67ae640 1 -- start start 2023-10-16T19:41:02.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.913+0000 7fa0a67ae640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0a006b160 0x7fa0a0152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.913+0000 7fa0a67ae640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0a00c5590 0x7fa0a0153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.913+0000 7fa0a67ae640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a00c7930 con 0x7fa0a006b540 2023-10-16T19:41:02.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.913+0000 7fa0a67ae640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00c4c50 con 0x7fa0a006b160 2023-10-16T19:41:02.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.913+0000 7fa0a67ae640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00c46b0 con 0x7fa0a00c5590 2023-10-16T19:41:02.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.915+0000 7fa0a4fab640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0a00c5590 0x7fa0a0153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.916+0000 7fa0a4fab640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0a00c5590 0x7fa0a0153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:51090/0 (socket says 172.21.15.57:51090) 2023-10-16T19:41:02.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.916+0000 7fa0a4fab640 1 -- 172.21.15.57:0/520754010 learned_addr learned my addr 172.21.15.57:0/520754010 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:02.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.919+0000 7fa0a57ac640 1 --2- 172.21.15.57:0/520754010 >> v2:172.21.15.57:3300/0 conn(0x7fa0a006b160 0x7fa0a0152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.922+0000 7fa0a4fab640 1 -- 172.21.15.57:0/520754010 >> v2:172.21.15.57:3300/0 conn(0x7fa0a006b160 msgr2=0x7fa0a0152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:02.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.922+0000 7fa0a4fab640 1 --2- 172.21.15.57:0/520754010 >> v2:172.21.15.57:3300/0 conn(0x7fa0a006b160 0x7fa0a0152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.922+0000 7fa0a4fab640 1 -- 172.21.15.57:0/520754010 >> v1:172.21.15.57:6789/0 conn(0x7fa0a006b540 legacy=0x7fa0a0155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:02.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.922+0000 7fa0a4fab640 1 -- 172.21.15.57:0/520754010 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00c4970 con 0x7fa0a00c5590 2023-10-16T19:41:02.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.929+0000 7fa0a4fab640 1 --2- 172.21.15.57:0/520754010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a00c5590 0x7fa0a0153350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0072030 tx=0x7fa09002db20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac981d903b1bf9da server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.942+0000 7fa097fff640 1 -- 172.21.15.57:0/520754010 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09002f8e0 con 0x7fa0a00c5590 2023-10-16T19:41:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.943+0000 7fa097fff640 1 -- 172.21.15.57:0/520754010 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09002fa40 con 0x7fa0a00c5590 2023-10-16T19:41:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.943+0000 7fa097fff640 1 -- 172.21.15.57:0/520754010 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09002fdd0 con 0x7fa0a00c5590 2023-10-16T19:41:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 -- 172.21.15.57:0/520754010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a00c5590 msgr2=0x7fa0a0153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/520754010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a00c5590 0x7fa0a0153350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0072030 tx=0x7fa09002db20 comp rx=0 tx=0).stop 2023-10-16T19:41:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 -- 172.21.15.57:0/520754010 shutdown_connections 2023-10-16T19:41:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/520754010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a00c5590 0x7fa0a0153350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/520754010 >> v2:172.21.15.57:3300/0 conn(0x7fa0a006b160 0x7fa0a0152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 -- 172.21.15.57:0/520754010 >> 172.21.15.57:0/520754010 conn(0x7fa0a00cb400 msgr2=0x7fa0a00cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 -- 172.21.15.57:0/520754010 shutdown_connections 2023-10-16T19:41:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.944+0000 7fa0a67ae640 1 -- 172.21.15.57:0/520754010 wait complete. 2023-10-16T19:41:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.947+0000 7fa0a67ae640 1 Processor -- start 2023-10-16T19:41:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.947+0000 7fa0a67ae640 1 -- start start 2023-10-16T19:41:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.948+0000 7fa0a67ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a006b160 0x7fa0a00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.948+0000 7fa0a67ae640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 0x7fa0a01dbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.949+0000 7fa0a67ae640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5590 0x7fa0a00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.949+0000 7fa0a67ae640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a01ed3a0 con 0x7fa0a006b540 2023-10-16T19:41:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.949+0000 7fa0a67ae640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a01ed640 con 0x7fa0a006b160 2023-10-16T19:41:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.949+0000 7fa0a67ae640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a01ed920 con 0x7fa0a00c5590 2023-10-16T19:41:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.949+0000 7fa0a4fab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 0x7fa0a01dbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.950+0000 7fa0a4fab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 0x7fa0a01dbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58572/0 (socket says 172.21.15.57:58572) 2023-10-16T19:41:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.950+0000 7fa0a4fab640 1 -- 172.21.15.57:0/2097605383 learned_addr learned my addr 172.21.15.57:0/2097605383 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.951+0000 7fa0a57ac640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a006b160 0x7fa0a00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.951+0000 7fa0a5fad640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5590 0x7fa0a00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.954+0000 7fa0a4fab640 1 -- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5590 msgr2=0x7fa0a00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.954+0000 7fa0a4fab640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5590 0x7fa0a00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.954+0000 7fa0a4fab640 1 -- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a006b160 msgr2=0x7fa0a00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.954+0000 7fa0a4fab640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a006b160 0x7fa0a00c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.954+0000 7fa0a4fab640 1 -- 172.21.15.57:0/2097605383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900094d0 con 0x7fa0a006b540 2023-10-16T19:41:02.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.957+0000 7fa0a4fab640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 0x7fa0a01dbd60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0900090b0 tx=0x7fa0900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.963+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090037df0 con 0x7fa0a006b540 2023-10-16T19:41:02.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.963+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090040420 con 0x7fa0a006b540 2023-10-16T19:41:02.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.963+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900407d0 con 0x7fa0a006b540 2023-10-16T19:41:02.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.963+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a01edc00 con 0x7fa0a006b540 2023-10-16T19:41:02.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.963+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a01dc410 con 0x7fa0a006b540 2023-10-16T19:41:02.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:02.965+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a01ee120 con 0x7fa0a006b540 2023-10-16T19:41:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.280+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa090040930 con 0x7fa0a006b540 2023-10-16T19:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.282+0000 7fa095ffb640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa08406aef0 0x7fa08406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.283+0000 7fa0a57ac640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa08406aef0 0x7fa08406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.284+0000 7fa0a57ac640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa08406aef0 0x7fa08406d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa09c006fd0 tx=0x7fa09c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.317+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa090033070 con 0x7fa0a006b540 2023-10-16T19:41:03.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.318+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa090079110 con 0x7fa0a006b540 2023-10-16T19:41:03.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:03.583+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa0a01ee120 con 0x7fa0a006b540 2023-10-16T19:41:04.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.946+0000 7fa095ffb640 1 -- 172.21.15.57:0/2097605383 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa0a01ee120 con 0x7fa0a006b540 2023-10-16T19:41:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa08406aef0 msgr2=0x7fa08406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa08406aef0 0x7fa08406d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa09c006fd0 tx=0x7fa09c008040 comp rx=0 tx=0).stop 2023-10-16T19:41:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 msgr2=0x7fa0a01dbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 0x7fa0a01dbd60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0900090b0 tx=0x7fa0900046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 shutdown_connections 2023-10-16T19:41:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa08406aef0 0x7fa08406d3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5590 0x7fa0a00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0a006b540 0x7fa0a01dbd60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 --2- 172.21.15.57:0/2097605383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a006b160 0x7fa0a00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 >> 172.21.15.57:0/2097605383 conn(0x7fa0a00cb400 msgr2=0x7fa0a0152290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 shutdown_connections 2023-10-16T19:41:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:04.950+0000 7fa0a67ae640 1 -- 172.21.15.57:0/2097605383 wait complete. 2023-10-16T19:41:04.972 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2023-10-16T19:41:04.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-16T19:41:05.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.201+0000 7f18aa939640 1 Processor -- start 2023-10-16T19:41:05.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.201+0000 7f18aa939640 1 -- start start 2023-10-16T19:41:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.202+0000 7f18aa939640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18a4150000 0x7f18a4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.202+0000 7f18aa939640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18a4071f80 0x7f18a40c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.203+0000 7f18aa939640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.203+0000 7f18aa939640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a41503e0 con 0x7f18a4071f80 2023-10-16T19:41:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.203+0000 7f18aa939640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a40c6510 con 0x7f18a4150000 2023-10-16T19:41:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.203+0000 7f18aa939640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a4155f60 con 0x7f18a4071450 2023-10-16T19:41:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.204+0000 7f18a37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18a4071f80 0x7f18a40c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.204+0000 7f18a37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18a4071f80 0x7f18a40c2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58574/0 (socket says 172.21.15.57:58574) 2023-10-16T19:41:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.204+0000 7f18a3fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18a4150000 0x7f18a4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.204+0000 7f18a37fe640 1 -- 172.21.15.57:0/2327411535 learned_addr learned my addr 172.21.15.57:0/2327411535 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.204+0000 7f18a8ed6640 1 --2- 172.21.15.57:0/2327411535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.207+0000 7f18a37fe640 1 -- 172.21.15.57:0/2327411535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 msgr2=0x7f18a40c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.207+0000 7f18a37fe640 1 --2- 172.21.15.57:0/2327411535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.207+0000 7f18a37fe640 1 -- 172.21.15.57:0/2327411535 >> v2:172.21.15.110:3300/0 conn(0x7f18a4150000 msgr2=0x7f18a4159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.207+0000 7f18a37fe640 1 --2- 172.21.15.57:0/2327411535 >> v2:172.21.15.110:3300/0 conn(0x7f18a4150000 0x7f18a4159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.207+0000 7f18a37fe640 1 -- 172.21.15.57:0/2327411535 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4156240 con 0x7f18a4071f80 2023-10-16T19:41:05.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.210+0000 7f18a37fe640 1 --2- 172.21.15.57:0/2327411535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a4071f80 0x7f18a40c2940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18a40c8d20 tx=0x7f189802e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c967e5ac62b8378 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:05.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.216+0000 7f18a2ffd640 1 -- 172.21.15.57:0/2327411535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189802ee80 con 0x7f18a4071f80 2023-10-16T19:41:05.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.216+0000 7f18a2ffd640 1 -- 172.21.15.57:0/2327411535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898036440 con 0x7f18a4071f80 2023-10-16T19:41:05.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.216+0000 7f18a2ffd640 1 -- 172.21.15.57:0/2327411535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18980367b0 con 0x7f18a4071f80 2023-10-16T19:41:05.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 -- 172.21.15.57:0/2327411535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a4071f80 msgr2=0x7f18a40c2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 --2- 172.21.15.57:0/2327411535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a4071f80 0x7f18a40c2940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18a40c8d20 tx=0x7f189802e0d0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 -- 172.21.15.57:0/2327411535 shutdown_connections 2023-10-16T19:41:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 --2- 172.21.15.57:0/2327411535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 --2- 172.21.15.57:0/2327411535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a4071f80 0x7f18a40c2940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 --2- 172.21.15.57:0/2327411535 >> v2:172.21.15.110:3300/0 conn(0x7f18a4150000 0x7f18a4159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 -- 172.21.15.57:0/2327411535 >> 172.21.15.57:0/2327411535 conn(0x7f18a406e790 msgr2=0x7f18a406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 -- 172.21.15.57:0/2327411535 shutdown_connections 2023-10-16T19:41:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.217+0000 7f18aa939640 1 -- 172.21.15.57:0/2327411535 wait complete. 2023-10-16T19:41:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.219+0000 7f18aa939640 1 Processor -- start 2023-10-16T19:41:05.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.219+0000 7f18aa939640 1 -- start start 2023-10-16T19:41:05.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.220+0000 7f18aa939640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.220+0000 7f18aa939640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a4150000 0x7f18a406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.220+0000 7f18aa939640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 0x7f18a41e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.220+0000 7f18aa939640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41ed860 con 0x7f18a41447e0 2023-10-16T19:41:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.220+0000 7f18aa939640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41ecfa0 con 0x7f18a4150000 2023-10-16T19:41:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.220+0000 7f18aa939640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a406b260 con 0x7f18a4071450 2023-10-16T19:41:05.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.221+0000 7f18a8ed6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 0x7f18a41e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.221+0000 7f18a8ed6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 0x7f18a41e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58578/0 (socket says 172.21.15.57:58578) 2023-10-16T19:41:05.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.221+0000 7f18a8ed6640 1 -- 172.21.15.57:0/2685385181 learned_addr learned my addr 172.21.15.57:0/2685385181 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:05.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.221+0000 7f18a3fff640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.222+0000 7f18a37fe640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a4150000 0x7f18a406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.226+0000 7f18a8ed6640 1 -- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 msgr2=0x7f18a40c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.226+0000 7f18a8ed6640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.226+0000 7f18a8ed6640 1 -- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a4150000 msgr2=0x7f18a406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.226+0000 7f18a8ed6640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a4150000 0x7f18a406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.226+0000 7f18a8ed6640 1 -- 172.21.15.57:0/2685385181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189800b770 con 0x7f18a41447e0 2023-10-16T19:41:05.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.229+0000 7f18a8ed6640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 0x7f18a41e9990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f189c00ef00 tx=0x7f189c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.234+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c010040 con 0x7f18a41447e0 2023-10-16T19:41:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.234+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c014400 con 0x7f18a41447e0 2023-10-16T19:41:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.234+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c009ea0 con 0x7f18a41447e0 2023-10-16T19:41:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.234+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a40c7e20 con 0x7f18a41447e0 2023-10-16T19:41:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.234+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a41ed4f0 con 0x7f18a41447e0 2023-10-16T19:41:05.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.236+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a40c9850 con 0x7f18a41447e0 2023-10-16T19:41:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.545+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f189c0147b0 con 0x7f18a41447e0 2023-10-16T19:41:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.547+0000 7f18a0ff9640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f189006aef0 0x7f189006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.548+0000 7f18a3fff640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f189006aef0 0x7f189006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.549+0000 7f18a3fff640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f189006aef0 0x7f189006d3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1894009aa0 tx=0x7f1894009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.581+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f189c059070 con 0x7f18a41447e0 2023-10-16T19:41:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.582+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f189c0553b0 con 0x7f18a41447e0 2023-10-16T19:41:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:05.831+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f18a40c9850 con 0x7f18a41447e0 2023-10-16T19:41:07.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.118+0000 7f18a0ff9640 1 -- 172.21.15.57:0/2685385181 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f18a40c9850 con 0x7f18a41447e0 2023-10-16T19:41:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f189006aef0 msgr2=0x7f189006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f189006aef0 0x7f189006d3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1894009aa0 tx=0x7f1894009190 comp rx=0 tx=0).stop 2023-10-16T19:41:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 msgr2=0x7f18a41e9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 0x7f18a41e9990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f189c00ef00 tx=0x7f189c00b480 comp rx=0 tx=0).stop 2023-10-16T19:41:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 shutdown_connections 2023-10-16T19:41:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f189006aef0 0x7f189006d3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18a41447e0 0x7f18a41e9990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18a4150000 0x7f18a406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 --2- 172.21.15.57:0/2685385181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18a4071450 0x7f18a40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 >> 172.21.15.57:0/2685385181 conn(0x7f18a406e790 msgr2=0x7f18a40c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 shutdown_connections 2023-10-16T19:41:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.122+0000 7f18aa939640 1 -- 172.21.15.57:0/2685385181 wait complete. 2023-10-16T19:41:07.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T19:41:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.373+0000 7f74ad22b640 1 Processor -- start 2023-10-16T19:41:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.374+0000 7f74ad22b640 1 -- start start 2023-10-16T19:41:07.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.376+0000 7f74ad22b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74a8153210 0x7f74a8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.376+0000 7f74ad22b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a81535f0 con 0x7f74a80c9710 2023-10-16T19:41:07.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.376+0000 7f74ad22b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80c4420 con 0x7f74a80ce800 2023-10-16T19:41:07.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.376+0000 7f74ad22b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8159680 con 0x7f74a8153210 2023-10-16T19:41:07.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.387+0000 7f74a6d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74a8153210 0x7f74a8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.388+0000 7f74a6d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74a8153210 0x7f74a8158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40450/0 (socket says 172.21.15.57:40450) 2023-10-16T19:41:07.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.388+0000 7f74a6d9d640 1 -- 172.21.15.57:0/1932927618 learned_addr learned my addr 172.21.15.57:0/1932927618 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:07.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.393+0000 7f74a6d9d640 1 -- 172.21.15.57:0/1932927618 >> v1:172.21.15.110:6789/0 conn(0x7f74a80ce800 legacy=0x7f74a81637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:07.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.393+0000 7f74a6d9d640 1 -- 172.21.15.57:0/1932927618 >> v1:172.21.15.57:6789/0 conn(0x7f74a80c9710 legacy=0x7f74a80c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.393+0000 7f74a6d9d640 1 -- 172.21.15.57:0/1932927618 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8159960 con 0x7f74a8153210 2023-10-16T19:41:07.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.398+0000 7f74a6d9d640 1 --2- 172.21.15.57:0/1932927618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a8153210 0x7f74a8158e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7498009870 tx=0x7f749802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbddd4d3722691a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:07.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.403+0000 7f74a5d9b640 1 -- 172.21.15.57:0/1932927618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498030850 con 0x7f74a8153210 2023-10-16T19:41:07.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.403+0000 7f74a5d9b640 1 -- 172.21.15.57:0/1932927618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74980309b0 con 0x7f74a8153210 2023-10-16T19:41:07.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.403+0000 7f74a5d9b640 1 -- 172.21.15.57:0/1932927618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498030d40 con 0x7f74a8153210 2023-10-16T19:41:07.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 -- 172.21.15.57:0/1932927618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a8153210 msgr2=0x7f74a8158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 --2- 172.21.15.57:0/1932927618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a8153210 0x7f74a8158e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7498009870 tx=0x7f749802b990 comp rx=0 tx=0).stop 2023-10-16T19:41:07.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 -- 172.21.15.57:0/1932927618 shutdown_connections 2023-10-16T19:41:07.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 --2- 172.21.15.57:0/1932927618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a8153210 0x7f74a8158e60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 -- 172.21.15.57:0/1932927618 >> 172.21.15.57:0/1932927618 conn(0x7f74a806ac80 msgr2=0x7f74a806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:07.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 -- 172.21.15.57:0/1932927618 shutdown_connections 2023-10-16T19:41:07.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.405+0000 7f74ad22b640 1 -- 172.21.15.57:0/1932927618 wait complete. 2023-10-16T19:41:07.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.407+0000 7f74ad22b640 1 Processor -- start 2023-10-16T19:41:07.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.408+0000 7f74ad22b640 1 -- start start 2023-10-16T19:41:07.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.409+0000 7f74ad22b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 0x7f74a81eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.409+0000 7f74ad22b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a80ce800 0x7f74a80b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.409+0000 7f74ad22b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a8153210 0x7f74a81585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.409+0000 7f74ad22b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8154690 con 0x7f74a80c9710 2023-10-16T19:41:07.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.409+0000 7f74ad22b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80b4830 con 0x7f74a8153210 2023-10-16T19:41:07.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.409+0000 7f74ad22b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80b38a0 con 0x7f74a80ce800 2023-10-16T19:41:07.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.411+0000 7f74a6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 0x7f74a81eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.411+0000 7f74a759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a8153210 0x7f74a81585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.411+0000 7f74a6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 0x7f74a81eeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40460/0 (socket says 172.21.15.57:40460) 2023-10-16T19:41:07.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.411+0000 7f74a6d9d640 1 -- 172.21.15.57:0/360854939 learned_addr learned my addr 172.21.15.57:0/360854939 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.416+0000 7f74a6d9d640 1 -- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a80ce800 msgr2=0x7f74a80b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.416+0000 7f74a659c640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a80ce800 0x7f74a80b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.416+0000 7f74a6d9d640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a80ce800 0x7f74a80b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.416+0000 7f74a6d9d640 1 -- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a8153210 msgr2=0x7f74a81585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.416+0000 7f74a6d9d640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a8153210 0x7f74a81585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.416+0000 7f74a6d9d640 1 -- 172.21.15.57:0/360854939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980094d0 con 0x7f74a80c9710 2023-10-16T19:41:07.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.421+0000 7f74a6d9d640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 0x7f74a81eeed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7498000c00 tx=0x7f7498004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:07.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.433+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498030800 con 0x7f74a80c9710 2023-10-16T19:41:07.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.433+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498039d90 con 0x7f74a80c9710 2023-10-16T19:41:07.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.433+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498043650 con 0x7f74a80c9710 2023-10-16T19:41:07.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.433+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a80b3e60 con 0x7f74a80c9710 2023-10-16T19:41:07.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.433+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a80c5eb0 con 0x7f74a80c9710 2023-10-16T19:41:07.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.435+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804e160 con 0x7f74a80c9710 2023-10-16T19:41:07.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.861+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f749802e070 con 0x7f74a80c9710 2023-10-16T19:41:07.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.864+0000 7f748f7fe640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f749406aef0 0x7f749406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.865+0000 7f74a659c640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f749406aef0 0x7f749406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.867+0000 7f74a659c640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f749406aef0 0x7f749406d3b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74a8152400 tx=0x7f749c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:07.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.906+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7498044e60 con 0x7f74a80c9710 2023-10-16T19:41:07.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:07.907+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74980772b0 con 0x7f74a80c9710 2023-10-16T19:41:08.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.166+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74a80b1710 con 0x7f74a80c9710 2023-10-16T19:41:08.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.848+0000 7f748f7fe640 1 -- 172.21.15.57:0/360854939 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f749807a8d0 con 0x7f74a80c9710 2023-10-16T19:41:08.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f749406aef0 msgr2=0x7f749406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f749406aef0 0x7f749406d3b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74a8152400 tx=0x7f749c009040 comp rx=0 tx=0).stop 2023-10-16T19:41:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 msgr2=0x7f74a81eeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 0x7f74a81eeed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7498000c00 tx=0x7f7498004730 comp rx=0 tx=0).stop 2023-10-16T19:41:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 shutdown_connections 2023-10-16T19:41:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f749406aef0 0x7f749406d3b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a8153210 0x7f74a81585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a80ce800 0x7f74a80b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 --2- 172.21.15.57:0/360854939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74a80c9710 0x7f74a81eeed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 >> 172.21.15.57:0/360854939 conn(0x7f74a806ac80 msgr2=0x7f74a80cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:08.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 shutdown_connections 2023-10-16T19:41:08.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:08.852+0000 7f74ad22b640 1 -- 172.21.15.57:0/360854939 wait complete. 2023-10-16T19:41:08.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-16T19:41:09.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.099+0000 7f233b59e640 1 Processor -- start 2023-10-16T19:41:09.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.099+0000 7f233b59e640 1 -- start start 2023-10-16T19:41:09.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.101+0000 7f233b59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f233c06a430 0x7f233c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.101+0000 7f233b59e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c15c6a0 con 0x7f233c0caf00 2023-10-16T19:41:09.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.101+0000 7f233b59e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0bfa40 con 0x7f233c06a050 2023-10-16T19:41:09.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.101+0000 7f233b59e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0c05c0 con 0x7f233c06a430 2023-10-16T19:41:09.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.102+0000 7f2333fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f233c0caf00 0x7f233c15cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37774/0 (socket says 172.21.15.57:37774) 2023-10-16T19:41:09.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.102+0000 7f2333fff640 1 -- 172.21.15.57:0/2908653683 learned_addr learned my addr 172.21.15.57:0/2908653683 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:09.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.104+0000 7f233ad9d640 1 --2- 172.21.15.57:0/2908653683 >> v2:172.21.15.110:3300/0 conn(0x7f233c06a430 0x7f233c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.106+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547081179 0 0) 0x7f233c15c6a0 con 0x7f233c0caf00 2023-10-16T19:41:09.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.106+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2328003520 con 0x7f233c0caf00 2023-10-16T19:41:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.109+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344228159 0 0) 0x7f2328003520 con 0x7f233c0caf00 2023-10-16T19:41:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 >> v2:172.21.15.110:3300/0 conn(0x7f233c06a430 msgr2=0x7f233c1593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 --2- 172.21.15.57:0/2908653683 >> v2:172.21.15.110:3300/0 conn(0x7f233c06a430 0x7f233c1593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 >> v1:172.21.15.110:6789/0 conn(0x7f233c06a050 legacy=0x7f233c0bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0bfd20 con 0x7f233c0caf00 2023-10-16T19:41:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f2324001670 con 0x7f233c0caf00 2023-10-16T19:41:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 >> v1:172.21.15.57:6789/0 conn(0x7f233c0caf00 legacy=0x7f233c15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23280039c0 0x7f2328003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f2328004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23280051d0 0x7f232800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232800c0f0 con 0x7f23280047c0 2023-10-16T19:41:09.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232800c260 con 0x7f23280039c0 2023-10-16T19:41:09.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.110+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232800c420 con 0x7f23280051d0 2023-10-16T19:41:09.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.111+0000 7f233ad9d640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23280051d0 0x7f232800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.112+0000 7f2333fff640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f2328004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.123+0000 7f2333fff640 1 -- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23280051d0 msgr2=0x7f232800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:09.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.124+0000 7f2333fff640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23280051d0 0x7f232800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.124+0000 7f2333fff640 1 -- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23280039c0 msgr2=0x7f2328003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:09.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.124+0000 7f2333fff640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23280039c0 0x7f2328003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.124+0000 7f2333fff640 1 -- 172.21.15.57:0/2908653683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328003520 con 0x7f23280047c0 2023-10-16T19:41:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.124+0000 7f233ad9d640 1 -- 172.21.15.57:0/2908653683 reap_dead start 2023-10-16T19:41:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.126+0000 7f2333fff640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f2328004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2324001eb0 tx=0x7f23280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97ae92e02ddc356 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:09.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.132+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324005ad0 con 0x7f23280047c0 2023-10-16T19:41:09.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.132+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324005c30 con 0x7f23280047c0 2023-10-16T19:41:09.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.132+0000 7f2339d9b640 1 -- 172.21.15.57:0/2908653683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240072b0 con 0x7f23280047c0 2023-10-16T19:41:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.132+0000 7f233b59e640 1 -- 172.21.15.57:0/2908653683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 msgr2=0x7f2328004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.132+0000 7f233b59e640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f2328004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2324001eb0 tx=0x7f23280057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.133+0000 7f233b59e640 1 -- 172.21.15.57:0/2908653683 shutdown_connections 2023-10-16T19:41:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.133+0000 7f233b59e640 1 --2- 172.21.15.57:0/2908653683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f2328004c40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.133+0000 7f233b59e640 1 -- 172.21.15.57:0/2908653683 >> 172.21.15.57:0/2908653683 conn(0x7f233c06db70 msgr2=0x7f233c0ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.133+0000 7f233b59e640 1 -- 172.21.15.57:0/2908653683 shutdown_connections 2023-10-16T19:41:09.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.133+0000 7f233b59e640 1 -- 172.21.15.57:0/2908653683 wait complete. 2023-10-16T19:41:09.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.135+0000 7f233b59e640 1 Processor -- start 2023-10-16T19:41:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.135+0000 7f233b59e640 1 -- start start 2023-10-16T19:41:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.136+0000 7f233b59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f233c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.136+0000 7f233b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233c0c90f0 0x7f233c14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.136+0000 7f233b59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f233c14e570 0x7f233c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.136+0000 7f233b59e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c14e9f0 con 0x7f23280047c0 2023-10-16T19:41:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.136+0000 7f233b59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c1536e0 con 0x7f233c14e570 2023-10-16T19:41:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.136+0000 7f233b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c8da0 con 0x7f233c0c90f0 2023-10-16T19:41:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.137+0000 7f233a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f233c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.137+0000 7f233a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f233c153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40486/0 (socket says 172.21.15.57:40486) 2023-10-16T19:41:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.137+0000 7f233a59c640 1 -- 172.21.15.57:0/2737104829 learned_addr learned my addr 172.21.15.57:0/2737104829 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.140+0000 7f233ad9d640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f233c14e570 0x7f233c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.141+0000 7f233a59c640 1 -- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233c0c90f0 msgr2=0x7f233c14e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.141+0000 7f233a59c640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233c0c90f0 0x7f233c14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.141+0000 7f233a59c640 1 -- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f233c14e570 msgr2=0x7f233c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.141+0000 7f233a59c640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f233c14e570 0x7f233c0aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.141+0000 7f233a59c640 1 -- 172.21.15.57:0/2737104829 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0c9970 con 0x7f23280047c0 2023-10-16T19:41:09.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.144+0000 7f233a59c640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f233c153ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f232c001eb0 tx=0x7f232c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:09.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.148+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0052d0 con 0x7f23280047c0 2023-10-16T19:41:09.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.148+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c005450 con 0x7f23280047c0 2023-10-16T19:41:09.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.148+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0c9c50 con 0x7f23280047c0 2023-10-16T19:41:09.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.148+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c012870 con 0x7f23280047c0 2023-10-16T19:41:09.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.149+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0c9f30 con 0x7f23280047c0 2023-10-16T19:41:09.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.150+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c04e160 con 0x7f23280047c0 2023-10-16T19:41:09.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.174+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f232c0129d0 con 0x7f23280047c0 2023-10-16T19:41:09.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.175+0000 7f2332ffd640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f231c06aec0 0x7f231c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.176+0000 7f2333fff640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f231c06aec0 0x7f231c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.177+0000 7f2333fff640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f231c06aec0 0x7f231c06d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2324034000 tx=0x7f2324039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:09.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.178+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f232c059100 con 0x7f23280047c0 2023-10-16T19:41:09.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.490+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f232c054d40 con 0x7f23280047c0 2023-10-16T19:41:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:09.773+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f233c06c7d0 con 0x7f23280047c0 2023-10-16T19:41:10.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.707+0000 7f2332ffd640 1 -- 172.21.15.57:0/2737104829 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f232c019300 con 0x7f23280047c0 2023-10-16T19:41:10.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f231c06aec0 msgr2=0x7f231c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f231c06aec0 0x7f231c06d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2324034000 tx=0x7f2324039040 comp rx=0 tx=0).stop 2023-10-16T19:41:10.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 msgr2=0x7f233c153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f233c153ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f232c001eb0 tx=0x7f232c00c960 comp rx=0 tx=0).stop 2023-10-16T19:41:10.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 shutdown_connections 2023-10-16T19:41:10.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f231c06aec0 0x7f231c06d380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f233c14e570 0x7f233c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233c0c90f0 0x7f233c14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 --2- 172.21.15.57:0/2737104829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23280047c0 0x7f233c153ea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 >> 172.21.15.57:0/2737104829 conn(0x7f233c06db70 msgr2=0x7f233c154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:10.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 shutdown_connections 2023-10-16T19:41:10.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.710+0000 7f233b59e640 1 -- 172.21.15.57:0/2737104829 wait complete. 2023-10-16T19:41:10.732 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T19:41:10.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:41:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.962+0000 7fcf8fc75640 1 Processor -- start 2023-10-16T19:41:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.962+0000 7fcf8fc75640 1 -- start start 2023-10-16T19:41:10.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.964+0000 7fcf8fc75640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf880c4ba0 0x7fcf880c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.964+0000 7fcf8fc75640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf880c9a30 con 0x7fcf880ca900 2023-10-16T19:41:10.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.964+0000 7fcf8fc75640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf880c4710 con 0x7fcf88153170 2023-10-16T19:41:10.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.964+0000 7fcf8fc75640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf880c9260 con 0x7fcf880c4ba0 2023-10-16T19:41:10.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.965+0000 7fcf8d210640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf880c4ba0 0x7fcf880c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.965+0000 7fcf8e212640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcf880ca900 0x7fcf8806b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37784/0 (socket says 172.21.15.57:37784) 2023-10-16T19:41:10.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.965+0000 7fcf8e212640 1 -- 172.21.15.57:0/3336984163 learned_addr learned my addr 172.21.15.57:0/3336984163 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:10.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.969+0000 7fcf8d210640 1 -- 172.21.15.57:0/3336984163 >> v1:172.21.15.110:6789/0 conn(0x7fcf88153170 legacy=0x7fcf88158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:10.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.969+0000 7fcf8d210640 1 -- 172.21.15.57:0/3336984163 >> v1:172.21.15.57:6789/0 conn(0x7fcf880ca900 legacy=0x7fcf8806b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.969+0000 7fcf8d210640 1 -- 172.21.15.57:0/3336984163 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88153550 con 0x7fcf880c4ba0 2023-10-16T19:41:10.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.974+0000 7fcf8d210640 1 --2- 172.21.15.57:0/3336984163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf880c4ba0 0x7fcf880c3a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf780097a0 tx=0x7fcf7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3d313a03e2b179 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:10.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.980+0000 7fcf8ca0f640 1 -- 172.21.15.57:0/3336984163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78031830 con 0x7fcf880c4ba0 2023-10-16T19:41:10.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.980+0000 7fcf8ca0f640 1 -- 172.21.15.57:0/3336984163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78031990 con 0x7fcf880c4ba0 2023-10-16T19:41:10.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.980+0000 7fcf8ca0f640 1 -- 172.21.15.57:0/3336984163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78031d20 con 0x7fcf880c4ba0 2023-10-16T19:41:10.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 -- 172.21.15.57:0/3336984163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf880c4ba0 msgr2=0x7fcf880c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/3336984163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf880c4ba0 0x7fcf880c3a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf780097a0 tx=0x7fcf7802b8d0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 -- 172.21.15.57:0/3336984163 shutdown_connections 2023-10-16T19:41:10.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/3336984163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf880c4ba0 0x7fcf880c3a90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 -- 172.21.15.57:0/3336984163 >> 172.21.15.57:0/3336984163 conn(0x7fcf88071720 msgr2=0x7fcf8806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:10.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 -- 172.21.15.57:0/3336984163 shutdown_connections 2023-10-16T19:41:10.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.981+0000 7fcf8fc75640 1 -- 172.21.15.57:0/3336984163 wait complete. 2023-10-16T19:41:10.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.983+0000 7fcf8fc75640 1 Processor -- start 2023-10-16T19:41:10.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.983+0000 7fcf8fc75640 1 -- start start 2023-10-16T19:41:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.985+0000 7fcf8fc75640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf880c4ba0 0x7fcf881eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.985+0000 7fcf8fc75640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf880ca900 0x7fcf88142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.985+0000 7fcf8fc75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 0x7fcf88157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.985+0000 7fcf8fc75640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880b26a0 con 0x7fcf88153170 2023-10-16T19:41:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.985+0000 7fcf8fc75640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf881e27f0 con 0x7fcf880ca900 2023-10-16T19:41:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.985+0000 7fcf8fc75640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8814d340 con 0x7fcf880c4ba0 2023-10-16T19:41:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.986+0000 7fcf8e212640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 0x7fcf88157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.986+0000 7fcf8e212640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 0x7fcf88157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40504/0 (socket says 172.21.15.57:40504) 2023-10-16T19:41:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.986+0000 7fcf8e212640 1 -- 172.21.15.57:0/2286777530 learned_addr learned my addr 172.21.15.57:0/2286777530 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:10.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.986+0000 7fcf8da11640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf880c4ba0 0x7fcf881eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.990+0000 7fcf8e212640 1 -- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf880c4ba0 msgr2=0x7fcf881eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.990+0000 7fcf8e212640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf880c4ba0 0x7fcf881eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.990+0000 7fcf8e212640 1 -- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf880ca900 msgr2=0x7fcf88142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.990+0000 7fcf8e212640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf880ca900 0x7fcf88142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.990+0000 7fcf8e212640 1 -- 172.21.15.57:0/2286777530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009400 con 0x7fcf88153170 2023-10-16T19:41:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.993+0000 7fcf8e212640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 0x7fcf88157db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000cbc0 tx=0x7fcf8000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:10.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.996+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000ad40 con 0x7fcf88153170 2023-10-16T19:41:10.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.996+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf881e3390 con 0x7fcf88153170 2023-10-16T19:41:10.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.997+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf881f2600 con 0x7fcf88153170 2023-10-16T19:41:11.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.997+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80001c00 con 0x7fcf88153170 2023-10-16T19:41:11.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.997+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000aea0 con 0x7fcf88153170 2023-10-16T19:41:11.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:10.998+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf70005250 con 0x7fcf88153170 2023-10-16T19:41:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.023+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf8001c640 con 0x7fcf88153170 2023-10-16T19:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.025+0000 7fcf7e7fc640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcf6c06ae70 0x7fcf6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.025+0000 7fcf8da11640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcf6c06ae70 0x7fcf6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.026+0000 7fcf8da11640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcf6c06ae70 0x7fcf6c06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf840017f0 tx=0x7fcf84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.341+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf80058b60 con 0x7fcf88153170 2023-10-16T19:41:11.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.342+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf80058930 con 0x7fcf88153170 2023-10-16T19:41:11.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.602+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf700057d0 con 0x7fcf88153170 2023-10-16T19:41:11.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.669+0000 7fcf7e7fc640 1 -- 172.21.15.57:0/2286777530 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6506 (secure 0 0 0) 0x7fcf80021090 con 0x7fcf88153170 2023-10-16T19:41:11.672 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:11.672 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:40:59.056046+0000","modified":"2023-10-16T19:41:09.794946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4250,"mds_1":4247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4247":{"gid":4247,"name":"d","rank":1,"incarnation":8,"state":"up:creating","state_seq":1,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:41:11.673 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 10 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcf6c06ae70 msgr2=0x7fcf6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcf6c06ae70 0x7fcf6c06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf840017f0 tx=0x7fcf84009040 comp rx=0 tx=0).stop 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 msgr2=0x7fcf88157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 0x7fcf88157db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000cbc0 tx=0x7fcf8000a430 comp rx=0 tx=0).stop 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 shutdown_connections 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcf6c06ae70 0x7fcf6c06d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf88153170 0x7fcf88157db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf880ca900 0x7fcf88142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 --2- 172.21.15.57:0/2286777530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf880c4ba0 0x7fcf881eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 >> 172.21.15.57:0/2286777530 conn(0x7fcf88071720 msgr2=0x7fcf8814e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.672+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 shutdown_connections 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.673+0000 7fcf8fc75640 1 -- 172.21.15.57:0/2286777530 wait complete. 2023-10-16T19:41:11.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:11.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.906+0000 7fec151d5640 1 Processor -- start 2023-10-16T19:41:11.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.906+0000 7fec151d5640 1 -- start start 2023-10-16T19:41:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.908+0000 7fec151d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.908+0000 7fec151d5640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1015c5a0 con 0x7fec101531a0 2023-10-16T19:41:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.908+0000 7fec151d5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1015d400 con 0x7fec100cb870 2023-10-16T19:41:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.908+0000 7fec151d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100c96e0 con 0x7fec100c92a0 2023-10-16T19:41:11.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.910+0000 7fec0f59e640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fec100cb870 0x7fec100ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:41986/0 (socket says 172.21.15.57:41986) 2023-10-16T19:41:11.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.910+0000 7fec0f59e640 1 -- 172.21.15.57:0/1926710517 learned_addr learned my addr 172.21.15.57:0/1926710517 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:11.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.910+0000 7fec07fff640 1 --2- 172.21.15.57:0/1926710517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.918+0000 7fec07fff640 1 -- 172.21.15.57:0/1926710517 >> v1:172.21.15.110:6789/0 conn(0x7fec100cb870 legacy=0x7fec100ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.918+0000 7fec07fff640 1 -- 172.21.15.57:0/1926710517 >> v1:172.21.15.57:6789/0 conn(0x7fec101531a0 legacy=0x7fec101599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:11.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.918+0000 7fec07fff640 1 -- 172.21.15.57:0/1926710517 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1015c7f0 con 0x7fec100c92a0 2023-10-16T19:41:11.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.924+0000 7fec07fff640 1 --2- 172.21.15.57:0/1926710517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100cb330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febf80097d0 tx=0x7febf802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e98d9cd0fdbe9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.938+0000 7fec0e59c640 1 -- 172.21.15.57:0/1926710517 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8031890 con 0x7fec100c92a0 2023-10-16T19:41:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.938+0000 7fec0e59c640 1 -- 172.21.15.57:0/1926710517 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80319f0 con 0x7fec100c92a0 2023-10-16T19:41:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.938+0000 7fec0e59c640 1 -- 172.21.15.57:0/1926710517 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8031d80 con 0x7fec100c92a0 2023-10-16T19:41:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 -- 172.21.15.57:0/1926710517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 msgr2=0x7fec100cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 --2- 172.21.15.57:0/1926710517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100cb330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febf80097d0 tx=0x7febf802b930 comp rx=0 tx=0).stop 2023-10-16T19:41:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 -- 172.21.15.57:0/1926710517 shutdown_connections 2023-10-16T19:41:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 --2- 172.21.15.57:0/1926710517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100cb330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 -- 172.21.15.57:0/1926710517 >> 172.21.15.57:0/1926710517 conn(0x7fec10071510 msgr2=0x7fec100659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 -- 172.21.15.57:0/1926710517 shutdown_connections 2023-10-16T19:41:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.939+0000 7fec151d5640 1 -- 172.21.15.57:0/1926710517 wait complete. 2023-10-16T19:41:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.941+0000 7fec151d5640 1 Processor -- start 2023-10-16T19:41:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.941+0000 7fec151d5640 1 -- start start 2023-10-16T19:41:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.942+0000 7fec151d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.942+0000 7fec151d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 0x7fec10140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.942+0000 7fec151d5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec101531a0 0x7fec10148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.942+0000 7fec151d5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101eeac0 con 0x7fec101531a0 2023-10-16T19:41:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.942+0000 7fec151d5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101f2fa0 con 0x7fec100cb870 2023-10-16T19:41:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.942+0000 7fec151d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec101f2140 con 0x7fec100c92a0 2023-10-16T19:41:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.944+0000 7fec07fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 0x7fec10140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.945+0000 7fec07fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 0x7fec10140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:46600/0 (socket says 172.21.15.57:46600) 2023-10-16T19:41:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.945+0000 7fec07fff640 1 -- 172.21.15.57:0/3100008052 learned_addr learned my addr 172.21.15.57:0/3100008052 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.946+0000 7fec0ed9d640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.955+0000 7fec07fff640 1 -- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 msgr2=0x7fec100b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.955+0000 7fec07fff640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.955+0000 7fec07fff640 1 -- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec101531a0 msgr2=0x7fec10148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.955+0000 7fec07fff640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec101531a0 0x7fec10148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.955+0000 7fec07fff640 1 -- 172.21.15.57:0/3100008052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8009400 con 0x7fec100cb870 2023-10-16T19:41:11.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.963+0000 7fec07fff640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 0x7fec10140920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7febf80097d0 tx=0x7febf80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.975+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8031830 con 0x7fec100cb870 2023-10-16T19:41:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.975+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80443f0 con 0x7fec100cb870 2023-10-16T19:41:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.975+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80447a0 con 0x7fec100cb870 2023-10-16T19:41:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.975+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec101f2420 con 0x7fec100cb870 2023-10-16T19:41:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.976+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec101f29e0 con 0x7fec100cb870 2023-10-16T19:41:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:11.978+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec100cb1a0 con 0x7fec100cb870 2023-10-16T19:41:12.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.328+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7febf804d450 con 0x7fec100cb870 2023-10-16T19:41:12.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.331+0000 7fec077fe640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7febf006aec0 0x7febf006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.332+0000 7fec0ed9d640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7febf006aec0 0x7febf006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.333+0000 7fec0ed9d640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7febf006aec0 0x7febf006d380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec000017f0 tx=0x7fec00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.381+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febf807b650 con 0x7fec100cb870 2023-10-16T19:41:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.422+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febf8077290 con 0x7fec100cb870 2023-10-16T19:41:12.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.646+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec1004e1d0 con 0x7fec100cb870 2023-10-16T19:41:12.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.980+0000 7fec077fe640 1 -- 172.21.15.57:0/3100008052 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16493 (secure 0 0 0) 0x7febf807a8b0 con 0x7fec100cb870 2023-10-16T19:41:12.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:12.984 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:00.442991+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.983+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7febf006aec0 msgr2=0x7febf006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.983+0000 7fec151d5640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7febf006aec0 0x7febf006d380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec000017f0 tx=0x7fec00009040 comp rx=0 tx=0).stop 2023-10-16T19:41:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 msgr2=0x7fec10140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 0x7fec10140920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7febf80097d0 tx=0x7febf80046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 shutdown_connections 2023-10-16T19:41:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7febf006aec0 0x7febf006d380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec101531a0 0x7fec10148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec100cb870 0x7fec10140920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 --2- 172.21.15.57:0/3100008052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec100c92a0 0x7fec100b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 >> 172.21.15.57:0/3100008052 conn(0x7fec10071510 msgr2=0x7fec100c37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:12.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 shutdown_connections 2023-10-16T19:41:12.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:12.984+0000 7fec151d5640 1 -- 172.21.15.57:0/3100008052 wait complete. 2023-10-16T19:41:13.010 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T19:41:13.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:13.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.225+0000 7f1c2e0a9640 1 Processor -- start 2023-10-16T19:41:13.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.225+0000 7f1c2e0a9640 1 -- start start 2023-10-16T19:41:13.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.227+0000 7f1c2e0a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c28151190 0x7f1c280c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.227+0000 7f1c2e0a9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c280c2aa0 0x7f1c2806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.227+0000 7f1c2e0a9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c28151570 con 0x7f1c280c12f0 2023-10-16T19:41:13.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.227+0000 7f1c2e0a9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c280c4010 con 0x7f1c280c2aa0 2023-10-16T19:41:13.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.227+0000 7f1c2e0a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280c1ce0 con 0x7f1c28151190 2023-10-16T19:41:13.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.228+0000 7f1c27fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c280c2aa0 0x7f1c2806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.228+0000 7f1c26ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1c280c12f0 0x7f1c2806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37810/0 (socket says 172.21.15.57:37810) 2023-10-16T19:41:13.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.228+0000 7f1c26ffd640 1 -- 172.21.15.57:0/3015441325 learned_addr learned my addr 172.21.15.57:0/3015441325 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:13.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.228+0000 7f1c277fe640 1 --2- 172.21.15.57:0/3015441325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c28151190 0x7f1c280c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.235+0000 7f1c27fff640 1 -- 172.21.15.57:0/3015441325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c28151190 msgr2=0x7f1c280c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:13.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.235+0000 7f1c27fff640 1 --2- 172.21.15.57:0/3015441325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c28151190 0x7f1c280c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.235+0000 7f1c27fff640 1 -- 172.21.15.57:0/3015441325 >> v1:172.21.15.57:6789/0 conn(0x7f1c280c12f0 legacy=0x7f1c2806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.235+0000 7f1c27fff640 1 -- 172.21.15.57:0/3015441325 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280c5530 con 0x7f1c280c2aa0 2023-10-16T19:41:13.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.241+0000 7f1c27fff640 1 --2- 172.21.15.57:0/3015441325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c280c2aa0 0x7f1c2806dce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c280c4150 tx=0x7f1c2002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9074768eda57d20e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.246+0000 7f1c267fc640 1 -- 172.21.15.57:0/3015441325 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2002d040 con 0x7f1c280c2aa0 2023-10-16T19:41:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.247+0000 7f1c267fc640 1 -- 172.21.15.57:0/3015441325 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20031810 con 0x7f1c280c2aa0 2023-10-16T19:41:13.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.247+0000 7f1c267fc640 1 -- 172.21.15.57:0/3015441325 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20031ba0 con 0x7f1c280c2aa0 2023-10-16T19:41:13.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/3015441325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c280c2aa0 msgr2=0x7f1c2806dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/3015441325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c280c2aa0 0x7f1c2806dce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c280c4150 tx=0x7f1c2002b8b0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/3015441325 shutdown_connections 2023-10-16T19:41:13.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/3015441325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c280c2aa0 0x7f1c2806dce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/3015441325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c28151190 0x7f1c280c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/3015441325 >> 172.21.15.57:0/3015441325 conn(0x7f1c2806c430 msgr2=0x7f1c28069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:13.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/3015441325 shutdown_connections 2023-10-16T19:41:13.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.248+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/3015441325 wait complete. 2023-10-16T19:41:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.251+0000 7f1c2e0a9640 1 Processor -- start 2023-10-16T19:41:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.251+0000 7f1c2e0a9640 1 -- start start 2023-10-16T19:41:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.253+0000 7f1c2e0a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c280c12f0 0x7f1c280bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.253+0000 7f1c2e0a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c280c2aa0 0x7f1c2814eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.253+0000 7f1c2e0a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 0x7f1c281f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.253+0000 7f1c2e0a9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2814cfa0 con 0x7f1c28151190 2023-10-16T19:41:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.253+0000 7f1c2e0a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2814ccc0 con 0x7f1c280c2aa0 2023-10-16T19:41:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.253+0000 7f1c2e0a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280c9ba0 con 0x7f1c280c12f0 2023-10-16T19:41:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.254+0000 7f1c27fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 0x7f1c281f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.254+0000 7f1c27fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 0x7f1c281f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40516/0 (socket says 172.21.15.57:40516) 2023-10-16T19:41:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.254+0000 7f1c27fff640 1 -- 172.21.15.57:0/1294423845 learned_addr learned my addr 172.21.15.57:0/1294423845 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.255+0000 7f1c26ffd640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c280c2aa0 0x7f1c2814eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.255+0000 7f1c277fe640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c280c12f0 0x7f1c280bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.258+0000 7f1c27fff640 1 -- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c280c12f0 msgr2=0x7f1c280bf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.258+0000 7f1c27fff640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c280c12f0 0x7f1c280bf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.258+0000 7f1c27fff640 1 -- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c280c2aa0 msgr2=0x7f1c2814eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.258+0000 7f1c27fff640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c280c2aa0 0x7f1c2814eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.258+0000 7f1c27fff640 1 -- 172.21.15.57:0/1294423845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20009400 con 0x7f1c28151190 2023-10-16T19:41:13.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.261+0000 7f1c27fff640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 0x7f1c281f16b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009890 tx=0x7f1c200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.266+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20006e10 con 0x7f1c28151190 2023-10-16T19:41:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.266+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2003ace0 con 0x7f1c28151190 2023-10-16T19:41:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.266+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20044630 con 0x7f1c28151190 2023-10-16T19:41:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.266+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c280c9e80 con 0x7f1c28151190 2023-10-16T19:41:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.266+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c280bdf80 con 0x7f1c28151190 2023-10-16T19:41:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.267+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c280ca680 con 0x7f1c28151190 2023-10-16T19:41:13.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.290+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c20044790 con 0x7f1c28151190 2023-10-16T19:41:13.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.291+0000 7f1c1ffff640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1c0806aec0 0x7f1c0806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.292+0000 7f1c277fe640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1c0806aec0 0x7f1c0806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.293+0000 7f1c277fe640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1c0806aec0 0x7f1c0806d380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c18011340 tx=0x7f1c1800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:13.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:13.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:13.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.594+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c2007a9e0 con 0x7f1c28151190 2023-10-16T19:41:13.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.595+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c20076d20 con 0x7f1c28151190 2023-10-16T19:41:13.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.812+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c2815af20 con 0x7f1c0806aec0 2023-10-16T19:41:13.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.825+0000 7f1c1ffff640 1 -- 172.21.15.57:0/1294423845 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264505 (secure 0 0 0) 0x7f1c1800f040 con 0x7f1c0806aec0 2023-10-16T19:41:13.830 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:13.834 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T19:41:13.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1c0806aec0 msgr2=0x7f1c0806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1c0806aec0 0x7f1c0806d380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c18011340 tx=0x7f1c1800b040 comp rx=0 tx=0).stop 2023-10-16T19:41:13.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 msgr2=0x7f1c281f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 0x7f1c281f16b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009890 tx=0x7f1c200046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 shutdown_connections 2023-10-16T19:41:13.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f1c0806aec0 0x7f1c0806d380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c28151190 0x7f1c281f16b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c280c2aa0 0x7f1c2814eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 --2- 172.21.15.57:0/1294423845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c280c12f0 0x7f1c280bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 >> 172.21.15.57:0/1294423845 conn(0x7f1c2806c430 msgr2=0x7f1c28158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:13.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 shutdown_connections 2023-10-16T19:41:13.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:13.831+0000 7f1c2e0a9640 1 -- 172.21.15.57:0/1294423845 wait complete. 2023-10-16T19:41:13.853 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-16T19:41:13.447365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594184,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":243,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226512,"kb_used_data":2064,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754748208,"statfs":{"total":773094113280,"available":772862164992,"internally_reserved":0,"allocated":2113536,"data_stored":1858144,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":229756472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3816,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004133"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813951+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T19:41:00.813951+0000","last_peered":"2023-10-16T19:41:00.813951+0000","last_clean":"2023-10-16T19:41:00.813951+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T19:41:00.813951+0000","last_undegraded":"2023-10-16T19:41:00.813951+0000","last_fullsized":"2023-10-16T19:41:00.813951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746317+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T19:41:00.746317+0000","last_peered":"2023-10-16T19:41:00.746317+0000","last_clean":"2023-10-16T19:41:00.746317+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T19:41:00.746317+0000","last_undegraded":"2023-10-16T19:41:00.746317+0000","last_fullsized":"2023-10-16T19:41:00.746317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983894+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T19:41:00.983894+0000","last_peered":"2023-10-16T19:41:00.983894+0000","last_clean":"2023-10-16T19:41:00.983894+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T19:41:00.983894+0000","last_undegraded":"2023-10-16T19:41:00.983894+0000","last_fullsized":"2023-10-16T19:41:00.983894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985780+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T19:41:00.985780+0000","last_peered":"2023-10-16T19:41:00.985780+0000","last_clean":"2023-10-16T19:41:00.985780+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T19:41:00.985780+0000","last_undegraded":"2023-10-16T19:41:00.985780+0000","last_fullsized":"2023-10-16T19:41:00.985780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812868+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T19:41:00.812868+0000","last_peered":"2023-10-16T19:41:00.812868+0000","last_clean":"2023-10-16T19:41:00.812868+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T19:41:00.812868+0000","last_undegraded":"2023-10-16T19:41:00.812868+0000","last_fullsized":"2023-10-16T19:41:00.812868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985163+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T19:41:00.985163+0000","last_peered":"2023-10-16T19:41:00.985163+0000","last_clean":"2023-10-16T19:41:00.985163+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T19:41:00.985163+0000","last_undegraded":"2023-10-16T19:41:00.985163+0000","last_fullsized":"2023-10-16T19:41:00.985163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812522+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T19:41:00.812522+0000","last_peered":"2023-10-16T19:41:00.812522+0000","last_clean":"2023-10-16T19:41:00.812522+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T19:41:00.812522+0000","last_undegraded":"2023-10-16T19:41:00.812522+0000","last_fullsized":"2023-10-16T19:41:00.812522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981033+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T19:41:00.981033+0000","last_peered":"2023-10-16T19:41:00.981033+0000","last_clean":"2023-10-16T19:41:00.981033+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T19:41:00.981033+0000","last_undegraded":"2023-10-16T19:41:00.981033+0000","last_fullsized":"2023-10-16T19:41:00.981033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814034+0000","last_change":"2023-10-16T19:40:59.155274+0000","last_active":"2023-10-16T19:41:00.814034+0000","last_peered":"2023-10-16T19:41:00.814034+0000","last_clean":"2023-10-16T19:41:00.814034+0000","last_became_active":"2023-10-16T19:40:59.155045+0000","last_became_peered":"2023-10-16T19:40:59.155045+0000","last_unstale":"2023-10-16T19:41:00.814034+0000","last_undegraded":"2023-10-16T19:41:00.814034+0000","last_fullsized":"2023-10-16T19:41:00.814034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:09.928086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984830+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T19:41:00.984830+0000","last_peered":"2023-10-16T19:41:00.984830+0000","last_clean":"2023-10-16T19:41:00.984830+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T19:41:00.984830+0000","last_undegraded":"2023-10-16T19:41:00.984830+0000","last_fullsized":"2023-10-16T19:41:00.984830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986814+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T19:41:00.986814+0000","last_peered":"2023-10-16T19:41:00.986814+0000","last_clean":"2023-10-16T19:41:00.986814+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T19:41:00.986814+0000","last_undegraded":"2023-10-16T19:41:00.986814+0000","last_fullsized":"2023-10-16T19:41:00.986814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784889+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T19:41:00.784889+0000","last_peered":"2023-10-16T19:41:00.784889+0000","last_clean":"2023-10-16T19:41:00.784889+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T19:41:00.784889+0000","last_undegraded":"2023-10-16T19:41:00.784889+0000","last_fullsized":"2023-10-16T19:41:00.784889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981729+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T19:41:00.981729+0000","last_peered":"2023-10-16T19:41:00.981729+0000","last_clean":"2023-10-16T19:41:00.981729+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T19:41:00.981729+0000","last_undegraded":"2023-10-16T19:41:00.981729+0000","last_fullsized":"2023-10-16T19:41:00.981729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984167+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T19:41:00.984167+0000","last_peered":"2023-10-16T19:41:00.984167+0000","last_clean":"2023-10-16T19:41:00.984167+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T19:41:00.984167+0000","last_undegraded":"2023-10-16T19:41:00.984167+0000","last_fullsized":"2023-10-16T19:41:00.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745736+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T19:41:00.745736+0000","last_peered":"2023-10-16T19:41:00.745736+0000","last_clean":"2023-10-16T19:41:00.745736+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T19:41:00.745736+0000","last_undegraded":"2023-10-16T19:41:00.745736+0000","last_fullsized":"2023-10-16T19:41:00.745736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984540+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T19:41:00.984540+0000","last_peered":"2023-10-16T19:41:00.984540+0000","last_clean":"2023-10-16T19:41:00.984540+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T19:41:00.984540+0000","last_undegraded":"2023-10-16T19:41:00.984540+0000","last_fullsized":"2023-10-16T19:41:00.984540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987728+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T19:41:00.987728+0000","last_peered":"2023-10-16T19:41:00.987728+0000","last_clean":"2023-10-16T19:41:00.987728+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T19:41:00.987728+0000","last_undegraded":"2023-10-16T19:41:00.987728+0000","last_fullsized":"2023-10-16T19:41:00.987728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.878158+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T19:41:00.878158+0000","last_peered":"2023-10-16T19:41:00.878158+0000","last_clean":"2023-10-16T19:41:00.878158+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T19:41:00.878158+0000","last_undegraded":"2023-10-16T19:41:00.878158+0000","last_fullsized":"2023-10-16T19:41:00.878158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813704+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T19:41:00.813704+0000","last_peered":"2023-10-16T19:41:00.813704+0000","last_clean":"2023-10-16T19:41:00.813704+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T19:41:00.813704+0000","last_undegraded":"2023-10-16T19:41:00.813704+0000","last_fullsized":"2023-10-16T19:41:00.813704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986380+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T19:41:00.986380+0000","last_peered":"2023-10-16T19:41:00.986380+0000","last_clean":"2023-10-16T19:41:00.986380+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T19:41:00.986380+0000","last_undegraded":"2023-10-16T19:41:00.986380+0000","last_fullsized":"2023-10-16T19:41:00.986380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983531+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T19:41:00.983531+0000","last_peered":"2023-10-16T19:41:00.983531+0000","last_clean":"2023-10-16T19:41:00.983531+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T19:41:00.983531+0000","last_undegraded":"2023-10-16T19:41:00.983531+0000","last_fullsized":"2023-10-16T19:41:00.983531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985539+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T19:41:00.985539+0000","last_peered":"2023-10-16T19:41:00.985539+0000","last_clean":"2023-10-16T19:41:00.985539+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T19:41:00.985539+0000","last_undegraded":"2023-10-16T19:41:00.985539+0000","last_fullsized":"2023-10-16T19:41:00.985539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981092+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T19:41:00.981092+0000","last_peered":"2023-10-16T19:41:00.981092+0000","last_clean":"2023-10-16T19:41:00.981092+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T19:41:00.981092+0000","last_undegraded":"2023-10-16T19:41:00.981092+0000","last_fullsized":"2023-10-16T19:41:00.981092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984894+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T19:41:00.984894+0000","last_peered":"2023-10-16T19:41:00.984894+0000","last_clean":"2023-10-16T19:41:00.984894+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T19:41:00.984894+0000","last_undegraded":"2023-10-16T19:41:00.984894+0000","last_fullsized":"2023-10-16T19:41:00.984894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T19:41:00.982954+0000","last_peered":"2023-10-16T19:41:00.982954+0000","last_clean":"2023-10-16T19:41:00.982954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T19:41:00.982954+0000","last_undegraded":"2023-10-16T19:41:00.982954+0000","last_fullsized":"2023-10-16T19:41:00.982954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985192+0000","last_change":"2023-10-16T19:40:59.212253+0000","last_active":"2023-10-16T19:41:00.985192+0000","last_peered":"2023-10-16T19:41:00.985192+0000","last_clean":"2023-10-16T19:41:00.985192+0000","last_became_active":"2023-10-16T19:40:59.210602+0000","last_became_peered":"2023-10-16T19:40:59.210602+0000","last_unstale":"2023-10-16T19:41:00.985192+0000","last_undegraded":"2023-10-16T19:41:00.985192+0000","last_fullsized":"2023-10-16T19:41:00.985192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746131+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T19:41:00.746131+0000","last_peered":"2023-10-16T19:41:00.746131+0000","last_clean":"2023-10-16T19:41:00.746131+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T19:41:00.746131+0000","last_undegraded":"2023-10-16T19:41:00.746131+0000","last_fullsized":"2023-10-16T19:41:00.746131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982276+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T19:41:00.982276+0000","last_peered":"2023-10-16T19:41:00.982276+0000","last_clean":"2023-10-16T19:41:00.982276+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T19:41:00.982276+0000","last_undegraded":"2023-10-16T19:41:00.982276+0000","last_fullsized":"2023-10-16T19:41:00.982276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983687+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T19:41:00.983687+0000","last_peered":"2023-10-16T19:41:00.983687+0000","last_clean":"2023-10-16T19:41:00.983687+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T19:41:00.983687+0000","last_undegraded":"2023-10-16T19:41:00.983687+0000","last_fullsized":"2023-10-16T19:41:00.983687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985872+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T19:41:00.985872+0000","last_peered":"2023-10-16T19:41:00.985872+0000","last_clean":"2023-10-16T19:41:00.985872+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T19:41:00.985872+0000","last_undegraded":"2023-10-16T19:41:00.985872+0000","last_fullsized":"2023-10-16T19:41:00.985872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.877995+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T19:41:00.877995+0000","last_peered":"2023-10-16T19:41:00.877995+0000","last_clean":"2023-10-16T19:41:00.877995+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T19:41:00.877995+0000","last_undegraded":"2023-10-16T19:41:00.877995+0000","last_fullsized":"2023-10-16T19:41:00.877995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984086+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T19:41:00.984086+0000","last_peered":"2023-10-16T19:41:00.984086+0000","last_clean":"2023-10-16T19:41:00.984086+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T19:41:00.984086+0000","last_undegraded":"2023-10-16T19:41:00.984086+0000","last_fullsized":"2023-10-16T19:41:00.984086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.783983+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T19:41:00.783983+0000","last_peered":"2023-10-16T19:41:00.783983+0000","last_clean":"2023-10-16T19:41:00.783983+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T19:41:00.783983+0000","last_undegraded":"2023-10-16T19:41:00.783983+0000","last_fullsized":"2023-10-16T19:41:00.783983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.837461+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T19:41:08.837461+0000","last_peered":"2023-10-16T19:41:08.837461+0000","last_clean":"2023-10-16T19:41:08.837461+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T19:41:08.837461+0000","last_undegraded":"2023-10-16T19:41:08.837461+0000","last_fullsized":"2023-10-16T19:41:08.837461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983824+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T19:41:00.983824+0000","last_peered":"2023-10-16T19:41:00.983824+0000","last_clean":"2023-10-16T19:41:00.983824+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T19:41:00.983824+0000","last_undegraded":"2023-10-16T19:41:00.983824+0000","last_fullsized":"2023-10-16T19:41:00.983824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986073+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T19:41:00.986073+0000","last_peered":"2023-10-16T19:41:00.986073+0000","last_clean":"2023-10-16T19:41:00.986073+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T19:41:00.986073+0000","last_undegraded":"2023-10-16T19:41:00.986073+0000","last_fullsized":"2023-10-16T19:41:00.986073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.501487+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T19:40:59.501487+0000","last_peered":"2023-10-16T19:40:59.501487+0000","last_clean":"2023-10-16T19:40:59.501487+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T19:40:59.501487+0000","last_undegraded":"2023-10-16T19:40:59.501487+0000","last_fullsized":"2023-10-16T19:40:59.501487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981065+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T19:41:00.981065+0000","last_peered":"2023-10-16T19:41:00.981065+0000","last_clean":"2023-10-16T19:41:00.981065+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T19:41:00.981065+0000","last_undegraded":"2023-10-16T19:41:00.981065+0000","last_fullsized":"2023-10-16T19:41:00.981065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985228+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T19:41:00.985228+0000","last_peered":"2023-10-16T19:41:00.985228+0000","last_clean":"2023-10-16T19:41:00.985228+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T19:41:00.985228+0000","last_undegraded":"2023-10-16T19:41:00.985228+0000","last_fullsized":"2023-10-16T19:41:00.985228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745738+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T19:41:00.745738+0000","last_peered":"2023-10-16T19:41:00.745738+0000","last_clean":"2023-10-16T19:41:00.745738+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T19:41:00.745738+0000","last_undegraded":"2023-10-16T19:41:00.745738+0000","last_fullsized":"2023-10-16T19:41:00.745738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.745798+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T19:41:08.745798+0000","last_peered":"2023-10-16T19:41:08.745798+0000","last_clean":"2023-10-16T19:41:08.745798+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T19:41:08.745798+0000","last_undegraded":"2023-10-16T19:41:08.745798+0000","last_fullsized":"2023-10-16T19:41:08.745798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985111+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T19:41:00.985111+0000","last_peered":"2023-10-16T19:41:00.985111+0000","last_clean":"2023-10-16T19:41:00.985111+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T19:41:00.985111+0000","last_undegraded":"2023-10-16T19:41:00.985111+0000","last_fullsized":"2023-10-16T19:41:00.985111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.817526+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T19:41:08.817526+0000","last_peered":"2023-10-16T19:41:08.817526+0000","last_clean":"2023-10-16T19:41:08.817526+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T19:41:08.817526+0000","last_undegraded":"2023-10-16T19:41:08.817526+0000","last_fullsized":"2023-10-16T19:41:08.817526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984320+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T19:41:00.984320+0000","last_peered":"2023-10-16T19:41:00.984320+0000","last_clean":"2023-10-16T19:41:00.984320+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T19:41:00.984320+0000","last_undegraded":"2023-10-16T19:41:00.984320+0000","last_fullsized":"2023-10-16T19:41:00.984320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:01.928797+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T19:41:01.928797+0000","last_peered":"2023-10-16T19:41:01.928797+0000","last_clean":"2023-10-16T19:41:01.928797+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T19:41:01.928797+0000","last_undegraded":"2023-10-16T19:41:01.928797+0000","last_fullsized":"2023-10-16T19:41:01.928797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784901+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T19:41:00.784901+0000","last_peered":"2023-10-16T19:41:00.784901+0000","last_clean":"2023-10-16T19:41:00.784901+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T19:41:00.784901+0000","last_undegraded":"2023-10-16T19:41:00.784901+0000","last_fullsized":"2023-10-16T19:41:00.784901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.742636+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T19:41:08.742636+0000","last_peered":"2023-10-16T19:41:08.742636+0000","last_clean":"2023-10-16T19:41:08.742636+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T19:41:08.742636+0000","last_undegraded":"2023-10-16T19:41:08.742636+0000","last_fullsized":"2023-10-16T19:41:08.742636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813276+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T19:41:00.813276+0000","last_peered":"2023-10-16T19:41:00.813276+0000","last_clean":"2023-10-16T19:41:00.813276+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T19:41:00.813276+0000","last_undegraded":"2023-10-16T19:41:00.813276+0000","last_fullsized":"2023-10-16T19:41:00.813276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.669501+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T19:41:08.669501+0000","last_peered":"2023-10-16T19:41:08.669501+0000","last_clean":"2023-10-16T19:41:08.669501+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T19:41:08.669501+0000","last_undegraded":"2023-10-16T19:41:08.669501+0000","last_fullsized":"2023-10-16T19:41:08.669501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984550+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T19:41:00.984550+0000","last_peered":"2023-10-16T19:41:00.984550+0000","last_clean":"2023-10-16T19:41:00.984550+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T19:41:00.984550+0000","last_undegraded":"2023-10-16T19:41:00.984550+0000","last_fullsized":"2023-10-16T19:41:00.984550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.818190+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T19:41:08.818190+0000","last_peered":"2023-10-16T19:41:08.818190+0000","last_clean":"2023-10-16T19:41:08.818190+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T19:41:08.818190+0000","last_undegraded":"2023-10-16T19:41:08.818190+0000","last_fullsized":"2023-10-16T19:41:08.818190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813025+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T19:41:00.813025+0000","last_peered":"2023-10-16T19:41:00.813025+0000","last_clean":"2023-10-16T19:41:00.813025+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T19:41:00.813025+0000","last_undegraded":"2023-10-16T19:41:00.813025+0000","last_fullsized":"2023-10-16T19:41:00.813025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.484950+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T19:40:59.484950+0000","last_peered":"2023-10-16T19:40:59.484950+0000","last_clean":"2023-10-16T19:40:59.484950+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T19:40:59.484950+0000","last_undegraded":"2023-10-16T19:40:59.484950+0000","last_fullsized":"2023-10-16T19:40:59.484950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984443+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T19:41:00.984443+0000","last_peered":"2023-10-16T19:41:00.984443+0000","last_clean":"2023-10-16T19:41:00.984443+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T19:41:00.984443+0000","last_undegraded":"2023-10-16T19:41:00.984443+0000","last_fullsized":"2023-10-16T19:41:00.984443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'10","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.671927+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T19:41:08.671927+0000","last_peered":"2023-10-16T19:41:08.671927+0000","last_clean":"2023-10-16T19:41:08.671927+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T19:41:08.671927+0000","last_undegraded":"2023-10-16T19:41:08.671927+0000","last_fullsized":"2023-10-16T19:41:08.671927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812555+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T19:41:00.812555+0000","last_peered":"2023-10-16T19:41:00.812555+0000","last_clean":"2023-10-16T19:41:00.812555+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T19:41:00.812555+0000","last_undegraded":"2023-10-16T19:41:00.812555+0000","last_fullsized":"2023-10-16T19:41:00.812555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.785544+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T19:41:00.785544+0000","last_peered":"2023-10-16T19:41:00.785544+0000","last_clean":"2023-10-16T19:41:00.785544+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T19:41:00.785544+0000","last_undegraded":"2023-10-16T19:41:00.785544+0000","last_fullsized":"2023-10-16T19:41:00.785544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813811+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T19:41:00.813811+0000","last_peered":"2023-10-16T19:41:00.813811+0000","last_clean":"2023-10-16T19:41:00.813811+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T19:41:00.813811+0000","last_undegraded":"2023-10-16T19:41:00.813811+0000","last_fullsized":"2023-10-16T19:41:00.813811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.117741+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T19:41:02.117741+0000","last_peered":"2023-10-16T19:41:02.117741+0000","last_clean":"2023-10-16T19:41:02.117741+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T19:41:02.117741+0000","last_undegraded":"2023-10-16T19:41:02.117741+0000","last_fullsized":"2023-10-16T19:41:02.117741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814249+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T19:41:00.814249+0000","last_peered":"2023-10-16T19:41:00.814249+0000","last_clean":"2023-10-16T19:41:00.814249+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T19:41:00.814249+0000","last_undegraded":"2023-10-16T19:41:00.814249+0000","last_fullsized":"2023-10-16T19:41:00.814249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746364+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T19:41:00.746364+0000","last_peered":"2023-10-16T19:41:00.746364+0000","last_clean":"2023-10-16T19:41:00.746364+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T19:41:00.746364+0000","last_undegraded":"2023-10-16T19:41:00.746364+0000","last_fullsized":"2023-10-16T19:41:00.746364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986392+0000","last_change":"2023-10-16T19:40:59.156646+0000","last_active":"2023-10-16T19:41:00.986392+0000","last_peered":"2023-10-16T19:41:00.986392+0000","last_clean":"2023-10-16T19:41:00.986392+0000","last_became_active":"2023-10-16T19:40:59.156121+0000","last_became_peered":"2023-10-16T19:40:59.156121+0000","last_unstale":"2023-10-16T19:41:00.986392+0000","last_undegraded":"2023-10-16T19:41:00.986392+0000","last_fullsized":"2023-10-16T19:41:00.986392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.488193+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T19:40:59.488193+0000","last_peered":"2023-10-16T19:40:59.488193+0000","last_clean":"2023-10-16T19:40:59.488193+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T19:40:59.488193+0000","last_undegraded":"2023-10-16T19:40:59.488193+0000","last_fullsized":"2023-10-16T19:40:59.488193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813302+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T19:41:00.813302+0000","last_peered":"2023-10-16T19:41:00.813302+0000","last_clean":"2023-10-16T19:41:00.813302+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T19:41:00.813302+0000","last_undegraded":"2023-10-16T19:41:00.813302+0000","last_fullsized":"2023-10-16T19:41:00.813302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.500181+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T19:40:59.500181+0000","last_peered":"2023-10-16T19:40:59.500181+0000","last_clean":"2023-10-16T19:40:59.500181+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T19:40:59.500181+0000","last_undegraded":"2023-10-16T19:40:59.500181+0000","last_fullsized":"2023-10-16T19:40:59.500181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.818239+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T19:41:08.818239+0000","last_peered":"2023-10-16T19:41:08.818239+0000","last_clean":"2023-10-16T19:41:08.818239+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T19:41:08.818239+0000","last_undegraded":"2023-10-16T19:41:08.818239+0000","last_fullsized":"2023-10-16T19:41:08.818239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981457+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T19:41:00.981457+0000","last_peered":"2023-10-16T19:41:00.981457+0000","last_clean":"2023-10-16T19:41:00.981457+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T19:41:00.981457+0000","last_undegraded":"2023-10-16T19:41:00.981457+0000","last_fullsized":"2023-10-16T19:41:00.981457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812361+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T19:41:00.812361+0000","last_peered":"2023-10-16T19:41:00.812361+0000","last_clean":"2023-10-16T19:41:00.812361+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T19:41:00.812361+0000","last_undegraded":"2023-10-16T19:41:00.812361+0000","last_fullsized":"2023-10-16T19:41:00.812361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983753+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T19:41:00.983753+0000","last_peered":"2023-10-16T19:41:00.983753+0000","last_clean":"2023-10-16T19:41:00.983753+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T19:41:00.983753+0000","last_undegraded":"2023-10-16T19:41:00.983753+0000","last_fullsized":"2023-10-16T19:41:00.983753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.878144+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T19:41:00.878144+0000","last_peered":"2023-10-16T19:41:00.878144+0000","last_clean":"2023-10-16T19:41:00.878144+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T19:41:00.878144+0000","last_undegraded":"2023-10-16T19:41:00.878144+0000","last_fullsized":"2023-10-16T19:41:00.878144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745727+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T19:41:00.745727+0000","last_peered":"2023-10-16T19:41:00.745727+0000","last_clean":"2023-10-16T19:41:00.745727+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T19:41:00.745727+0000","last_undegraded":"2023-10-16T19:41:00.745727+0000","last_fullsized":"2023-10-16T19:41:00.745727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.503962+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T19:40:59.503962+0000","last_peered":"2023-10-16T19:40:59.503962+0000","last_clean":"2023-10-16T19:40:59.503962+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T19:40:59.503962+0000","last_undegraded":"2023-10-16T19:40:59.503962+0000","last_fullsized":"2023-10-16T19:40:59.503962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784673+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T19:41:00.784673+0000","last_peered":"2023-10-16T19:41:00.784673+0000","last_clean":"2023-10-16T19:41:00.784673+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T19:41:00.784673+0000","last_undegraded":"2023-10-16T19:41:00.784673+0000","last_fullsized":"2023-10-16T19:41:00.784673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.441518+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T19:40:59.441518+0000","last_peered":"2023-10-16T19:40:59.441518+0000","last_clean":"2023-10-16T19:40:59.441518+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T19:40:59.441518+0000","last_undegraded":"2023-10-16T19:40:59.441518+0000","last_fullsized":"2023-10-16T19:40:59.441518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987116+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T19:41:00.987116+0000","last_peered":"2023-10-16T19:41:00.987116+0000","last_clean":"2023-10-16T19:41:00.987116+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T19:41:00.987116+0000","last_undegraded":"2023-10-16T19:41:00.987116+0000","last_fullsized":"2023-10-16T19:41:00.987116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813716+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T19:41:00.813716+0000","last_peered":"2023-10-16T19:41:00.813716+0000","last_clean":"2023-10-16T19:41:00.813716+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T19:41:00.813716+0000","last_undegraded":"2023-10-16T19:41:00.813716+0000","last_fullsized":"2023-10-16T19:41:00.813716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746157+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T19:41:00.746157+0000","last_peered":"2023-10-16T19:41:00.746157+0000","last_clean":"2023-10-16T19:41:00.746157+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T19:41:00.746157+0000","last_undegraded":"2023-10-16T19:41:00.746157+0000","last_fullsized":"2023-10-16T19:41:00.746157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746326+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T19:41:00.746326+0000","last_peered":"2023-10-16T19:41:00.746326+0000","last_clean":"2023-10-16T19:41:00.746326+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T19:41:00.746326+0000","last_undegraded":"2023-10-16T19:41:00.746326+0000","last_fullsized":"2023-10-16T19:41:00.746326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982757+0000","last_change":"2023-10-16T19:40:59.119901+0000","last_active":"2023-10-16T19:41:00.982757+0000","last_peered":"2023-10-16T19:41:00.982757+0000","last_clean":"2023-10-16T19:41:00.982757+0000","last_became_active":"2023-10-16T19:40:59.118945+0000","last_became_peered":"2023-10-16T19:40:59.118945+0000","last_unstale":"2023-10-16T19:41:00.982757+0000","last_undegraded":"2023-10-16T19:41:00.982757+0000","last_fullsized":"2023-10-16T19:41:00.982757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.743639+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T19:41:08.743639+0000","last_peered":"2023-10-16T19:41:08.743639+0000","last_clean":"2023-10-16T19:41:08.743639+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T19:41:08.743639+0000","last_undegraded":"2023-10-16T19:41:08.743639+0000","last_fullsized":"2023-10-16T19:41:08.743639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983472+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T19:41:00.983472+0000","last_peered":"2023-10-16T19:41:00.983472+0000","last_clean":"2023-10-16T19:41:00.983472+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T19:41:00.983472+0000","last_undegraded":"2023-10-16T19:41:00.983472+0000","last_fullsized":"2023-10-16T19:41:00.983472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.665285+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T19:41:08.665285+0000","last_peered":"2023-10-16T19:41:08.665285+0000","last_clean":"2023-10-16T19:41:08.665285+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T19:41:08.665285+0000","last_undegraded":"2023-10-16T19:41:08.665285+0000","last_fullsized":"2023-10-16T19:41:08.665285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784318+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T19:41:00.784318+0000","last_peered":"2023-10-16T19:41:00.784318+0000","last_clean":"2023-10-16T19:41:00.784318+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T19:41:00.784318+0000","last_undegraded":"2023-10-16T19:41:00.784318+0000","last_fullsized":"2023-10-16T19:41:00.784318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.670336+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T19:41:08.670336+0000","last_peered":"2023-10-16T19:41:08.670336+0000","last_clean":"2023-10-16T19:41:08.670336+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T19:41:08.670336+0000","last_undegraded":"2023-10-16T19:41:08.670336+0000","last_fullsized":"2023-10-16T19:41:08.670336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981209+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T19:41:00.981209+0000","last_peered":"2023-10-16T19:41:00.981209+0000","last_clean":"2023-10-16T19:41:00.981209+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T19:41:00.981209+0000","last_undegraded":"2023-10-16T19:41:00.981209+0000","last_fullsized":"2023-10-16T19:41:00.981209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.441244+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T19:40:59.441244+0000","last_peered":"2023-10-16T19:40:59.441244+0000","last_clean":"2023-10-16T19:40:59.441244+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T19:40:59.441244+0000","last_undegraded":"2023-10-16T19:40:59.441244+0000","last_fullsized":"2023-10-16T19:40:59.441244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981819+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T19:41:00.981819+0000","last_peered":"2023-10-16T19:41:00.981819+0000","last_clean":"2023-10-16T19:41:00.981819+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T19:41:00.981819+0000","last_undegraded":"2023-10-16T19:41:00.981819+0000","last_fullsized":"2023-10-16T19:41:00.981819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.668394+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T19:41:08.668394+0000","last_peered":"2023-10-16T19:41:08.668394+0000","last_clean":"2023-10-16T19:41:08.668394+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T19:41:08.668394+0000","last_undegraded":"2023-10-16T19:41:08.668394+0000","last_fullsized":"2023-10-16T19:41:08.668394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985755+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T19:41:00.985755+0000","last_peered":"2023-10-16T19:41:00.985755+0000","last_clean":"2023-10-16T19:41:00.985755+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T19:41:00.985755+0000","last_undegraded":"2023-10-16T19:41:00.985755+0000","last_fullsized":"2023-10-16T19:41:00.985755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986953+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T19:41:00.986953+0000","last_peered":"2023-10-16T19:41:00.986953+0000","last_clean":"2023-10-16T19:41:00.986953+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T19:41:00.986953+0000","last_undegraded":"2023-10-16T19:41:00.986953+0000","last_fullsized":"2023-10-16T19:41:00.986953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.044274+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T19:41:02.044274+0000","last_peered":"2023-10-16T19:41:02.044274+0000","last_clean":"2023-10-16T19:41:02.044274+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T19:41:02.044274+0000","last_undegraded":"2023-10-16T19:41:02.044274+0000","last_fullsized":"2023-10-16T19:41:02.044274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986108+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T19:41:00.986108+0000","last_peered":"2023-10-16T19:41:00.986108+0000","last_clean":"2023-10-16T19:41:00.986108+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T19:41:00.986108+0000","last_undegraded":"2023-10-16T19:41:00.986108+0000","last_fullsized":"2023-10-16T19:41:00.986108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.045001+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T19:41:02.045001+0000","last_peered":"2023-10-16T19:41:02.045001+0000","last_clean":"2023-10-16T19:41:02.045001+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T19:41:02.045001+0000","last_undegraded":"2023-10-16T19:41:02.045001+0000","last_fullsized":"2023-10-16T19:41:02.045001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984216+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T19:41:00.984216+0000","last_peered":"2023-10-16T19:41:00.984216+0000","last_clean":"2023-10-16T19:41:00.984216+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T19:41:00.984216+0000","last_undegraded":"2023-10-16T19:41:00.984216+0000","last_fullsized":"2023-10-16T19:41:00.984216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983090+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T19:41:00.983090+0000","last_peered":"2023-10-16T19:41:00.983090+0000","last_clean":"2023-10-16T19:41:00.983090+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T19:41:00.983090+0000","last_undegraded":"2023-10-16T19:41:00.983090+0000","last_fullsized":"2023-10-16T19:41:00.983090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982817+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T19:41:00.982817+0000","last_peered":"2023-10-16T19:41:00.982817+0000","last_clean":"2023-10-16T19:41:00.982817+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T19:41:00.982817+0000","last_undegraded":"2023-10-16T19:41:00.982817+0000","last_fullsized":"2023-10-16T19:41:00.982817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:01.936737+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T19:41:01.936737+0000","last_peered":"2023-10-16T19:41:01.936737+0000","last_clean":"2023-10-16T19:41:01.936737+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T19:41:01.936737+0000","last_undegraded":"2023-10-16T19:41:01.936737+0000","last_fullsized":"2023-10-16T19:41:01.936737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3816,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":675406,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0179999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":85424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":85956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9239999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.982}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7949999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":674750,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":83848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":84554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:13.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:14.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.125+0000 7fa7b034c640 1 Processor -- start 2023-10-16T19:41:14.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.125+0000 7fa7b034c640 1 -- start start 2023-10-16T19:41:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.128+0000 7fa7b034c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7a8151190 0x7fa7a80c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.128+0000 7fa7b034c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 0x7fa7a806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.128+0000 7fa7b034c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a8151570 con 0x7fa7a80c12f0 2023-10-16T19:41:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.128+0000 7fa7b034c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80c4010 con 0x7fa7a8151190 2023-10-16T19:41:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.128+0000 7fa7b034c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c1ce0 con 0x7fa7a80c2aa0 2023-10-16T19:41:14.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.129+0000 7fa7ad8e7640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa7a80c12f0 0x7fa7a806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37822/0 (socket says 172.21.15.57:37822) 2023-10-16T19:41:14.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.129+0000 7fa7ad8e7640 1 -- 172.21.15.57:0/543184583 learned_addr learned my addr 172.21.15.57:0/543184583 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:14.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.133+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529628851 0 0) 0x7fa7a8151570 con 0x7fa7a80c12f0 2023-10-16T19:41:14.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.133+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa794003520 con 0x7fa7a80c12f0 2023-10-16T19:41:14.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.136+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/543184583 >> v2:172.21.15.110:3300/0 conn(0x7fa7a8151190 0x7fa7a80c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.140+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604334196 0 0) 0x7fa794003520 con 0x7fa7a80c12f0 2023-10-16T19:41:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 msgr2=0x7fa7a806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 0x7fa7a806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 >> v2:172.21.15.110:3300/0 conn(0x7fa7a8151190 msgr2=0x7fa7a80c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 --2- 172.21.15.57:0/543184583 >> v2:172.21.15.110:3300/0 conn(0x7fa7a8151190 0x7fa7a80c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80c5530 con 0x7fa7a80c12f0 2023-10-16T19:41:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7fa798001670 con 0x7fa7a80c12f0 2023-10-16T19:41:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 >> v1:172.21.15.57:6789/0 conn(0x7fa7a80c12f0 legacy=0x7fa7a806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 0x7fa794003990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa794003f60 0x7fa7940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794004d00 0x7fa794005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c4010 con 0x7fa794004d00 2023-10-16T19:41:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c1ce0 con 0x7fa794003f60 2023-10-16T19:41:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.141+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79400bb40 con 0x7fa7a80c2aa0 2023-10-16T19:41:14.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.148+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 0x7fa794003990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.154+0000 7fa7ad8e7640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa794003f60 0x7fa7940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:14.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.156+0000 7fa7ae0e8640 1 -- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa794003f60 msgr2=0x7fa7940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:14.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.156+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa794003f60 0x7fa7940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.157+0000 7fa7ae0e8640 1 -- 172.21.15.57:0/543184583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794004d00 msgr2=0x7fa794005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:14.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.157+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa794004d00 0x7fa794005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.157+0000 7fa7ae0e8640 1 -- 172.21.15.57:0/543184583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794003520 con 0x7fa7a80c2aa0 2023-10-16T19:41:14.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.167+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 0x7fa794003990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009a90 tx=0x7fa7940057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57274b0fccc6429f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:14.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.179+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a402c600 con 0x7fa7a80c2aa0 2023-10-16T19:41:14.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.179+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a402c760 con 0x7fa7a80c2aa0 2023-10-16T19:41:14.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.179+0000 7fa7ad0e6640 1 -- 172.21.15.57:0/543184583 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a402caf0 con 0x7fa7a80c2aa0 2023-10-16T19:41:14.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7b034c640 1 -- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 msgr2=0x7fa794003990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:14.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7b034c640 1 --2- 172.21.15.57:0/543184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a80c2aa0 0x7fa794003990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009a90 tx=0x7fa7940057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7ae8e9640 1 -- 172.21.15.57:0/543184583 reap_dead start 2023-10-16T19:41:14.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7b034c640 1 -- 172.21.15.57:0/543184583 shutdown_connections 2023-10-16T19:41:14.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7b034c640 1 -- 172.21.15.57:0/543184583 >> 172.21.15.57:0/543184583 conn(0x7fa7a806c430 msgr2=0x7fa7a8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:14.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7b034c640 1 -- 172.21.15.57:0/543184583 shutdown_connections 2023-10-16T19:41:14.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.180+0000 7fa7b034c640 1 -- 172.21.15.57:0/543184583 wait complete. 2023-10-16T19:41:14.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.183+0000 7fa7b034c640 1 Processor -- start 2023-10-16T19:41:14.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.184+0000 7fa7b034c640 1 -- start start 2023-10-16T19:41:14.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.185+0000 7fa7b034c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a814f590 0x7fa7a8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.185+0000 7fa7b034c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7a81579d0 0x7fa7a8158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.185+0000 7fa7b034c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a8155580 0x7fa7a8159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.185+0000 7fa7b034c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c04c0 con 0x7fa7a81579d0 2023-10-16T19:41:14.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.185+0000 7fa7b034c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a81592a0 con 0x7fa7a8155580 2023-10-16T19:41:14.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.185+0000 7fa7b034c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80ca200 con 0x7fa7a814f590 2023-10-16T19:41:14.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.187+0000 7fa7ae0e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a814f590 0x7fa7a8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:14.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.187+0000 7fa7ae8e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a8155580 0x7fa7a8159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:14.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.188+0000 7fa7ae0e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a814f590 0x7fa7a8071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:35998/0 (socket says 172.21.15.57:35998) 2023-10-16T19:41:14.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.188+0000 7fa7ae0e8640 1 -- 172.21.15.57:0/725589900 learned_addr learned my addr 172.21.15.57:0/725589900 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:14.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.198+0000 7fa7ae8e9640 1 -- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a814f590 msgr2=0x7fa7a8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:14.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.198+0000 7fa7ae8e9640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a814f590 0x7fa7a8071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.198+0000 7fa7ae8e9640 1 -- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7a81579d0 msgr2=0x7fa7a8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:14.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.198+0000 7fa7ae8e9640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7a81579d0 0x7fa7a8158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.198+0000 7fa7ae8e9640 1 -- 172.21.15.57:0/725589900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a81552c0 con 0x7fa7a8155580 2023-10-16T19:41:14.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.205+0000 7fa7ae8e9640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a8155580 0x7fa7a8159450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8151700 tx=0x7fa7a000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:14.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.216+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000aa20 con 0x7fa7a8155580 2023-10-16T19:41:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.217+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a000ab80 con 0x7fa7a8155580 2023-10-16T19:41:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.217+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000ce50 con 0x7fa7a8155580 2023-10-16T19:41:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.217+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a81588d0 con 0x7fa7a8155580 2023-10-16T19:41:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.217+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8157fe0 con 0x7fa7a8155580 2023-10-16T19:41:14.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.218+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a80c0d00 con 0x7fa7a8155580 2023-10-16T19:41:14.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.547+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7a001b3b0 con 0x7fa7a8155580 2023-10-16T19:41:14.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.549+0000 7fa79effd640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa78c06aec0 0x7fa78c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:14.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.549+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7a0088f70 con 0x7fa7a8155580 2023-10-16T19:41:14.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.549+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa78c06aec0 0x7fa78c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:14.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.551+0000 7fa7ae0e8640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa78c06aec0 0x7fa78c06d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4000c00 tx=0x7fa7a4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:14.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.624+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7a0054240 con 0x7fa7a8155580 2023-10-16T19:41:14.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.856+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7a815af20 con 0x7fa78c06aec0 2023-10-16T19:41:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.868+0000 7fa79effd640 1 -- 172.21.15.57:0/725589900 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264505 (secure 0 0 0) 0x7fa7a4004040 con 0x7fa78c06aec0 2023-10-16T19:41:14.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T19:41:14.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.873+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa78c06aec0 msgr2=0x7fa78c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:14.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.873+0000 7fa7b034c640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa78c06aec0 0x7fa78c06d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4000c00 tx=0x7fa7a4030000 comp rx=0 tx=0).stop 2023-10-16T19:41:14.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.873+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a8155580 msgr2=0x7fa7a8159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:14.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.873+0000 7fa7b034c640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a8155580 0x7fa7a8159450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8151700 tx=0x7fa7a000cc00 comp rx=0 tx=0).stop 2023-10-16T19:41:14.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 shutdown_connections 2023-10-16T19:41:14.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa78c06aec0 0x7fa78c06d380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a8155580 0x7fa7a8159450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7a81579d0 0x7fa7a8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 --2- 172.21.15.57:0/725589900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7a814f590 0x7fa7a8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 >> 172.21.15.57:0/725589900 conn(0x7fa7a806c430 msgr2=0x7fa7a80c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 shutdown_connections 2023-10-16T19:41:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:14.874+0000 7fa7b034c640 1 -- 172.21.15.57:0/725589900 wait complete. 2023-10-16T19:41:14.896 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-16T19:41:13.447365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594184,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":243,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226512,"kb_used_data":2064,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754748208,"statfs":{"total":773094113280,"available":772862164992,"internally_reserved":0,"allocated":2113536,"data_stored":1858144,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":229756472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3816,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004133"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813951+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T19:41:00.813951+0000","last_peered":"2023-10-16T19:41:00.813951+0000","last_clean":"2023-10-16T19:41:00.813951+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T19:41:00.813951+0000","last_undegraded":"2023-10-16T19:41:00.813951+0000","last_fullsized":"2023-10-16T19:41:00.813951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746317+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T19:41:00.746317+0000","last_peered":"2023-10-16T19:41:00.746317+0000","last_clean":"2023-10-16T19:41:00.746317+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T19:41:00.746317+0000","last_undegraded":"2023-10-16T19:41:00.746317+0000","last_fullsized":"2023-10-16T19:41:00.746317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983894+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T19:41:00.983894+0000","last_peered":"2023-10-16T19:41:00.983894+0000","last_clean":"2023-10-16T19:41:00.983894+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T19:41:00.983894+0000","last_undegraded":"2023-10-16T19:41:00.983894+0000","last_fullsized":"2023-10-16T19:41:00.983894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985780+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T19:41:00.985780+0000","last_peered":"2023-10-16T19:41:00.985780+0000","last_clean":"2023-10-16T19:41:00.985780+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T19:41:00.985780+0000","last_undegraded":"2023-10-16T19:41:00.985780+0000","last_fullsized":"2023-10-16T19:41:00.985780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812868+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T19:41:00.812868+0000","last_peered":"2023-10-16T19:41:00.812868+0000","last_clean":"2023-10-16T19:41:00.812868+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T19:41:00.812868+0000","last_undegraded":"2023-10-16T19:41:00.812868+0000","last_fullsized":"2023-10-16T19:41:00.812868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985163+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T19:41:00.985163+0000","last_peered":"2023-10-16T19:41:00.985163+0000","last_clean":"2023-10-16T19:41:00.985163+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T19:41:00.985163+0000","last_undegraded":"2023-10-16T19:41:00.985163+0000","last_fullsized":"2023-10-16T19:41:00.985163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812522+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T19:41:00.812522+0000","last_peered":"2023-10-16T19:41:00.812522+0000","last_clean":"2023-10-16T19:41:00.812522+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T19:41:00.812522+0000","last_undegraded":"2023-10-16T19:41:00.812522+0000","last_fullsized":"2023-10-16T19:41:00.812522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981033+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T19:41:00.981033+0000","last_peered":"2023-10-16T19:41:00.981033+0000","last_clean":"2023-10-16T19:41:00.981033+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T19:41:00.981033+0000","last_undegraded":"2023-10-16T19:41:00.981033+0000","last_fullsized":"2023-10-16T19:41:00.981033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814034+0000","last_change":"2023-10-16T19:40:59.155274+0000","last_active":"2023-10-16T19:41:00.814034+0000","last_peered":"2023-10-16T19:41:00.814034+0000","last_clean":"2023-10-16T19:41:00.814034+0000","last_became_active":"2023-10-16T19:40:59.155045+0000","last_became_peered":"2023-10-16T19:40:59.155045+0000","last_unstale":"2023-10-16T19:41:00.814034+0000","last_undegraded":"2023-10-16T19:41:00.814034+0000","last_fullsized":"2023-10-16T19:41:00.814034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:09.928086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984830+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T19:41:00.984830+0000","last_peered":"2023-10-16T19:41:00.984830+0000","last_clean":"2023-10-16T19:41:00.984830+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T19:41:00.984830+0000","last_undegraded":"2023-10-16T19:41:00.984830+0000","last_fullsized":"2023-10-16T19:41:00.984830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986814+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T19:41:00.986814+0000","last_peered":"2023-10-16T19:41:00.986814+0000","last_clean":"2023-10-16T19:41:00.986814+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T19:41:00.986814+0000","last_undegraded":"2023-10-16T19:41:00.986814+0000","last_fullsized":"2023-10-16T19:41:00.986814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784889+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T19:41:00.784889+0000","last_peered":"2023-10-16T19:41:00.784889+0000","last_clean":"2023-10-16T19:41:00.784889+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T19:41:00.784889+0000","last_undegraded":"2023-10-16T19:41:00.784889+0000","last_fullsized":"2023-10-16T19:41:00.784889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981729+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T19:41:00.981729+0000","last_peered":"2023-10-16T19:41:00.981729+0000","last_clean":"2023-10-16T19:41:00.981729+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T19:41:00.981729+0000","last_undegraded":"2023-10-16T19:41:00.981729+0000","last_fullsized":"2023-10-16T19:41:00.981729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984167+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T19:41:00.984167+0000","last_peered":"2023-10-16T19:41:00.984167+0000","last_clean":"2023-10-16T19:41:00.984167+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T19:41:00.984167+0000","last_undegraded":"2023-10-16T19:41:00.984167+0000","last_fullsized":"2023-10-16T19:41:00.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745736+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T19:41:00.745736+0000","last_peered":"2023-10-16T19:41:00.745736+0000","last_clean":"2023-10-16T19:41:00.745736+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T19:41:00.745736+0000","last_undegraded":"2023-10-16T19:41:00.745736+0000","last_fullsized":"2023-10-16T19:41:00.745736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984540+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T19:41:00.984540+0000","last_peered":"2023-10-16T19:41:00.984540+0000","last_clean":"2023-10-16T19:41:00.984540+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T19:41:00.984540+0000","last_undegraded":"2023-10-16T19:41:00.984540+0000","last_fullsized":"2023-10-16T19:41:00.984540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987728+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T19:41:00.987728+0000","last_peered":"2023-10-16T19:41:00.987728+0000","last_clean":"2023-10-16T19:41:00.987728+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T19:41:00.987728+0000","last_undegraded":"2023-10-16T19:41:00.987728+0000","last_fullsized":"2023-10-16T19:41:00.987728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.878158+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T19:41:00.878158+0000","last_peered":"2023-10-16T19:41:00.878158+0000","last_clean":"2023-10-16T19:41:00.878158+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T19:41:00.878158+0000","last_undegraded":"2023-10-16T19:41:00.878158+0000","last_fullsized":"2023-10-16T19:41:00.878158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813704+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T19:41:00.813704+0000","last_peered":"2023-10-16T19:41:00.813704+0000","last_clean":"2023-10-16T19:41:00.813704+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T19:41:00.813704+0000","last_undegraded":"2023-10-16T19:41:00.813704+0000","last_fullsized":"2023-10-16T19:41:00.813704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986380+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T19:41:00.986380+0000","last_peered":"2023-10-16T19:41:00.986380+0000","last_clean":"2023-10-16T19:41:00.986380+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T19:41:00.986380+0000","last_undegraded":"2023-10-16T19:41:00.986380+0000","last_fullsized":"2023-10-16T19:41:00.986380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983531+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T19:41:00.983531+0000","last_peered":"2023-10-16T19:41:00.983531+0000","last_clean":"2023-10-16T19:41:00.983531+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T19:41:00.983531+0000","last_undegraded":"2023-10-16T19:41:00.983531+0000","last_fullsized":"2023-10-16T19:41:00.983531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985539+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T19:41:00.985539+0000","last_peered":"2023-10-16T19:41:00.985539+0000","last_clean":"2023-10-16T19:41:00.985539+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T19:41:00.985539+0000","last_undegraded":"2023-10-16T19:41:00.985539+0000","last_fullsized":"2023-10-16T19:41:00.985539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981092+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T19:41:00.981092+0000","last_peered":"2023-10-16T19:41:00.981092+0000","last_clean":"2023-10-16T19:41:00.981092+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T19:41:00.981092+0000","last_undegraded":"2023-10-16T19:41:00.981092+0000","last_fullsized":"2023-10-16T19:41:00.981092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984894+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T19:41:00.984894+0000","last_peered":"2023-10-16T19:41:00.984894+0000","last_clean":"2023-10-16T19:41:00.984894+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T19:41:00.984894+0000","last_undegraded":"2023-10-16T19:41:00.984894+0000","last_fullsized":"2023-10-16T19:41:00.984894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T19:41:00.982954+0000","last_peered":"2023-10-16T19:41:00.982954+0000","last_clean":"2023-10-16T19:41:00.982954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T19:41:00.982954+0000","last_undegraded":"2023-10-16T19:41:00.982954+0000","last_fullsized":"2023-10-16T19:41:00.982954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985192+0000","last_change":"2023-10-16T19:40:59.212253+0000","last_active":"2023-10-16T19:41:00.985192+0000","last_peered":"2023-10-16T19:41:00.985192+0000","last_clean":"2023-10-16T19:41:00.985192+0000","last_became_active":"2023-10-16T19:40:59.210602+0000","last_became_peered":"2023-10-16T19:40:59.210602+0000","last_unstale":"2023-10-16T19:41:00.985192+0000","last_undegraded":"2023-10-16T19:41:00.985192+0000","last_fullsized":"2023-10-16T19:41:00.985192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746131+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T19:41:00.746131+0000","last_peered":"2023-10-16T19:41:00.746131+0000","last_clean":"2023-10-16T19:41:00.746131+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T19:41:00.746131+0000","last_undegraded":"2023-10-16T19:41:00.746131+0000","last_fullsized":"2023-10-16T19:41:00.746131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982276+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T19:41:00.982276+0000","last_peered":"2023-10-16T19:41:00.982276+0000","last_clean":"2023-10-16T19:41:00.982276+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T19:41:00.982276+0000","last_undegraded":"2023-10-16T19:41:00.982276+0000","last_fullsized":"2023-10-16T19:41:00.982276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983687+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T19:41:00.983687+0000","last_peered":"2023-10-16T19:41:00.983687+0000","last_clean":"2023-10-16T19:41:00.983687+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T19:41:00.983687+0000","last_undegraded":"2023-10-16T19:41:00.983687+0000","last_fullsized":"2023-10-16T19:41:00.983687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985872+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T19:41:00.985872+0000","last_peered":"2023-10-16T19:41:00.985872+0000","last_clean":"2023-10-16T19:41:00.985872+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T19:41:00.985872+0000","last_undegraded":"2023-10-16T19:41:00.985872+0000","last_fullsized":"2023-10-16T19:41:00.985872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.877995+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T19:41:00.877995+0000","last_peered":"2023-10-16T19:41:00.877995+0000","last_clean":"2023-10-16T19:41:00.877995+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T19:41:00.877995+0000","last_undegraded":"2023-10-16T19:41:00.877995+0000","last_fullsized":"2023-10-16T19:41:00.877995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984086+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T19:41:00.984086+0000","last_peered":"2023-10-16T19:41:00.984086+0000","last_clean":"2023-10-16T19:41:00.984086+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T19:41:00.984086+0000","last_undegraded":"2023-10-16T19:41:00.984086+0000","last_fullsized":"2023-10-16T19:41:00.984086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.783983+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T19:41:00.783983+0000","last_peered":"2023-10-16T19:41:00.783983+0000","last_clean":"2023-10-16T19:41:00.783983+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T19:41:00.783983+0000","last_undegraded":"2023-10-16T19:41:00.783983+0000","last_fullsized":"2023-10-16T19:41:00.783983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.837461+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T19:41:08.837461+0000","last_peered":"2023-10-16T19:41:08.837461+0000","last_clean":"2023-10-16T19:41:08.837461+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T19:41:08.837461+0000","last_undegraded":"2023-10-16T19:41:08.837461+0000","last_fullsized":"2023-10-16T19:41:08.837461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983824+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T19:41:00.983824+0000","last_peered":"2023-10-16T19:41:00.983824+0000","last_clean":"2023-10-16T19:41:00.983824+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T19:41:00.983824+0000","last_undegraded":"2023-10-16T19:41:00.983824+0000","last_fullsized":"2023-10-16T19:41:00.983824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986073+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T19:41:00.986073+0000","last_peered":"2023-10-16T19:41:00.986073+0000","last_clean":"2023-10-16T19:41:00.986073+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T19:41:00.986073+0000","last_undegraded":"2023-10-16T19:41:00.986073+0000","last_fullsized":"2023-10-16T19:41:00.986073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.501487+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T19:40:59.501487+0000","last_peered":"2023-10-16T19:40:59.501487+0000","last_clean":"2023-10-16T19:40:59.501487+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T19:40:59.501487+0000","last_undegraded":"2023-10-16T19:40:59.501487+0000","last_fullsized":"2023-10-16T19:40:59.501487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981065+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T19:41:00.981065+0000","last_peered":"2023-10-16T19:41:00.981065+0000","last_clean":"2023-10-16T19:41:00.981065+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T19:41:00.981065+0000","last_undegraded":"2023-10-16T19:41:00.981065+0000","last_fullsized":"2023-10-16T19:41:00.981065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985228+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T19:41:00.985228+0000","last_peered":"2023-10-16T19:41:00.985228+0000","last_clean":"2023-10-16T19:41:00.985228+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T19:41:00.985228+0000","last_undegraded":"2023-10-16T19:41:00.985228+0000","last_fullsized":"2023-10-16T19:41:00.985228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745738+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T19:41:00.745738+0000","last_peered":"2023-10-16T19:41:00.745738+0000","last_clean":"2023-10-16T19:41:00.745738+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T19:41:00.745738+0000","last_undegraded":"2023-10-16T19:41:00.745738+0000","last_fullsized":"2023-10-16T19:41:00.745738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.745798+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T19:41:08.745798+0000","last_peered":"2023-10-16T19:41:08.745798+0000","last_clean":"2023-10-16T19:41:08.745798+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T19:41:08.745798+0000","last_undegraded":"2023-10-16T19:41:08.745798+0000","last_fullsized":"2023-10-16T19:41:08.745798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985111+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T19:41:00.985111+0000","last_peered":"2023-10-16T19:41:00.985111+0000","last_clean":"2023-10-16T19:41:00.985111+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T19:41:00.985111+0000","last_undegraded":"2023-10-16T19:41:00.985111+0000","last_fullsized":"2023-10-16T19:41:00.985111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.817526+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T19:41:08.817526+0000","last_peered":"2023-10-16T19:41:08.817526+0000","last_clean":"2023-10-16T19:41:08.817526+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T19:41:08.817526+0000","last_undegraded":"2023-10-16T19:41:08.817526+0000","last_fullsized":"2023-10-16T19:41:08.817526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984320+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T19:41:00.984320+0000","last_peered":"2023-10-16T19:41:00.984320+0000","last_clean":"2023-10-16T19:41:00.984320+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T19:41:00.984320+0000","last_undegraded":"2023-10-16T19:41:00.984320+0000","last_fullsized":"2023-10-16T19:41:00.984320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:01.928797+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T19:41:01.928797+0000","last_peered":"2023-10-16T19:41:01.928797+0000","last_clean":"2023-10-16T19:41:01.928797+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T19:41:01.928797+0000","last_undegraded":"2023-10-16T19:41:01.928797+0000","last_fullsized":"2023-10-16T19:41:01.928797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784901+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T19:41:00.784901+0000","last_peered":"2023-10-16T19:41:00.784901+0000","last_clean":"2023-10-16T19:41:00.784901+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T19:41:00.784901+0000","last_undegraded":"2023-10-16T19:41:00.784901+0000","last_fullsized":"2023-10-16T19:41:00.784901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.742636+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T19:41:08.742636+0000","last_peered":"2023-10-16T19:41:08.742636+0000","last_clean":"2023-10-16T19:41:08.742636+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T19:41:08.742636+0000","last_undegraded":"2023-10-16T19:41:08.742636+0000","last_fullsized":"2023-10-16T19:41:08.742636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813276+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T19:41:00.813276+0000","last_peered":"2023-10-16T19:41:00.813276+0000","last_clean":"2023-10-16T19:41:00.813276+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T19:41:00.813276+0000","last_undegraded":"2023-10-16T19:41:00.813276+0000","last_fullsized":"2023-10-16T19:41:00.813276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.669501+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T19:41:08.669501+0000","last_peered":"2023-10-16T19:41:08.669501+0000","last_clean":"2023-10-16T19:41:08.669501+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T19:41:08.669501+0000","last_undegraded":"2023-10-16T19:41:08.669501+0000","last_fullsized":"2023-10-16T19:41:08.669501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984550+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T19:41:00.984550+0000","last_peered":"2023-10-16T19:41:00.984550+0000","last_clean":"2023-10-16T19:41:00.984550+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T19:41:00.984550+0000","last_undegraded":"2023-10-16T19:41:00.984550+0000","last_fullsized":"2023-10-16T19:41:00.984550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.818190+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T19:41:08.818190+0000","last_peered":"2023-10-16T19:41:08.818190+0000","last_clean":"2023-10-16T19:41:08.818190+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T19:41:08.818190+0000","last_undegraded":"2023-10-16T19:41:08.818190+0000","last_fullsized":"2023-10-16T19:41:08.818190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813025+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T19:41:00.813025+0000","last_peered":"2023-10-16T19:41:00.813025+0000","last_clean":"2023-10-16T19:41:00.813025+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T19:41:00.813025+0000","last_undegraded":"2023-10-16T19:41:00.813025+0000","last_fullsized":"2023-10-16T19:41:00.813025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.484950+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T19:40:59.484950+0000","last_peered":"2023-10-16T19:40:59.484950+0000","last_clean":"2023-10-16T19:40:59.484950+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T19:40:59.484950+0000","last_undegraded":"2023-10-16T19:40:59.484950+0000","last_fullsized":"2023-10-16T19:40:59.484950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984443+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T19:41:00.984443+0000","last_peered":"2023-10-16T19:41:00.984443+0000","last_clean":"2023-10-16T19:41:00.984443+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T19:41:00.984443+0000","last_undegraded":"2023-10-16T19:41:00.984443+0000","last_fullsized":"2023-10-16T19:41:00.984443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'10","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.671927+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T19:41:08.671927+0000","last_peered":"2023-10-16T19:41:08.671927+0000","last_clean":"2023-10-16T19:41:08.671927+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T19:41:08.671927+0000","last_undegraded":"2023-10-16T19:41:08.671927+0000","last_fullsized":"2023-10-16T19:41:08.671927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812555+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T19:41:00.812555+0000","last_peered":"2023-10-16T19:41:00.812555+0000","last_clean":"2023-10-16T19:41:00.812555+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T19:41:00.812555+0000","last_undegraded":"2023-10-16T19:41:00.812555+0000","last_fullsized":"2023-10-16T19:41:00.812555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.785544+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T19:41:00.785544+0000","last_peered":"2023-10-16T19:41:00.785544+0000","last_clean":"2023-10-16T19:41:00.785544+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T19:41:00.785544+0000","last_undegraded":"2023-10-16T19:41:00.785544+0000","last_fullsized":"2023-10-16T19:41:00.785544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813811+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T19:41:00.813811+0000","last_peered":"2023-10-16T19:41:00.813811+0000","last_clean":"2023-10-16T19:41:00.813811+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T19:41:00.813811+0000","last_undegraded":"2023-10-16T19:41:00.813811+0000","last_fullsized":"2023-10-16T19:41:00.813811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.117741+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T19:41:02.117741+0000","last_peered":"2023-10-16T19:41:02.117741+0000","last_clean":"2023-10-16T19:41:02.117741+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T19:41:02.117741+0000","last_undegraded":"2023-10-16T19:41:02.117741+0000","last_fullsized":"2023-10-16T19:41:02.117741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814249+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T19:41:00.814249+0000","last_peered":"2023-10-16T19:41:00.814249+0000","last_clean":"2023-10-16T19:41:00.814249+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T19:41:00.814249+0000","last_undegraded":"2023-10-16T19:41:00.814249+0000","last_fullsized":"2023-10-16T19:41:00.814249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746364+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T19:41:00.746364+0000","last_peered":"2023-10-16T19:41:00.746364+0000","last_clean":"2023-10-16T19:41:00.746364+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T19:41:00.746364+0000","last_undegraded":"2023-10-16T19:41:00.746364+0000","last_fullsized":"2023-10-16T19:41:00.746364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986392+0000","last_change":"2023-10-16T19:40:59.156646+0000","last_active":"2023-10-16T19:41:00.986392+0000","last_peered":"2023-10-16T19:41:00.986392+0000","last_clean":"2023-10-16T19:41:00.986392+0000","last_became_active":"2023-10-16T19:40:59.156121+0000","last_became_peered":"2023-10-16T19:40:59.156121+0000","last_unstale":"2023-10-16T19:41:00.986392+0000","last_undegraded":"2023-10-16T19:41:00.986392+0000","last_fullsized":"2023-10-16T19:41:00.986392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.488193+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T19:40:59.488193+0000","last_peered":"2023-10-16T19:40:59.488193+0000","last_clean":"2023-10-16T19:40:59.488193+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T19:40:59.488193+0000","last_undegraded":"2023-10-16T19:40:59.488193+0000","last_fullsized":"2023-10-16T19:40:59.488193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813302+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T19:41:00.813302+0000","last_peered":"2023-10-16T19:41:00.813302+0000","last_clean":"2023-10-16T19:41:00.813302+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T19:41:00.813302+0000","last_undegraded":"2023-10-16T19:41:00.813302+0000","last_fullsized":"2023-10-16T19:41:00.813302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.500181+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T19:40:59.500181+0000","last_peered":"2023-10-16T19:40:59.500181+0000","last_clean":"2023-10-16T19:40:59.500181+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T19:40:59.500181+0000","last_undegraded":"2023-10-16T19:40:59.500181+0000","last_fullsized":"2023-10-16T19:40:59.500181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.818239+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T19:41:08.818239+0000","last_peered":"2023-10-16T19:41:08.818239+0000","last_clean":"2023-10-16T19:41:08.818239+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T19:41:08.818239+0000","last_undegraded":"2023-10-16T19:41:08.818239+0000","last_fullsized":"2023-10-16T19:41:08.818239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981457+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T19:41:00.981457+0000","last_peered":"2023-10-16T19:41:00.981457+0000","last_clean":"2023-10-16T19:41:00.981457+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T19:41:00.981457+0000","last_undegraded":"2023-10-16T19:41:00.981457+0000","last_fullsized":"2023-10-16T19:41:00.981457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812361+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T19:41:00.812361+0000","last_peered":"2023-10-16T19:41:00.812361+0000","last_clean":"2023-10-16T19:41:00.812361+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T19:41:00.812361+0000","last_undegraded":"2023-10-16T19:41:00.812361+0000","last_fullsized":"2023-10-16T19:41:00.812361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983753+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T19:41:00.983753+0000","last_peered":"2023-10-16T19:41:00.983753+0000","last_clean":"2023-10-16T19:41:00.983753+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T19:41:00.983753+0000","last_undegraded":"2023-10-16T19:41:00.983753+0000","last_fullsized":"2023-10-16T19:41:00.983753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.878144+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T19:41:00.878144+0000","last_peered":"2023-10-16T19:41:00.878144+0000","last_clean":"2023-10-16T19:41:00.878144+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T19:41:00.878144+0000","last_undegraded":"2023-10-16T19:41:00.878144+0000","last_fullsized":"2023-10-16T19:41:00.878144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745727+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T19:41:00.745727+0000","last_peered":"2023-10-16T19:41:00.745727+0000","last_clean":"2023-10-16T19:41:00.745727+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T19:41:00.745727+0000","last_undegraded":"2023-10-16T19:41:00.745727+0000","last_fullsized":"2023-10-16T19:41:00.745727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.503962+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T19:40:59.503962+0000","last_peered":"2023-10-16T19:40:59.503962+0000","last_clean":"2023-10-16T19:40:59.503962+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T19:40:59.503962+0000","last_undegraded":"2023-10-16T19:40:59.503962+0000","last_fullsized":"2023-10-16T19:40:59.503962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784673+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T19:41:00.784673+0000","last_peered":"2023-10-16T19:41:00.784673+0000","last_clean":"2023-10-16T19:41:00.784673+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T19:41:00.784673+0000","last_undegraded":"2023-10-16T19:41:00.784673+0000","last_fullsized":"2023-10-16T19:41:00.784673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.441518+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T19:40:59.441518+0000","last_peered":"2023-10-16T19:40:59.441518+0000","last_clean":"2023-10-16T19:40:59.441518+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T19:40:59.441518+0000","last_undegraded":"2023-10-16T19:40:59.441518+0000","last_fullsized":"2023-10-16T19:40:59.441518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987116+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T19:41:00.987116+0000","last_peered":"2023-10-16T19:41:00.987116+0000","last_clean":"2023-10-16T19:41:00.987116+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T19:41:00.987116+0000","last_undegraded":"2023-10-16T19:41:00.987116+0000","last_fullsized":"2023-10-16T19:41:00.987116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813716+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T19:41:00.813716+0000","last_peered":"2023-10-16T19:41:00.813716+0000","last_clean":"2023-10-16T19:41:00.813716+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T19:41:00.813716+0000","last_undegraded":"2023-10-16T19:41:00.813716+0000","last_fullsized":"2023-10-16T19:41:00.813716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746157+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T19:41:00.746157+0000","last_peered":"2023-10-16T19:41:00.746157+0000","last_clean":"2023-10-16T19:41:00.746157+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T19:41:00.746157+0000","last_undegraded":"2023-10-16T19:41:00.746157+0000","last_fullsized":"2023-10-16T19:41:00.746157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746326+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T19:41:00.746326+0000","last_peered":"2023-10-16T19:41:00.746326+0000","last_clean":"2023-10-16T19:41:00.746326+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T19:41:00.746326+0000","last_undegraded":"2023-10-16T19:41:00.746326+0000","last_fullsized":"2023-10-16T19:41:00.746326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982757+0000","last_change":"2023-10-16T19:40:59.119901+0000","last_active":"2023-10-16T19:41:00.982757+0000","last_peered":"2023-10-16T19:41:00.982757+0000","last_clean":"2023-10-16T19:41:00.982757+0000","last_became_active":"2023-10-16T19:40:59.118945+0000","last_became_peered":"2023-10-16T19:40:59.118945+0000","last_unstale":"2023-10-16T19:41:00.982757+0000","last_undegraded":"2023-10-16T19:41:00.982757+0000","last_fullsized":"2023-10-16T19:41:00.982757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.743639+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T19:41:08.743639+0000","last_peered":"2023-10-16T19:41:08.743639+0000","last_clean":"2023-10-16T19:41:08.743639+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T19:41:08.743639+0000","last_undegraded":"2023-10-16T19:41:08.743639+0000","last_fullsized":"2023-10-16T19:41:08.743639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983472+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T19:41:00.983472+0000","last_peered":"2023-10-16T19:41:00.983472+0000","last_clean":"2023-10-16T19:41:00.983472+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T19:41:00.983472+0000","last_undegraded":"2023-10-16T19:41:00.983472+0000","last_fullsized":"2023-10-16T19:41:00.983472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.665285+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T19:41:08.665285+0000","last_peered":"2023-10-16T19:41:08.665285+0000","last_clean":"2023-10-16T19:41:08.665285+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T19:41:08.665285+0000","last_undegraded":"2023-10-16T19:41:08.665285+0000","last_fullsized":"2023-10-16T19:41:08.665285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784318+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T19:41:00.784318+0000","last_peered":"2023-10-16T19:41:00.784318+0000","last_clean":"2023-10-16T19:41:00.784318+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T19:41:00.784318+0000","last_undegraded":"2023-10-16T19:41:00.784318+0000","last_fullsized":"2023-10-16T19:41:00.784318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.670336+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T19:41:08.670336+0000","last_peered":"2023-10-16T19:41:08.670336+0000","last_clean":"2023-10-16T19:41:08.670336+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T19:41:08.670336+0000","last_undegraded":"2023-10-16T19:41:08.670336+0000","last_fullsized":"2023-10-16T19:41:08.670336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981209+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T19:41:00.981209+0000","last_peered":"2023-10-16T19:41:00.981209+0000","last_clean":"2023-10-16T19:41:00.981209+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T19:41:00.981209+0000","last_undegraded":"2023-10-16T19:41:00.981209+0000","last_fullsized":"2023-10-16T19:41:00.981209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.441244+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T19:40:59.441244+0000","last_peered":"2023-10-16T19:40:59.441244+0000","last_clean":"2023-10-16T19:40:59.441244+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T19:40:59.441244+0000","last_undegraded":"2023-10-16T19:40:59.441244+0000","last_fullsized":"2023-10-16T19:40:59.441244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981819+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T19:41:00.981819+0000","last_peered":"2023-10-16T19:41:00.981819+0000","last_clean":"2023-10-16T19:41:00.981819+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T19:41:00.981819+0000","last_undegraded":"2023-10-16T19:41:00.981819+0000","last_fullsized":"2023-10-16T19:41:00.981819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.668394+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T19:41:08.668394+0000","last_peered":"2023-10-16T19:41:08.668394+0000","last_clean":"2023-10-16T19:41:08.668394+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T19:41:08.668394+0000","last_undegraded":"2023-10-16T19:41:08.668394+0000","last_fullsized":"2023-10-16T19:41:08.668394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985755+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T19:41:00.985755+0000","last_peered":"2023-10-16T19:41:00.985755+0000","last_clean":"2023-10-16T19:41:00.985755+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T19:41:00.985755+0000","last_undegraded":"2023-10-16T19:41:00.985755+0000","last_fullsized":"2023-10-16T19:41:00.985755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986953+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T19:41:00.986953+0000","last_peered":"2023-10-16T19:41:00.986953+0000","last_clean":"2023-10-16T19:41:00.986953+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T19:41:00.986953+0000","last_undegraded":"2023-10-16T19:41:00.986953+0000","last_fullsized":"2023-10-16T19:41:00.986953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.044274+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T19:41:02.044274+0000","last_peered":"2023-10-16T19:41:02.044274+0000","last_clean":"2023-10-16T19:41:02.044274+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T19:41:02.044274+0000","last_undegraded":"2023-10-16T19:41:02.044274+0000","last_fullsized":"2023-10-16T19:41:02.044274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986108+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T19:41:00.986108+0000","last_peered":"2023-10-16T19:41:00.986108+0000","last_clean":"2023-10-16T19:41:00.986108+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T19:41:00.986108+0000","last_undegraded":"2023-10-16T19:41:00.986108+0000","last_fullsized":"2023-10-16T19:41:00.986108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.045001+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T19:41:02.045001+0000","last_peered":"2023-10-16T19:41:02.045001+0000","last_clean":"2023-10-16T19:41:02.045001+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T19:41:02.045001+0000","last_undegraded":"2023-10-16T19:41:02.045001+0000","last_fullsized":"2023-10-16T19:41:02.045001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984216+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T19:41:00.984216+0000","last_peered":"2023-10-16T19:41:00.984216+0000","last_clean":"2023-10-16T19:41:00.984216+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T19:41:00.984216+0000","last_undegraded":"2023-10-16T19:41:00.984216+0000","last_fullsized":"2023-10-16T19:41:00.984216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983090+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T19:41:00.983090+0000","last_peered":"2023-10-16T19:41:00.983090+0000","last_clean":"2023-10-16T19:41:00.983090+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T19:41:00.983090+0000","last_undegraded":"2023-10-16T19:41:00.983090+0000","last_fullsized":"2023-10-16T19:41:00.983090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982817+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T19:41:00.982817+0000","last_peered":"2023-10-16T19:41:00.982817+0000","last_clean":"2023-10-16T19:41:00.982817+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T19:41:00.982817+0000","last_undegraded":"2023-10-16T19:41:00.982817+0000","last_fullsized":"2023-10-16T19:41:00.982817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:01.936737+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T19:41:01.936737+0000","last_peered":"2023-10-16T19:41:01.936737+0000","last_clean":"2023-10-16T19:41:01.936737+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T19:41:01.936737+0000","last_undegraded":"2023-10-16T19:41:01.936737+0000","last_fullsized":"2023-10-16T19:41:01.936737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3816,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":675406,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0179999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":85424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":85956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9239999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.982}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7949999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":674750,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":83848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":84554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:14.902 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T19:41:14.902 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T19:41:14.902 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T19:41:14.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T19:41:14.903 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T19:41:15.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.152+0000 7fb7a5fd7640 1 Processor -- start 2023-10-16T19:41:15.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.152+0000 7fb7a5fd7640 1 -- start start 2023-10-16T19:41:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.154+0000 7fb7a5fd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.154+0000 7fb7a5fd7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a0151570 con 0x7fb7a0151190 2023-10-16T19:41:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.154+0000 7fb7a5fd7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a00c5530 con 0x7fb7a00c12f0 2023-10-16T19:41:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.154+0000 7fb7a5fd7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00c4010 con 0x7fb7a00c2c70 2023-10-16T19:41:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.155+0000 7fb79f7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb7a0151190 0x7fb7a00c2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37830/0 (socket says 172.21.15.57:37830) 2023-10-16T19:41:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.155+0000 7fb79f7fe640 1 -- 172.21.15.57:0/1079241518 learned_addr learned my addr 172.21.15.57:0/1079241518 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.156+0000 7fb79ffff640 1 --2- 172.21.15.57:0/1079241518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:15.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.159+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627727087 0 0) 0x7fb7a0151570 con 0x7fb7a0151190 2023-10-16T19:41:15.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.159+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c003520 con 0x7fb7a0151190 2023-10-16T19:41:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.163+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395694411 0 0) 0x7fb7a00c5530 con 0x7fb7a00c12f0 2023-10-16T19:41:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.163+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a0151570 con 0x7fb7a00c12f0 2023-10-16T19:41:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.163+0000 7fb79ffff640 1 -- 172.21.15.57:0/1079241518 >> v1:172.21.15.110:6789/0 conn(0x7fb7a00c12f0 legacy=0x7fb7a006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.163+0000 7fb79ffff640 1 -- 172.21.15.57:0/1079241518 >> v1:172.21.15.57:6789/0 conn(0x7fb7a0151190 legacy=0x7fb7a00c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.163+0000 7fb79ffff640 1 -- 172.21.15.57:0/1079241518 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a015af20 con 0x7fb7a00c2c70 2023-10-16T19:41:15.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.169+0000 7fb79ffff640 1 --2- 172.21.15.57:0/1079241518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a006dce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb798009dc0 tx=0x7fb79802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=984de05760520790 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:15.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.185+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79802cc30 con 0x7fb7a00c2c70 2023-10-16T19:41:15.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.185+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79802cd90 con 0x7fb7a00c2c70 2023-10-16T19:41:15.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.185+0000 7fb79effd640 1 -- 172.21.15.57:0/1079241518 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798034660 con 0x7fb7a00c2c70 2023-10-16T19:41:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/1079241518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 msgr2=0x7fb7a006dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/1079241518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a006dce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb798009dc0 tx=0x7fb79802be80 comp rx=0 tx=0).stop 2023-10-16T19:41:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/1079241518 shutdown_connections 2023-10-16T19:41:15.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/1079241518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a006dce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:15.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/1079241518 >> 172.21.15.57:0/1079241518 conn(0x7fb7a006c430 msgr2=0x7fb7a0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:15.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/1079241518 shutdown_connections 2023-10-16T19:41:15.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.186+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/1079241518 wait complete. 2023-10-16T19:41:15.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.190+0000 7fb7a5fd7640 1 Processor -- start 2023-10-16T19:41:15.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.190+0000 7fb7a5fd7640 1 -- start start 2023-10-16T19:41:15.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.191+0000 7fb7a5fd7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a00c12f0 0x7fb7a0145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:15.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.191+0000 7fb7a5fd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a00bd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:15.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.191+0000 7fb7a5fd7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 0x7fb7a00c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:15.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.191+0000 7fb7a5fd7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00cae00 con 0x7fb7a0151190 2023-10-16T19:41:15.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.191+0000 7fb7a5fd7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00c08f0 con 0x7fb7a00c12f0 2023-10-16T19:41:15.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.191+0000 7fb7a5fd7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00bb350 con 0x7fb7a00c2c70 2023-10-16T19:41:15.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.193+0000 7fb79ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 0x7fb7a00c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:15.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.193+0000 7fb79f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a00c12f0 0x7fb7a0145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:15.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.193+0000 7fb79ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 0x7fb7a00c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40538/0 (socket says 172.21.15.57:40538) 2023-10-16T19:41:15.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.193+0000 7fb79ffff640 1 -- 172.21.15.57:0/861172776 learned_addr learned my addr 172.21.15.57:0/861172776 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:15.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.194+0000 7fb797fff640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a00bd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:15.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.200+0000 7fb79ffff640 1 -- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 msgr2=0x7fb7a00bd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:15.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.200+0000 7fb79ffff640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a00bd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:15.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.200+0000 7fb79ffff640 1 -- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a00c12f0 msgr2=0x7fb7a0145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:15.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.200+0000 7fb79ffff640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a00c12f0 0x7fb7a0145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:15.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.200+0000 7fb79ffff640 1 -- 172.21.15.57:0/861172776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798009a70 con 0x7fb7a0151190 2023-10-16T19:41:15.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.206+0000 7fb79ffff640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 0x7fb7a00c5d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb79802c490 tx=0x7fb798004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:15.212 INFO:tasks.ceph.mds.e.smithi057.stderr:2023-10-16T19:41:15.203+0000 f5b3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-16T19:41:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.215+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79803e610 con 0x7fb7a0151190 2023-10-16T19:41:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.215+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79803e770 con 0x7fb7a0151190 2023-10-16T19:41:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.215+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79803eb20 con 0x7fb7a0151190 2023-10-16T19:41:15.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.215+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a0145680 con 0x7fb7a0151190 2023-10-16T19:41:15.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.216+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a0070c70 con 0x7fb7a0151190 2023-10-16T19:41:15.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.217+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a00c5b60 con 0x7fb7a0151190 2023-10-16T19:41:15.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.254+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb79803b050 con 0x7fb7a0151190 2023-10-16T19:41:15.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.256+0000 7fb79cff9640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb78006aec0 0x7fb78006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:15.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.256+0000 7fb79f7fe640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb78006aec0 0x7fb78006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:15.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.258+0000 7fb79f7fe640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb78006aec0 0x7fb78006d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7900011e0 tx=0x7fb790007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:15.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.261+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb79807af80 con 0x7fb7a0151190 2023-10-16T19:41:15.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.582+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7980772c0 con 0x7fb7a0151190 2023-10-16T19:41:15.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:15.861+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb7a004e1d0 con 0x7fb7a0151190 2023-10-16T19:41:16.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.061+0000 7fb79cff9640 1 -- 172.21.15.57:0/861172776 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171024 (secure 0 0 0) 0x7fb79804e070 con 0x7fb7a0151190 2023-10-16T19:41:16.069 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:16.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.066+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb78006aec0 msgr2=0x7fb78006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.066+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb78006aec0 0x7fb78006d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7900011e0 tx=0x7fb790007d30 comp rx=0 tx=0).stop 2023-10-16T19:41:16.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 msgr2=0x7fb7a00c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 0x7fb7a00c5d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb79802c490 tx=0x7fb798004a40 comp rx=0 tx=0).stop 2023-10-16T19:41:16.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 shutdown_connections 2023-10-16T19:41:16.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb78006aec0 0x7fb78006d380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7a0151190 0x7fb7a00c5d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7a00c2c70 0x7fb7a00bd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 --2- 172.21.15.57:0/861172776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a00c12f0 0x7fb7a0145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 >> 172.21.15.57:0/861172776 conn(0x7fb7a006c430 msgr2=0x7fb7a014f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:16.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 shutdown_connections 2023-10-16T19:41:16.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.067+0000 7fb7a5fd7640 1 -- 172.21.15.57:0/861172776 wait complete. 2023-10-16T19:41:16.097 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":32930157},{"type":"v1","addr":"172.21.15.57:6801","nonce":32930157}]},"active_addr":"172.21.15.57:6801/32930157","active_change":"2023-10-16T19:40:22.926035+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2964341375}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1974798323}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2646677668}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2949826184}]}]} 2023-10-16T19:41:16.101 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T19:41:16.102 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T19:41:16.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:16.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.325+0000 7fa6003a9640 1 Processor -- start 2023-10-16T19:41:16.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.325+0000 7fa6003a9640 1 -- start start 2023-10-16T19:41:16.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.327+0000 7fa6003a9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5f80c4ad0 0x7fa5f80c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.327+0000 7fa6003a9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80c5d90 con 0x7fa5f80c46f0 2023-10-16T19:41:16.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.327+0000 7fa6003a9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80c57f0 con 0x7fa5f80b0e50 2023-10-16T19:41:16.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.327+0000 7fa6003a9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f8066110 con 0x7fa5f80c4ad0 2023-10-16T19:41:16.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.328+0000 7fa5fd944640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa5f80b0e50 0x7fa5f8153ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:37160/0 (socket says 172.21.15.57:37160) 2023-10-16T19:41:16.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.329+0000 7fa5fd944640 1 -- 172.21.15.57:0/1762294936 learned_addr learned my addr 172.21.15.57:0/1762294936 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:16.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.333+0000 7fa5fe946640 1 --2- 172.21.15.57:0/1762294936 >> v2:172.21.15.57:3300/0 conn(0x7fa5f80c4ad0 0x7fa5f80c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.338+0000 7fa5fe946640 1 -- 172.21.15.57:0/1762294936 >> v1:172.21.15.110:6789/0 conn(0x7fa5f80b0e50 legacy=0x7fa5f8153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.338+0000 7fa5fe946640 1 -- 172.21.15.57:0/1762294936 >> v1:172.21.15.57:6789/0 conn(0x7fa5f80c46f0 legacy=0x7fa5f8157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.338+0000 7fa5fe946640 1 -- 172.21.15.57:0/1762294936 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f80c5ab0 con 0x7fa5f80c4ad0 2023-10-16T19:41:16.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.412+0000 7fa5fe946640 1 --2- 172.21.15.57:0/1762294936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c4ad0 0x7fa5f80c72d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009d90 tx=0x7fa5f002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda786776c3fcaf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:16.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.428+0000 7fa5fd143640 1 -- 172.21.15.57:0/1762294936 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f002ccf0 con 0x7fa5f80c4ad0 2023-10-16T19:41:16.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.428+0000 7fa5fd143640 1 -- 172.21.15.57:0/1762294936 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f002ce50 con 0x7fa5f80c4ad0 2023-10-16T19:41:16.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.428+0000 7fa5fd143640 1 -- 172.21.15.57:0/1762294936 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0034660 con 0x7fa5f80c4ad0 2023-10-16T19:41:16.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 -- 172.21.15.57:0/1762294936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c4ad0 msgr2=0x7fa5f80c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 --2- 172.21.15.57:0/1762294936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c4ad0 0x7fa5f80c72d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009d90 tx=0x7fa5f002bf40 comp rx=0 tx=0).stop 2023-10-16T19:41:16.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 -- 172.21.15.57:0/1762294936 shutdown_connections 2023-10-16T19:41:16.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 --2- 172.21.15.57:0/1762294936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c4ad0 0x7fa5f80c72d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 -- 172.21.15.57:0/1762294936 >> 172.21.15.57:0/1762294936 conn(0x7fa5f80c78f0 msgr2=0x7fa5f80c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:16.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 -- 172.21.15.57:0/1762294936 shutdown_connections 2023-10-16T19:41:16.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.429+0000 7fa6003a9640 1 -- 172.21.15.57:0/1762294936 wait complete. 2023-10-16T19:41:16.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.432+0000 7fa6003a9640 1 Processor -- start 2023-10-16T19:41:16.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.432+0000 7fa6003a9640 1 -- start start 2023-10-16T19:41:16.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa6003a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5f80b0e50 0x7fa5f80be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa6003a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 0x7fa5f8148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa6003a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5f80c4ad0 0x7fa5f8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa6003a9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81521b0 con 0x7fa5f80c46f0 2023-10-16T19:41:16.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa6003a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80ca410 con 0x7fa5f80c4ad0 2023-10-16T19:41:16.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa6003a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8154f50 con 0x7fa5f80b0e50 2023-10-16T19:41:16.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.434+0000 7fa5fd944640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 0x7fa5f8148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.435+0000 7fa5fd944640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 0x7fa5f8148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56300/0 (socket says 172.21.15.57:56300) 2023-10-16T19:41:16.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.435+0000 7fa5fd944640 1 -- 172.21.15.57:0/206343705 learned_addr learned my addr 172.21.15.57:0/206343705 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:16.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.435+0000 7fa5fe145640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5f80b0e50 0x7fa5f80be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.439+0000 7fa5fd944640 1 -- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5f80b0e50 msgr2=0x7fa5f80be9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.439+0000 7fa5fd944640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5f80b0e50 0x7fa5f80be9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.439+0000 7fa5fd944640 1 -- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5f80c4ad0 msgr2=0x7fa5f8155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.439+0000 7fa5fd944640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5f80c4ad0 0x7fa5f8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.439+0000 7fa5fd944640 1 -- 172.21.15.57:0/206343705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009a70 con 0x7fa5f80c46f0 2023-10-16T19:41:16.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.442+0000 7fa5fd944640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 0x7fa5f8148560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c500 tx=0x7fa5e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:16.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.448+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8005ce0 con 0x7fa5f80c46f0 2023-10-16T19:41:16.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.448+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8005e40 con 0x7fa5f80c46f0 2023-10-16T19:41:16.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.448+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80072f0 con 0x7fa5f80c46f0 2023-10-16T19:41:16.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.448+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f80c0c20 con 0x7fa5f80c46f0 2023-10-16T19:41:16.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.448+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f80bf3a0 con 0x7fa5f80c46f0 2023-10-16T19:41:16.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.449+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f804e1d0 con 0x7fa5f80c46f0 2023-10-16T19:41:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.471+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5e8007510 con 0x7fa5f80c46f0 2023-10-16T19:41:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.472+0000 7fa5eeffd640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa5dc06aec0 0x7fa5dc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.473+0000 7fa5fe145640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa5dc06aec0 0x7fa5dc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.474+0000 7fa5fe145640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa5dc06aec0 0x7fa5dc06d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4000f60 tx=0x7fa5f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.780+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5e8058140 con 0x7fa5f80c46f0 2023-10-16T19:41:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.781+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5e8054480 con 0x7fa5f80c46f0 2023-10-16T19:41:16.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:16.996+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5f81e0130 con 0x7fa5f80c46f0 2023-10-16T19:41:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.087+0000 7fa5eeffd640 1 -- 172.21.15.57:0/206343705 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fa5e8057aa0 con 0x7fa5f80c46f0 2023-10-16T19:41:17.090 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:17.090 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:00.442991+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa5dc06aec0 msgr2=0x7fa5dc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa5dc06aec0 0x7fa5dc06d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4000f60 tx=0x7fa5f4009040 comp rx=0 tx=0).stop 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 msgr2=0x7fa5f8148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 0x7fa5f8148560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c500 tx=0x7fa5e800c9c0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 shutdown_connections 2023-10-16T19:41:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa5dc06aec0 0x7fa5dc06d380 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5f80c4ad0 0x7fa5f8155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.090+0000 7fa6003a9640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5f80c46f0 0x7fa5f8148560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.091+0000 7fa6003a9640 1 --2- 172.21.15.57:0/206343705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5f80b0e50 0x7fa5f80be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.091+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 >> 172.21.15.57:0/206343705 conn(0x7fa5f80c78f0 msgr2=0x7fa5f80c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.091+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 shutdown_connections 2023-10-16T19:41:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.091+0000 7fa6003a9640 1 -- 172.21.15.57:0/206343705 wait complete. 2023-10-16T19:41:17.115 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T19:41:17.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:17.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.330+0000 7f88f8f0f640 1 Processor -- start 2023-10-16T19:41:17.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.330+0000 7f88f8f0f640 1 -- start start 2023-10-16T19:41:17.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.332+0000 7f88f8f0f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88f414ff50 0x7f88f40711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.332+0000 7f88f8f0f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88f4071d80 0x7f88f4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.332+0000 7f88f8f0f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f4150330 con 0x7f88f4071930 2023-10-16T19:41:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.332+0000 7f88f8f0f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40c2b80 con 0x7f88f4071d80 2023-10-16T19:41:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.332+0000 7f88f8f0f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40c66d0 con 0x7f88f414ff50 2023-10-16T19:41:17.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.333+0000 7f88f2d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88f4071d80 0x7f88f4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.333+0000 7f88e9d9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f88f4071930 0x7f88f40c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51142/0 (socket says 172.21.15.57:51142) 2023-10-16T19:41:17.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.333+0000 7f88e9d9b640 1 -- 172.21.15.57:0/1392221247 learned_addr learned my addr 172.21.15.57:0/1392221247 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:17.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.337+0000 7f88f2d9d640 1 -- 172.21.15.57:0/1392221247 >> v2:172.21.15.110:3300/0 conn(0x7f88f414ff50 msgr2=0x7f88f40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:17.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.337+0000 7f88f2d9d640 1 --2- 172.21.15.57:0/1392221247 >> v2:172.21.15.110:3300/0 conn(0x7f88f414ff50 0x7f88f40711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.337+0000 7f88f2d9d640 1 -- 172.21.15.57:0/1392221247 >> v1:172.21.15.57:6789/0 conn(0x7f88f4071930 legacy=0x7f88f40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.337+0000 7f88f2d9d640 1 -- 172.21.15.57:0/1392221247 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f415a110 con 0x7f88f4071d80 2023-10-16T19:41:17.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.341+0000 7f88f2d9d640 1 --2- 172.21.15.57:0/1392221247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4071d80 0x7f88f4155f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f88f406ab50 tx=0x7f88ec02db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e50a1d9a622cec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.349+0000 7f88f1d9b640 1 -- 172.21.15.57:0/1392221247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec02e920 con 0x7f88f4071d80 2023-10-16T19:41:17.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.349+0000 7f88f1d9b640 1 -- 172.21.15.57:0/1392221247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec02ea80 con 0x7f88f4071d80 2023-10-16T19:41:17.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.349+0000 7f88f1d9b640 1 -- 172.21.15.57:0/1392221247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec02ee10 con 0x7f88f4071d80 2023-10-16T19:41:17.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.350+0000 7f88f8f0f640 1 -- 172.21.15.57:0/1392221247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4071d80 msgr2=0x7f88f4155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.350+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/1392221247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4071d80 0x7f88f4155f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f88f406ab50 tx=0x7f88ec02db70 comp rx=0 tx=0).stop 2023-10-16T19:41:17.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.351+0000 7f88f8f0f640 1 -- 172.21.15.57:0/1392221247 shutdown_connections 2023-10-16T19:41:17.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.351+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/1392221247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4071d80 0x7f88f4155f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.351+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/1392221247 >> v2:172.21.15.110:3300/0 conn(0x7f88f414ff50 0x7f88f40711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.351+0000 7f88f8f0f640 1 -- 172.21.15.57:0/1392221247 >> 172.21.15.57:0/1392221247 conn(0x7f88f406c430 msgr2=0x7f88f4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:17.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.351+0000 7f88f8f0f640 1 -- 172.21.15.57:0/1392221247 shutdown_connections 2023-10-16T19:41:17.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.351+0000 7f88f8f0f640 1 -- 172.21.15.57:0/1392221247 wait complete. 2023-10-16T19:41:17.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.353+0000 7f88f8f0f640 1 Processor -- start 2023-10-16T19:41:17.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.353+0000 7f88f8f0f640 1 -- start start 2023-10-16T19:41:17.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.354+0000 7f88f8f0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f4071930 0x7f88f40c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.354+0000 7f88f8f0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f414ff50 0x7f88f414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.354+0000 7f88f8f0f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 0x7f88f40c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.354+0000 7f88f8f0f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40c4ad0 con 0x7f88f4141340 2023-10-16T19:41:17.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.354+0000 7f88f8f0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f414ac10 con 0x7f88f4071930 2023-10-16T19:41:17.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.354+0000 7f88f8f0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4156e80 con 0x7f88f414ff50 2023-10-16T19:41:17.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.355+0000 7f88f2d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 0x7f88f40c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.356+0000 7f88f259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f4071930 0x7f88f40c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.356+0000 7f88f2d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 0x7f88f40c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56318/0 (socket says 172.21.15.57:56318) 2023-10-16T19:41:17.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.356+0000 7f88f2d9d640 1 -- 172.21.15.57:0/2947580243 learned_addr learned my addr 172.21.15.57:0/2947580243 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:17.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.360+0000 7f88f2d9d640 1 -- 172.21.15.57:0/2947580243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f414ff50 msgr2=0x7f88f414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.360+0000 7f88f2d9d640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f414ff50 0x7f88f414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.360+0000 7f88f2d9d640 1 -- 172.21.15.57:0/2947580243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f4071930 msgr2=0x7f88f40c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.360+0000 7f88f2d9d640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f4071930 0x7f88f40c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.360+0000 7f88f2d9d640 1 -- 172.21.15.57:0/2947580243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec009400 con 0x7f88f4141340 2023-10-16T19:41:17.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.364+0000 7f88f2d9d640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 0x7f88f40c5500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88ec02e180 tx=0x7f88ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.451+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec03f660 con 0x7f88f4141340 2023-10-16T19:41:17.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.451+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec03f7e0 con 0x7f88f4141340 2023-10-16T19:41:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.451+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec03fb90 con 0x7f88f4141340 2023-10-16T19:41:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.451+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f4157160 con 0x7f88f4141340 2023-10-16T19:41:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.452+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f40c4d00 con 0x7f88f4141340 2023-10-16T19:41:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.453+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f40c7a20 con 0x7f88f4141340 2023-10-16T19:41:17.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.813+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88ec03d070 con 0x7f88f4141340 2023-10-16T19:41:17.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.814+0000 7f88eb7fe640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88d406aef0 0x7f88d406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.815+0000 7f88f259c640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88d406aef0 0x7f88d406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.816+0000 7f88f259c640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88d406aef0 0x7f88d406d3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88e400a400 tx=0x7f88e400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.840+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88ec07be20 con 0x7f88f4141340 2023-10-16T19:41:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:17.841+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88ec077a60 con 0x7f88f4141340 2023-10-16T19:41:18.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.080+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88f40c7a20 con 0x7f88f4141340 2023-10-16T19:41:18.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.144+0000 7f88eb7fe640 1 -- 172.21.15.57:0/2947580243 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f88ec03b070 con 0x7f88f4141340 2023-10-16T19:41:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:18.148 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:00.442991+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:18.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88d406aef0 msgr2=0x7f88d406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88d406aef0 0x7f88d406d3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88e400a400 tx=0x7f88e400d040 comp rx=0 tx=0).stop 2023-10-16T19:41:18.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 msgr2=0x7f88f40c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 0x7f88f40c5500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88ec02e180 tx=0x7f88ec0046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 shutdown_connections 2023-10-16T19:41:18.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88d406aef0 0x7f88d406d3b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88f4141340 0x7f88f40c5500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88f414ff50 0x7f88f414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 --2- 172.21.15.57:0/2947580243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88f4071930 0x7f88f40c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 >> 172.21.15.57:0/2947580243 conn(0x7f88f406c430 msgr2=0x7f88f406d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 shutdown_connections 2023-10-16T19:41:18.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.148+0000 7f88f8f0f640 1 -- 172.21.15.57:0/2947580243 wait complete. 2023-10-16T19:41:18.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T19:41:18.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T19:41:18.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T19:41:18.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T19:41:18.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T19:41:18.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T19:41:18.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T19:41:18.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T19:41:18.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.546+0000 7f6a70590640 1 Processor -- start 2023-10-16T19:41:18.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.546+0000 7f6a70590640 1 -- start start 2023-10-16T19:41:18.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.549+0000 7f6a70590640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a681551b0 0x7f6a6806a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.549+0000 7f6a70590640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a681587a0 con 0x7f6a68069de0 2023-10-16T19:41:18.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.549+0000 7f6a70590640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6814f660 con 0x7f6a680c66b0 2023-10-16T19:41:18.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.549+0000 7f6a70590640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6806a700 con 0x7f6a681551b0 2023-10-16T19:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.551+0000 7f6a6db2b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6a680c66b0 0x7f6a6815db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:37168/0 (socket says 172.21.15.57:37168) 2023-10-16T19:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.551+0000 7f6a6db2b640 1 -- 172.21.15.57:0/762343229 learned_addr learned my addr 172.21.15.57:0/762343229 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:18.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.565+0000 7f6a6eb2d640 1 --2- 172.21.15.57:0/762343229 >> v2:172.21.15.57:3300/0 conn(0x7f6a681551b0 0x7f6a6806a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.566+0000 7f6a6d32a640 1 -- 172.21.15.57:0/762343229 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141409688 0 0) 0x7f6a6814f660 con 0x7f6a680c66b0 2023-10-16T19:41:18.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.567+0000 7f6a6d32a640 1 -- 172.21.15.57:0/762343229 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a54003440 con 0x7f6a680c66b0 2023-10-16T19:41:18.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.571+0000 7f9523fff640 1 Processor -- start 2023-10-16T19:41:18.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.571+0000 7f9523fff640 1 -- start start 2023-10-16T19:41:18.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.573+0000 7f9523fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f952406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.573+0000 7f9523fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95240c67c0 0x7f952406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.573+0000 7f9523fff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952406e230 con 0x7f95241540b0 2023-10-16T19:41:18.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.573+0000 7f9523fff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9524161800 con 0x7f95240c67c0 2023-10-16T19:41:18.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.573+0000 7f9523fff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9524161560 con 0x7f95240c5cd0 2023-10-16T19:41:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.574+0000 7f6a6eb2d640 1 -- 172.21.15.57:0/762343229 >> v1:172.21.15.110:6789/0 conn(0x7f6a680c66b0 legacy=0x7f6a6815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.574+0000 7f6a6eb2d640 1 -- 172.21.15.57:0/762343229 >> v1:172.21.15.57:6789/0 conn(0x7f6a68069de0 legacy=0x7f6a68158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.574+0000 7f6a6eb2d640 1 -- 172.21.15.57:0/762343229 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680bf9c0 con 0x7f6a681551b0 2023-10-16T19:41:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.575+0000 7fa0d0e9e640 1 Processor -- start 2023-10-16T19:41:18.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.575+0000 7fa0d0e9e640 1 -- start start 2023-10-16T19:41:18.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.576+0000 7f95227fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f952406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.577+0000 7fa0d0e9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0cc153180 0x7fa0cc0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.577+0000 7fa0d0e9e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0cc0c5c20 0x7fa0cc0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.577+0000 7fa0d0e9e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc0cef90 con 0x7fa0cc0ceb00 2023-10-16T19:41:18.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.577+0000 7fa0d0e9e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc159bb0 con 0x7fa0cc0c5c20 2023-10-16T19:41:18.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.577+0000 7fa0d0e9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc153560 con 0x7fa0cc153180 2023-10-16T19:41:18.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.578+0000 7f95227fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f952406dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:38878/0 (socket says 172.21.15.57:38878) 2023-10-16T19:41:18.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.578+0000 7f95227fc640 1 -- 172.21.15.57:0/2926584920 learned_addr learned my addr 172.21.15.57:0/2926584920 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.578+0000 7fdf5bfff640 1 Processor -- start 2023-10-16T19:41:18.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.578+0000 7fdf5bfff640 1 -- start start 2023-10-16T19:41:18.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.580+0000 7fdf5bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf5c14efb0 0x7fdf5c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.580+0000 7fdf5bfff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c1591c0 con 0x7fdf5c0c7a20 2023-10-16T19:41:18.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.580+0000 7fdf5bfff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c158ee0 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.580+0000 7fdf5bfff640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c0c4ea0 con 0x7fdf5c14efb0 2023-10-16T19:41:18.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.583+0000 7fa0caffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa0cc0ceb00 0x7fa0cc0c93f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51174/0 (socket says 172.21.15.57:51174) 2023-10-16T19:41:18.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.583+0000 7fa0caffd640 1 -- 172.21.15.57:0/2136095963 learned_addr learned my addr 172.21.15.57:0/2136095963 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:18.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.583+0000 7fa0cbfff640 1 --2- 172.21.15.57:0/2136095963 >> v2:172.21.15.57:3300/0 conn(0x7fa0cc0c5c20 0x7fa0cc0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.583+0000 7f17d8b18640 1 Processor -- start 2023-10-16T19:41:18.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.584+0000 7f262171a640 1 Processor -- start 2023-10-16T19:41:18.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.584+0000 7f17d8b18640 1 -- start start 2023-10-16T19:41:18.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.585+0000 7f95227fc640 1 -- 172.21.15.57:0/2926584920 >> v2:172.21.15.110:3300/0 conn(0x7f95240c67c0 msgr2=0x7f952406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.585+0000 7f95227fc640 1 --2- 172.21.15.57:0/2926584920 >> v2:172.21.15.110:3300/0 conn(0x7f95240c67c0 0x7f952406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.585+0000 7f95227fc640 1 -- 172.21.15.57:0/2926584920 >> v1:172.21.15.57:6789/0 conn(0x7f95241540b0 legacy=0x7f9524070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.585+0000 7f95227fc640 1 -- 172.21.15.57:0/2926584920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952406dab0 con 0x7f95240c5cd0 2023-10-16T19:41:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.585+0000 7f262171a640 1 -- start start 2023-10-16T19:41:18.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.586+0000 7f17d8b18640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17d40ca900 0x7f17d406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.586+0000 7f17d8b18640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40c9a30 con 0x7f17d40c4ba0 2023-10-16T19:41:18.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.586+0000 7f17d8b18640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40c4710 con 0x7f17d4153170 2023-10-16T19:41:18.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.586+0000 7f17d8b18640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40c9260 con 0x7f17d40ca900 2023-10-16T19:41:18.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.587+0000 7f262171a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f261c1575c0 0x7f261c0c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.587+0000 7f262171a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f261c15dcb0 0x7f261c0c5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.587+0000 7f262171a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c161240 con 0x7f261c15d890 2023-10-16T19:41:18.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.587+0000 7f262171a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c1579a0 con 0x7f261c1575c0 2023-10-16T19:41:18.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.587+0000 7f262171a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c15d1a0 con 0x7f261c15dcb0 2023-10-16T19:41:18.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.588+0000 7f6a6eb2d640 1 --2- 172.21.15.57:0/762343229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 0x7f6a6806a1c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a640097a0 tx=0x7f6a6402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923b840639c5deec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.591+0000 7f95227fc640 1 --2- 172.21.15.57:0/2926584920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f952406dcf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9518009850 tx=0x7f951802ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f95b9b67f55748 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.601+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2136095963 >> v2:172.21.15.110:3300/0 conn(0x7fa0cc153180 msgr2=0x7fa0cc0ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.601+0000 7fa0cbfff640 1 --2- 172.21.15.57:0/2136095963 >> v2:172.21.15.110:3300/0 conn(0x7fa0cc153180 0x7fa0cc0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.601+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2136095963 >> v1:172.21.15.57:6789/0 conn(0x7fa0cc0ceb00 legacy=0x7fa0cc0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.601+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2136095963 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc158fa0 con 0x7fa0cc0c5c20 2023-10-16T19:41:18.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.602+0000 7f55544d7640 1 Processor -- start 2023-10-16T19:41:18.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.602+0000 7f55544d7640 1 -- start start 2023-10-16T19:41:18.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f55544d7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f554c0c12f0 0x7f554c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f55544d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f554c0c2c70 0x7f554c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f55544d7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c151570 con 0x7f554c151190 2023-10-16T19:41:18.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f55544d7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0c4010 con 0x7f554c0c12f0 2023-10-16T19:41:18.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f55544d7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0c1ce0 con 0x7f554c0c2c70 2023-10-16T19:41:18.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f6a6d32a640 1 -- 172.21.15.57:0/762343229 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64030610 con 0x7f6a681551b0 2023-10-16T19:41:18.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f6a6d32a640 1 -- 172.21.15.57:0/762343229 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64030770 con 0x7f6a681551b0 2023-10-16T19:41:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f6a6d32a640 1 -- 172.21.15.57:0/762343229 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64030b00 con 0x7f6a681551b0 2023-10-16T19:41:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.605+0000 7f9521ffb640 1 -- 172.21.15.57:0/2926584920 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518004230 con 0x7f95240c5cd0 2023-10-16T19:41:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f9521ffb640 1 -- 172.21.15.57:0/2926584920 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518004390 con 0x7f95240c5cd0 2023-10-16T19:41:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f9521ffb640 1 -- 172.21.15.57:0/2926584920 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951802f820 con 0x7f95240c5cd0 2023-10-16T19:41:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7fa0cbfff640 1 --2- 172.21.15.57:0/2136095963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc0c5c20 0x7fa0cc0cad90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc06b090 tx=0x7fa0b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821d6e91ac18bb91 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f6a70590640 1 -- 172.21.15.57:0/762343229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 msgr2=0x7f6a6806a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f6a70590640 1 --2- 172.21.15.57:0/762343229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 0x7f6a6806a1c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a640097a0 tx=0x7f6a6402b960 comp rx=0 tx=0).stop 2023-10-16T19:41:18.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f6a70590640 1 -- 172.21.15.57:0/762343229 shutdown_connections 2023-10-16T19:41:18.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f6a70590640 1 --2- 172.21.15.57:0/762343229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 0x7f6a6806a1c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f6a70590640 1 -- 172.21.15.57:0/762343229 >> 172.21.15.57:0/762343229 conn(0x7f6a6806da20 msgr2=0x7f6a680ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f9523fff640 1 -- 172.21.15.57:0/2926584920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 msgr2=0x7f952406dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f9523fff640 1 --2- 172.21.15.57:0/2926584920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f952406dcf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9518009850 tx=0x7f951802ba00 comp rx=0 tx=0).stop 2023-10-16T19:41:18.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.606+0000 7f6a70590640 1 -- 172.21.15.57:0/762343229 shutdown_connections 2023-10-16T19:41:18.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f9523fff640 1 -- 172.21.15.57:0/2926584920 shutdown_connections 2023-10-16T19:41:18.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f9523fff640 1 --2- 172.21.15.57:0/2926584920 >> v2:172.21.15.110:3300/0 conn(0x7f95240c67c0 0x7f952406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f9523fff640 1 --2- 172.21.15.57:0/2926584920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f952406dcf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f9523fff640 1 -- 172.21.15.57:0/2926584920 >> 172.21.15.57:0/2926584920 conn(0x7f95240c6f00 msgr2=0x7f95240c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f9523fff640 1 -- 172.21.15.57:0/2926584920 shutdown_connections 2023-10-16T19:41:18.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f9523fff640 1 -- 172.21.15.57:0/2926584920 wait complete. 2023-10-16T19:41:18.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.607+0000 7f6a70590640 1 -- 172.21.15.57:0/762343229 wait complete. 2023-10-16T19:41:18.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.609+0000 7f6a70590640 1 Processor -- start 2023-10-16T19:41:18.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.609+0000 7f9523fff640 1 Processor -- start 2023-10-16T19:41:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.610+0000 7f9523fff640 1 -- start start 2023-10-16T19:41:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.610+0000 7f6a70590640 1 -- start start 2023-10-16T19:41:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.610+0000 7fdf5b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdf5c0c7a20 0x7fdf5c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51188/0 (socket says 172.21.15.57:51188) 2023-10-16T19:41:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.610+0000 7fdf5b7fe640 1 -- 172.21.15.57:0/1079486885 learned_addr learned my addr 172.21.15.57:0/1079486885 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f9523fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f95240c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f9523fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95240c67c0 0x7f952413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f9523fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95241540b0 0x7f95240c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f9523fff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952415f050 con 0x7f95240c67c0 2023-10-16T19:41:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f9523fff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952413b6e0 con 0x7f95241540b0 2023-10-16T19:41:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f9523fff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952413ccc0 con 0x7f95240c5cd0 2023-10-16T19:41:18.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f6a70590640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a68069de0 0x7f6a681e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f6a70590640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a680c66b0 0x7f6a68146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f6a70590640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 0x7f6a681dece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f6a70590640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681f6250 con 0x7f6a681551b0 2023-10-16T19:41:18.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f6a70590640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681f6dd0 con 0x7f6a680c66b0 2023-10-16T19:41:18.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.611+0000 7f6a70590640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681ddd10 con 0x7f6a68069de0 2023-10-16T19:41:18.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.614+0000 7f6a6e32c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a68069de0 0x7f6a681e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.614+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f95240c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.615+0000 7fdf5affd640 1 --2- 172.21.15.57:0/1079486885 >> v2:172.21.15.57:3300/0 conn(0x7fdf5c14efb0 0x7fdf5c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.615+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f95240c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:38888/0 (socket says 172.21.15.57:38888) 2023-10-16T19:41:18.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.615+0000 7f9522ffd640 1 -- 172.21.15.57:0/324578419 learned_addr learned my addr 172.21.15.57:0/324578419 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.616+0000 7f6a6e32c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a68069de0 0x7f6a681e05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:38892/0 (socket says 172.21.15.57:38892) 2023-10-16T19:41:18.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.616+0000 7f6a6e32c640 1 -- 172.21.15.57:0/797358756 learned_addr learned my addr 172.21.15.57:0/797358756 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.618+0000 7f261bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f261c1575c0 0x7f261c0c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.618+0000 7f261bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f261c1575c0 0x7f261c0c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56352/0 (socket says 172.21.15.57:56352) 2023-10-16T19:41:18.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.618+0000 7f261bfff640 1 -- 172.21.15.57:0/2830358317 learned_addr learned my addr 172.21.15.57:0/2830358317 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.620+0000 7fdf5affd640 1 -- 172.21.15.57:0/1079486885 >> v1:172.21.15.110:6789/0 conn(0x7fdf5c0c67c0 legacy=0x7fdf5c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.620+0000 7fdf5affd640 1 -- 172.21.15.57:0/1079486885 >> v1:172.21.15.57:6789/0 conn(0x7fdf5c0c7a20 legacy=0x7fdf5c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.620+0000 7fdf5affd640 1 -- 172.21.15.57:0/1079486885 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0c5180 con 0x7fdf5c14efb0 2023-10-16T19:41:18.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.622+0000 7f261bfff640 1 -- 172.21.15.57:0/2830358317 >> v2:172.21.15.110:3300/0 conn(0x7f261c15dcb0 msgr2=0x7f261c0c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.622+0000 7f261bfff640 1 --2- 172.21.15.57:0/2830358317 >> v2:172.21.15.110:3300/0 conn(0x7f261c15dcb0 0x7f261c0c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.622+0000 7f261bfff640 1 -- 172.21.15.57:0/2830358317 >> v1:172.21.15.110:6789/0 conn(0x7f261c15d890 legacy=0x7f261c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.622+0000 7f261bfff640 1 -- 172.21.15.57:0/2830358317 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c15d390 con 0x7f261c1575c0 2023-10-16T19:41:18.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.624+0000 7fa0ca7fc640 1 -- 172.21.15.57:0/2136095963 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4031830 con 0x7fa0cc0c5c20 2023-10-16T19:41:18.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.624+0000 7fa0ca7fc640 1 -- 172.21.15.57:0/2136095963 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4031990 con 0x7fa0cc0c5c20 2023-10-16T19:41:18.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0ca7fc640 1 -- 172.21.15.57:0/2136095963 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4031d20 con 0x7fa0cc0c5c20 2023-10-16T19:41:18.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2136095963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc0c5c20 msgr2=0x7fa0cc0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 --2- 172.21.15.57:0/2136095963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc0c5c20 0x7fa0cc0cad90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc06b090 tx=0x7fa0b402b8d0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2136095963 shutdown_connections 2023-10-16T19:41:18.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 --2- 172.21.15.57:0/2136095963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc0c5c20 0x7fa0cc0cad90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7f5edb01a640 1 Processor -- start 2023-10-16T19:41:18.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 --2- 172.21.15.57:0/2136095963 >> v2:172.21.15.110:3300/0 conn(0x7fa0cc153180 0x7fa0cc0ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2136095963 >> 172.21.15.57:0/2136095963 conn(0x7fa0cc06c760 msgr2=0x7fa0cc06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.625+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2136095963 shutdown_connections 2023-10-16T19:41:18.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.626+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2136095963 wait complete. 2023-10-16T19:41:18.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.626+0000 7f5edb01a640 1 -- start start 2023-10-16T19:41:18.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.626+0000 7f17c9d9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f17d40c4ba0 0x7f17d40c3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51194/0 (socket says 172.21.15.57:51194) 2023-10-16T19:41:18.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.626+0000 7f17c9d9b640 1 -- 172.21.15.57:0/2189368531 learned_addr learned my addr 172.21.15.57:0/2189368531 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:18.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.627+0000 7f5edb01a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ed41531a0 0x7f5ed40c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.627+0000 7f5edb01a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed415c5a0 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.627+0000 7f5edb01a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed415d400 con 0x7f5ed41599e0 2023-10-16T19:41:18.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.627+0000 7f5edb01a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed415c7f0 con 0x7f5ed41531a0 2023-10-16T19:41:18.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7f6a6e32c640 1 -- 172.21.15.57:0/797358756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a680c66b0 msgr2=0x7f6a68146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7f6a6e32c640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a680c66b0 0x7f6a68146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7f6a6e32c640 1 -- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 msgr2=0x7f6a681dece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7f6a6e32c640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a681551b0 0x7f6a681dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7f6a6e32c640 1 -- 172.21.15.57:0/797358756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64009400 con 0x7f6a68069de0 2023-10-16T19:41:18.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7fa0d0e9e640 1 Processor -- start 2023-10-16T19:41:18.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.628+0000 7fa0d0e9e640 1 -- start start 2023-10-16T19:41:18.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.629+0000 7fa0d0e9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0cc0c5c20 0x7fa0cc0ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.629+0000 7fa0d0e9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0cc153180 0x7fa0cc14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.629+0000 7fa0d0e9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc14c980 0x7fa0cc14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.629+0000 7fa0d0e9e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc158d90 con 0x7fa0cc14c980 2023-10-16T19:41:18.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.629+0000 7fa0d0e9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0ce590 con 0x7fa0cc153180 2023-10-16T19:41:18.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.629+0000 7fa0d0e9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc1f28f0 con 0x7fa0cc0c5c20 2023-10-16T19:41:18.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.630+0000 7f261bfff640 1 --2- 172.21.15.57:0/2830358317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c0c68a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f261c06b3a0 tx=0x7f260c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b32a72728596d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.631+0000 7fdf5affd640 1 --2- 172.21.15.57:0/1079486885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c14efb0 0x7fdf5c06fc00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009d90 tx=0x7fdf4c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d754720774c63a08 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.634+0000 7f95227fc640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95240c67c0 0x7f952413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.636+0000 7f5552a74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f554c0c2c70 0x7f554c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.637+0000 7f9522ffd640 1 -- 172.21.15.57:0/324578419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95241540b0 msgr2=0x7f95240c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.637+0000 7f9522ffd640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95241540b0 0x7f95240c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.637+0000 7f9522ffd640 1 -- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95240c67c0 msgr2=0x7f952413d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.637+0000 7f9522ffd640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95240c67c0 0x7f952413d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.637+0000 7f9522ffd640 1 -- 172.21.15.57:0/324578419 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009460 con 0x7f95240c5cd0 2023-10-16T19:41:18.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.637+0000 7f5551a72640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f554c0c12f0 0x7f554c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.640+0000 7f5551a72640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f554c0c12f0 0x7f554c06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56354/0 (socket says 172.21.15.57:56354) 2023-10-16T19:41:18.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.640+0000 7f5551a72640 1 -- 172.21.15.57:0/1783538919 learned_addr learned my addr 172.21.15.57:0/1783538919 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.644+0000 7f5551a72640 1 -- 172.21.15.57:0/1783538919 >> v2:172.21.15.110:3300/0 conn(0x7f554c0c2c70 msgr2=0x7f554c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.644+0000 7f5551a72640 1 --2- 172.21.15.57:0/1783538919 >> v2:172.21.15.110:3300/0 conn(0x7f554c0c2c70 0x7f554c06db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.644+0000 7f5551a72640 1 -- 172.21.15.57:0/1783538919 >> v1:172.21.15.57:6789/0 conn(0x7f554c151190 legacy=0x7f554c0c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.644+0000 7f5551a72640 1 -- 172.21.15.57:0/1783538919 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0c5530 con 0x7f554c0c12f0 2023-10-16T19:41:18.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.647+0000 7f9522ffd640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f95240c9710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f951400c430 tx=0x7f951400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.647+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186496820 0 0) 0x7f17d40c9a30 con 0x7f17d40c4ba0 2023-10-16T19:41:18.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.647+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c0003520 con 0x7f17d40c4ba0 2023-10-16T19:41:18.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.648+0000 7f5551a72640 1 --2- 172.21.15.57:0/1783538919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c0c12f0 0x7f554c06d5d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f554c0c1710 tx=0x7f553c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c240a9df3f18fd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.648+0000 7f5ed8db6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ed41531a0 0x7f5ed40c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.648+0000 7f6a6e32c640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a68069de0 0x7f6a681e05d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000bd60 tx=0x7f6a60009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.649+0000 7f5ed8db6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ed41531a0 0x7f5ed40c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56368/0 (socket says 172.21.15.57:56368) 2023-10-16T19:41:18.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.649+0000 7f5ed8db6640 1 -- 172.21.15.57:0/51911951 learned_addr learned my addr 172.21.15.57:0/51911951 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.651+0000 7f261affd640 1 -- 172.21.15.57:0/2830358317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c030880 con 0x7f261c1575c0 2023-10-16T19:41:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.651+0000 7f261affd640 1 -- 172.21.15.57:0/2830358317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0309e0 con 0x7f261c1575c0 2023-10-16T19:41:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.651+0000 7f261affd640 1 -- 172.21.15.57:0/2830358317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c030db0 con 0x7f261c1575c0 2023-10-16T19:41:18.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 -- 172.21.15.57:0/2830358317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 msgr2=0x7f261c0c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 --2- 172.21.15.57:0/2830358317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c0c68a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f261c06b3a0 tx=0x7f260c02b9c0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 -- 172.21.15.57:0/2830358317 shutdown_connections 2023-10-16T19:41:18.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 --2- 172.21.15.57:0/2830358317 >> v2:172.21.15.110:3300/0 conn(0x7f261c15dcb0 0x7f261c0c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 --2- 172.21.15.57:0/2830358317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c0c68a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 -- 172.21.15.57:0/2830358317 >> 172.21.15.57:0/2830358317 conn(0x7f261c0c6f00 msgr2=0x7f261c0c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 -- 172.21.15.57:0/2830358317 shutdown_connections 2023-10-16T19:41:18.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.652+0000 7f262171a640 1 -- 172.21.15.57:0/2830358317 wait complete. 2023-10-16T19:41:18.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.654+0000 7f262171a640 1 Processor -- start 2023-10-16T19:41:18.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.654+0000 7f262171a640 1 -- start start 2023-10-16T19:41:18.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f262171a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f262171a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c15d890 0x7f261c15fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f262171a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f261c15dcb0 0x7f261c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f262171a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c3b30 con 0x7f261c1575c0 2023-10-16T19:41:18.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f262171a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c4410 con 0x7f261c15d890 2023-10-16T19:41:18.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f262171a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c14c9b0 con 0x7f261c15dcb0 2023-10-16T19:41:18.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f5ed8db6640 1 -- 172.21.15.57:0/51911951 >> v1:172.21.15.110:6789/0 conn(0x7f5ed41599e0 legacy=0x7f5ed40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f5ed8db6640 1 -- 172.21.15.57:0/51911951 >> v1:172.21.15.57:6789/0 conn(0x7f5ed40ca1e0 legacy=0x7f5ed40ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.655+0000 7f5ed8db6640 1 -- 172.21.15.57:0/51911951 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed415cad0 con 0x7f5ed41531a0 2023-10-16T19:41:18.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.658+0000 7fa0cbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc14c980 0x7fa0cc14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.658+0000 7fa0cbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc14c980 0x7fa0cc14b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56374/0 (socket says 172.21.15.57:56374) 2023-10-16T19:41:18.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.658+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2352157757 learned_addr learned my addr 172.21.15.57:0/2352157757 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.660+0000 7fa0cb7fe640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0cc0c5c20 0x7fa0cc0ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.661+0000 7fdf59ffb640 1 -- 172.21.15.57:0/1079486885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c02cc60 con 0x7fdf5c14efb0 2023-10-16T19:41:18.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.661+0000 7fdf59ffb640 1 -- 172.21.15.57:0/1079486885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c02cdc0 con 0x7fdf5c14efb0 2023-10-16T19:41:18.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.661+0000 7fdf59ffb640 1 -- 172.21.15.57:0/1079486885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c034660 con 0x7fdf5c14efb0 2023-10-16T19:41:18.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.662+0000 7fdf5bfff640 1 -- 172.21.15.57:0/1079486885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c14efb0 msgr2=0x7fdf5c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.662+0000 7fdf5bfff640 1 --2- 172.21.15.57:0/1079486885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c14efb0 0x7fdf5c06fc00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009d90 tx=0x7fdf4c02beb0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95140052d0 con 0x7f95240c5cd0 2023-10-16T19:41:18.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9514005430 con 0x7f95240c5cd0 2023-10-16T19:41:18.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514003830 con 0x7f95240c5cd0 2023-10-16T19:41:18.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7fdf5bfff640 1 -- 172.21.15.57:0/1079486885 shutdown_connections 2023-10-16T19:41:18.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7fdf5bfff640 1 --2- 172.21.15.57:0/1079486885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c14efb0 0x7fdf5c06fc00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7fdf5bfff640 1 -- 172.21.15.57:0/1079486885 >> 172.21.15.57:0/1079486885 conn(0x7fdf5c0c6f00 msgr2=0x7fdf5c0c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952413e790 con 0x7f95240c5cd0 2023-10-16T19:41:18.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7fdf5bfff640 1 -- 172.21.15.57:0/1079486885 shutdown_connections 2023-10-16T19:41:18.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952415e5f0 con 0x7f95240c5cd0 2023-10-16T19:41:18.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.664+0000 7fdf5bfff640 1 -- 172.21.15.57:0/1079486885 wait complete. 2023-10-16T19:41:18.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.665+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2352157757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0cc0c5c20 msgr2=0x7fa0cc0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.665+0000 7fa0cbfff640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0cc0c5c20 0x7fa0cc0ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.665+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2352157757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0cc153180 msgr2=0x7fa0cc14ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.665+0000 7fa0cbfff640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0cc153180 0x7fa0cc14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.665+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2352157757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4009400 con 0x7fa0cc14c980 2023-10-16T19:41:18.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.665+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95240c4f10 con 0x7f95240c5cd0 2023-10-16T19:41:18.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.666+0000 7fdf5bfff640 1 Processor -- start 2023-10-16T19:41:18.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.666+0000 7fdf5bfff640 1 -- start start 2023-10-16T19:41:18.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.667+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c0c67c0 0x7fdf5c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.667+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf5c0c7a20 0x7fdf5c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.667+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf5c14efb0 0x7fdf5c0c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.667+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c1f25a0 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.667+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c157370 con 0x7fdf5c0c7a20 2023-10-16T19:41:18.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.667+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c157ac0 con 0x7fdf5c14efb0 2023-10-16T19:41:18.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.668+0000 7fa0cbfff640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc14c980 0x7fa0cc14b2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0b402b910 tx=0x7fa0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.670+0000 7f2620f19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f261c15dcb0 0x7f261c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.671+0000 7f5551271640 1 -- 172.21.15.57:0/1783538919 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c031870 con 0x7f554c0c12f0 2023-10-16T19:41:18.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.671+0000 7f5551271640 1 -- 172.21.15.57:0/1783538919 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0319d0 con 0x7f554c0c12f0 2023-10-16T19:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.671+0000 7f5551271640 1 -- 172.21.15.57:0/1783538919 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c031d60 con 0x7f554c0c12f0 2023-10-16T19:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.671+0000 7f55544d7640 1 -- 172.21.15.57:0/1783538919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c0c12f0 msgr2=0x7f554c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.671+0000 7f55544d7640 1 --2- 172.21.15.57:0/1783538919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c0c12f0 0x7f554c06d5d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f554c0c1710 tx=0x7f553c02b910 comp rx=0 tx=0).stop 2023-10-16T19:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.672+0000 7f55544d7640 1 -- 172.21.15.57:0/1783538919 shutdown_connections 2023-10-16T19:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.672+0000 7f55544d7640 1 --2- 172.21.15.57:0/1783538919 >> v2:172.21.15.110:3300/0 conn(0x7f554c0c2c70 0x7f554c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.672+0000 7f55544d7640 1 --2- 172.21.15.57:0/1783538919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c0c12f0 0x7f554c06d5d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.672+0000 7f55544d7640 1 -- 172.21.15.57:0/1783538919 >> 172.21.15.57:0/1783538919 conn(0x7f554c06c430 msgr2=0x7f554c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.672+0000 7f55544d7640 1 -- 172.21.15.57:0/1783538919 shutdown_connections 2023-10-16T19:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.672+0000 7f55544d7640 1 -- 172.21.15.57:0/1783538919 wait complete. 2023-10-16T19:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.674+0000 7f55544d7640 1 Processor -- start 2023-10-16T19:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.674+0000 7f55544d7640 1 -- start start 2023-10-16T19:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.674+0000 7f5ed8db6640 1 --2- 172.21.15.57:0/51911951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 0x7f5ed40c92a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009870 tx=0x7f5ec802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c6a71b5cf1d710 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.675+0000 7f55544d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c0c12f0 0x7f554c1ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.675+0000 7f55544d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f554c0c2c70 0x7f554c1f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.675+0000 7f55544d7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c151190 0x7f554c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.675+0000 7f55544d7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1f1870 con 0x7f554c151190 2023-10-16T19:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.675+0000 7f55544d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c14c060 con 0x7f554c0c12f0 2023-10-16T19:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.675+0000 7f55544d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c14c340 con 0x7f554c0c2c70 2023-10-16T19:41:18.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.676+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60014640 con 0x7f6a68069de0 2023-10-16T19:41:18.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.676+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a600147c0 con 0x7f6a68069de0 2023-10-16T19:41:18.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.676+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60014b70 con 0x7f6a68069de0 2023-10-16T19:41:18.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.676+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a681f64a0 con 0x7f6a68069de0 2023-10-16T19:41:18.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.676+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a681f6a60 con 0x7f6a68069de0 2023-10-16T19:41:18.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.677+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a68155710 con 0x7f6a68069de0 2023-10-16T19:41:18.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.678+0000 7f2620f19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f261c15dcb0 0x7f261c147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:38902/0 (socket says 172.21.15.57:38902) 2023-10-16T19:41:18.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.678+0000 7f2620f19640 1 -- 172.21.15.57:0/1573071399 learned_addr learned my addr 172.21.15.57:0/1573071399 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.682+0000 7fdf5affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c0c67c0 0x7fdf5c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.682+0000 7f261bfff640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.683+0000 7fdf5affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c0c67c0 0x7fdf5c1583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56398/0 (socket says 172.21.15.57:56398) 2023-10-16T19:41:18.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.683+0000 7fdf5affd640 1 -- 172.21.15.57:0/24375615 learned_addr learned my addr 172.21.15.57:0/24375615 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.689+0000 7f261bfff640 1 -- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f261c15dcb0 msgr2=0x7f261c147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.689+0000 7f261bfff640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f261c15dcb0 0x7f261c147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.689+0000 7f261bfff640 1 -- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c15d890 msgr2=0x7f261c15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.689+0000 7f261bfff640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c15d890 0x7f261c15fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.689+0000 7f261bfff640 1 -- 172.21.15.57:0/1573071399 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094d0 con 0x7f261c1575c0 2023-10-16T19:41:18.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.692+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b403a9e0 con 0x7fa0cc14c980 2023-10-16T19:41:18.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.692+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b403ab60 con 0x7fa0cc14c980 2023-10-16T19:41:18.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.692+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40443f0 con 0x7fa0cc14c980 2023-10-16T19:41:18.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.692+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2352157757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc1587d0 con 0x7fa0cc14c980 2023-10-16T19:41:18.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.692+0000 7fa0d0e9e640 1 -- 172.21.15.57:0/2352157757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc156cd0 con 0x7fa0cc14c980 2023-10-16T19:41:18.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.693+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0cc159560 con 0x7fa0cc14c980 2023-10-16T19:41:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.694+0000 7fdf5affd640 1 -- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf5c14efb0 msgr2=0x7fdf5c0c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.695+0000 7fdf5affd640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf5c14efb0 0x7fdf5c0c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.695+0000 7fdf5affd640 1 -- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf5c0c7a20 msgr2=0x7fdf5c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.695+0000 7fdf5affd640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf5c0c7a20 0x7fdf5c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.695+0000 7fdf5affd640 1 -- 172.21.15.57:0/24375615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009a70 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f261bfff640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c14d720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f260c033000 tx=0x7f260c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064155688 0 0) 0x7f17c0003520 con 0x7f17d40c4ba0 2023-10-16T19:41:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 >> v2:172.21.15.110:3300/0 conn(0x7f17d40ca900 msgr2=0x7f17d406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 --2- 172.21.15.57:0/2189368531 >> v2:172.21.15.110:3300/0 conn(0x7f17d40ca900 0x7f17d406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 >> v1:172.21.15.110:6789/0 conn(0x7f17d4153170 legacy=0x7f17d4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4153550 con 0x7f17d40c4ba0 2023-10-16T19:41:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f17c4001670 con 0x7f17d40c4ba0 2023-10-16T19:41:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 >> v1:172.21.15.57:6789/0 conn(0x7f17d40c4ba0 legacy=0x7f17d40c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c00047c0 0x7f17c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17c00052a0 0x7f17c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c9260 con 0x7f17c00039c0 2023-10-16T19:41:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c000c1f0 con 0x7f17c00047c0 2023-10-16T19:41:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.698+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c000c3b0 con 0x7f17c00052a0 2023-10-16T19:41:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.701+0000 7fdf5affd640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c0c67c0 0x7fdf5c1583a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009d90 tx=0x7fdf4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.701+0000 7f5ed37fe640 1 -- 172.21.15.57:0/51911951 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8030860 con 0x7f5ed41531a0 2023-10-16T19:41:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.701+0000 7f5ed37fe640 1 -- 172.21.15.57:0/51911951 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec80309c0 con 0x7f5ed41531a0 2023-10-16T19:41:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.701+0000 7f5ed37fe640 1 -- 172.21.15.57:0/51911951 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8030d50 con 0x7f5ed41531a0 2023-10-16T19:41:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 -- 172.21.15.57:0/51911951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 msgr2=0x7f5ed40c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 --2- 172.21.15.57:0/51911951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 0x7f5ed40c92a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009870 tx=0x7f5ec802b9a0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 -- 172.21.15.57:0/51911951 shutdown_connections 2023-10-16T19:41:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 --2- 172.21.15.57:0/51911951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 0x7f5ed40c92a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 -- 172.21.15.57:0/51911951 >> 172.21.15.57:0/51911951 conn(0x7f5ed4071510 msgr2=0x7f5ed40659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 -- 172.21.15.57:0/51911951 shutdown_connections 2023-10-16T19:41:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.702+0000 7f5edb01a640 1 -- 172.21.15.57:0/51911951 wait complete. 2023-10-16T19:41:18.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.704+0000 7f5edb01a640 1 Processor -- start 2023-10-16T19:41:18.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.704+0000 7f5edb01a640 1 -- start start 2023-10-16T19:41:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5552a74640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c151190 0x7f554c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5edb01a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40ca1e0 0x7f5ed414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5edb01a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 0x7f5ed414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5edb01a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ed41599e0 0x7f5ed4149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5edb01a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40c8c10 con 0x7f5ed41531a0 2023-10-16T19:41:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5edb01a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40c8400 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.705+0000 7f5edb01a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414b4c0 con 0x7f5ed41599e0 2023-10-16T19:41:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.708+0000 7f17d259c640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.708+0000 7f5552a74640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c151190 0x7f554c14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56402/0 (socket says 172.21.15.57:56402) 2023-10-16T19:41:18.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.708+0000 7f5552a74640 1 -- 172.21.15.57:0/2061373332 learned_addr learned my addr 172.21.15.57:0/2061373332 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.720+0000 7f5552a74640 1 -- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f554c0c2c70 msgr2=0x7f554c1f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.720+0000 7f5552a74640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f554c0c2c70 0x7f554c1f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.720+0000 7f5552a74640 1 -- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c0c12f0 msgr2=0x7f554c1ebb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.720+0000 7f5552a74640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c0c12f0 0x7f554c1ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.720+0000 7f5552a74640 1 -- 172.21.15.57:0/2061373332 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0094d0 con 0x7f554c151190 2023-10-16T19:41:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.737+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa0b4044550 con 0x7fa0cc14c980 2023-10-16T19:41:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.737+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c039e20 con 0x7f261c1575c0 2023-10-16T19:41:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.737+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c043400 con 0x7f261c1575c0 2023-10-16T19:41:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.737+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0437b0 con 0x7f261c1575c0 2023-10-16T19:41:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.737+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c0c3140 con 0x7f261c1575c0 2023-10-16T19:41:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.737+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c14c080 con 0x7f261c1575c0 2023-10-16T19:41:18.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.738+0000 7fa0c3fff640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa0ac06aec0 0x7fa0ac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.738+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f261c1614e0 con 0x7f261c1575c0 2023-10-16T19:41:18.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.738+0000 7fa0cb7fe640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa0ac06aec0 0x7fa0ac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.739+0000 7fa0cb7fe640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa0ac06aec0 0x7fa0ac06d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009f20 tx=0x7fa0c40094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.739+0000 7f5ed8db6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40ca1e0 0x7f5ed414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.745+0000 7f17d259c640 1 -- 172.21.15.57:0/2189368531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17c00052a0 msgr2=0x7f17c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.745+0000 7f17d259c640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17c00052a0 0x7f17c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.745+0000 7f17d259c640 1 -- 172.21.15.57:0/2189368531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c00047c0 msgr2=0x7f17c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.745+0000 7f17d259c640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c00047c0 0x7f17c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.745+0000 7f17d259c640 1 -- 172.21.15.57:0/2189368531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0003520 con 0x7f17c00039c0 2023-10-16T19:41:18.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.745+0000 7f17d2d9d640 1 -- 172.21.15.57:0/2189368531 reap_dead start 2023-10-16T19:41:18.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.746+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0b407ba00 con 0x7fa0cc14c980 2023-10-16T19:41:18.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.747+0000 7fa0c3fff640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fa0ac073060 0x7fa0ac075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.747+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 --> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0ac075b30 con 0x7fa0ac073060 2023-10-16T19:41:18.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.747+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b4077680 con 0x7fa0cc14c980 2023-10-16T19:41:18.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.747+0000 7fa0caffd640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fa0ac073060 0x7fa0ac075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.747+0000 7fa0caffd640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fa0ac073060 0x7fa0ac075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.748+0000 7f5ed8db6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40ca1e0 0x7f5ed414c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52404/0 (socket says 172.21.15.57:52404) 2023-10-16T19:41:18.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.748+0000 7f5ed8db6640 1 -- 172.21.15.57:0/1515097945 learned_addr learned my addr 172.21.15.57:0/1515097945 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.748+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== osd.0 v2:172.21.15.57:6818/314169635 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa0ac075b30 con 0x7fa0ac073060 2023-10-16T19:41:18.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.749+0000 7f5552a74640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c151190 0x7f554c14d670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f554400cd70 tx=0x7f554400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.750+0000 7f17d259c640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17c0003dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001620 tx=0x7f17c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14304f828ea9aa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.760+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6a60002020 con 0x7f6a68069de0 2023-10-16T19:41:18.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.761+0000 7f5ed8db6640 1 -- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ed41599e0 msgr2=0x7f5ed4149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.761+0000 7f5ed8db6640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ed41599e0 0x7f5ed4149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.761+0000 7f5ed8db6640 1 -- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 msgr2=0x7f5ed414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.761+0000 7f5ed8db6640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed41531a0 0x7f5ed414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.761+0000 7f5ed8db6640 1 -- 172.21.15.57:0/1515097945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80094d0 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.761+0000 7f6a5effd640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6a4c06aec0 0x7f6a4c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.762+0000 7f6a6db2b640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6a4c06aec0 0x7f6a4c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.762+0000 7f6a6db2b640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6a4c06aec0 0x7f6a4c06d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a6814c920 tx=0x7f6a58007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.771+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 --> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0cc159280 con 0x7fa0ac073060 2023-10-16T19:41:18.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.771+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c03e610 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.771+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c03e770 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.771+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c03eb00 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.771+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c157da0 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.771+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c157650 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.772+0000 7fa0c3fff640 1 -- 172.21.15.57:0/2352157757 <== osd.0 v2:172.21.15.57:6818/314169635 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0bc001210 con 0x7fa0ac073060 2023-10-16T19:41:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.772+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf5c157c30 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.772+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fa0ac073060 msgr2=0x7fa0ac075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.772+0000 7fa0c1ffb640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fa0ac073060 0x7fa0ac075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa0ac06aec0 msgr2=0x7fa0ac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa0ac06aec0 0x7fa0ac06d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009f20 tx=0x7fa0c40094f0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc14c980 msgr2=0x7fa0cc14b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 --2- 172.21.15.57:0/2352157757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc14c980 0x7fa0cc14b2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0b402b910 tx=0x7fa0b40046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0cbfff640 1 -- 172.21.15.57:0/2352157757 reap_dead start 2023-10-16T19:41:18.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 shutdown_connections 2023-10-16T19:41:18.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 >> 172.21.15.57:0/2352157757 conn(0x7fa0cc06c760 msgr2=0x7fa0cc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a60059740 con 0x7f6a68069de0 2023-10-16T19:41:18.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 shutdown_connections 2023-10-16T19:41:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7fa0c1ffb640 1 -- 172.21.15.57:0/2352157757 wait complete. 2023-10-16T19:41:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7f6a5effd640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7f6a4c073060 0x7f6a4c075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.773+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 --> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a4c075b30 con 0x7f6a4c073060 2023-10-16T19:41:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.774+0000 7f6a6eb2d640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7f6a4c073060 0x7f6a4c075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.774+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a600097f0 con 0x7f6a68069de0 2023-10-16T19:41:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.774+0000 7f6a6eb2d640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7f6a4c073060 0x7f6a4c075480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.775+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== osd.1 v2:172.21.15.57:6802/1525227707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6a4c075b30 con 0x7f6a4c073060 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.776+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005070 con 0x7f17c00039c0 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.776+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc02e070 con 0x7f17c00039c0 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.776+0000 7f17d1d9b640 1 -- 172.21.15.57:0/2189368531 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005430 con 0x7f17c00039c0 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 -- 172.21.15.57:0/2189368531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 msgr2=0x7f17c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17c0003dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001620 tx=0x7f17c00057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 -- 172.21.15.57:0/2189368531 shutdown_connections 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 --2- 172.21.15.57:0/2189368531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17c0003dc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 -- 172.21.15.57:0/2189368531 >> 172.21.15.57:0/2189368531 conn(0x7f17d4071720 msgr2=0x7f17d406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 -- 172.21.15.57:0/2189368531 shutdown_connections 2023-10-16T19:41:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.777+0000 7f17d8b18640 1 -- 172.21.15.57:0/2189368531 wait complete. 2023-10-16T19:41:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.778+0000 7f5ed8db6640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40ca1e0 0x7f5ed414c480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8000c00 tx=0x7f5ec8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.779+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544003b90 con 0x7f554c151190 2023-10-16T19:41:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.779+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544003cf0 con 0x7f554c151190 2023-10-16T19:41:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.779+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544004240 con 0x7f554c151190 2023-10-16T19:41:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.779+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c1f1220 con 0x7f554c151190 2023-10-16T19:41:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.779+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c0c0d00 con 0x7f554c151190 2023-10-16T19:41:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.780+0000 7f17d8b18640 1 Processor -- start 2023-10-16T19:41:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.780+0000 7f17d8b18640 1 -- start start 2023-10-16T19:41:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.780+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f554c0c4f90 con 0x7f554c151190 2023-10-16T19:41:18.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.782+0000 7f17d8b18640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17d4147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.782+0000 7f17d8b18640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d414eba0 0x7f17d4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.782+0000 7f17d8b18640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17d41f6540 0x7f17d41543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.782+0000 7f17d8b18640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4153730 con 0x7f17c00039c0 2023-10-16T19:41:18.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.782+0000 7f17d8b18640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4153a10 con 0x7f17d414eba0 2023-10-16T19:41:18.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.782+0000 7f17d8b18640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d41f6a30 con 0x7f17d41f6540 2023-10-16T19:41:18.794 INFO:teuthology.orchestra.run.smithi057.stdout:64424509452 2023-10-16T19:41:18.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T19:41:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.794+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 --> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a680bf1d0 con 0x7f6a4c073060 2023-10-16T19:41:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a5effd640 1 -- 172.21.15.57:0/797358756 <== osd.1 v2:172.21.15.57:6802/1525227707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a64030410 con 0x7f6a4c073060 2023-10-16T19:41:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7f6a4c073060 msgr2=0x7f6a4c075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7f6a4c073060 0x7f6a4c075480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6a4c06aec0 msgr2=0x7f6a4c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6a4c06aec0 0x7f6a4c06d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a6814c920 tx=0x7f6a58007930 comp rx=0 tx=0).stop 2023-10-16T19:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a68069de0 msgr2=0x7f6a681e05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 --2- 172.21.15.57:0/797358756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6a68069de0 0x7f6a681e05d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000bd60 tx=0x7f6a60009ed0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a6eb2d640 1 -- 172.21.15.57:0/797358756 reap_dead start 2023-10-16T19:41:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 shutdown_connections 2023-10-16T19:41:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.795+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 >> 172.21.15.57:0/797358756 conn(0x7f6a6806da20 msgr2=0x7f6a68145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.796+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 shutdown_connections 2023-10-16T19:41:18.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.796+0000 7f6a70590640 1 -- 172.21.15.57:0/797358756 wait complete. 2023-10-16T19:41:18.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.797+0000 7f17c9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d414eba0 0x7f17d4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.798+0000 7f17c9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d414eba0 0x7f17d4153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52418/0 (socket says 172.21.15.57:52418) 2023-10-16T19:41:18.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.798+0000 7f17c9d9b640 1 -- 172.21.15.57:0/1484871310 learned_addr learned my addr 172.21.15.57:0/1484871310 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:18.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.800+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f260c043910 con 0x7f261c1575c0 2023-10-16T19:41:18.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.801+0000 7f2618ff9640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f260806aea0 0x7f260806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.802+0000 7f261b7fe640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f260806aea0 0x7f260806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.803+0000 7f261b7fe640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f260806aea0 0x7f260806d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f261c0c1250 tx=0x7f2610007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.803+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f260c03e070 con 0x7f261c1575c0 2023-10-16T19:41:18.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.804+0000 7f2618ff9640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7f2608073040 0x7f2608075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.804+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 --> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2608075b10 con 0x7f2608073040 2023-10-16T19:41:18.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.804+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f260c078100 con 0x7f261c1575c0 2023-10-16T19:41:18.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.804+0000 7f2620f19640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7f2608073040 0x7f2608075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.805+0000 7f2620f19640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7f2608073040 0x7f2608075460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.808+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== osd.4 v2:172.21.15.110:6800/1242957558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2608075b10 con 0x7f2608073040 2023-10-16T19:41:18.816 INFO:teuthology.orchestra.run.smithi057.stdout:60129542156 2023-10-16T19:41:18.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.817+0000 7f17c9d9b640 1 -- 172.21.15.57:0/1484871310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17d41f6540 msgr2=0x7f17d41543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.817+0000 7f17c9d9b640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17d41f6540 0x7f17d41543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.817+0000 7f17c9d9b640 1 -- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 msgr2=0x7f17d4147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.817+0000 7f17c9d9b640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00039c0 0x7f17d4147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.817+0000 7f17c9d9b640 1 -- 172.21.15.57:0/1484871310 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d41f6d10 con 0x7f17d414eba0 2023-10-16T19:41:18.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.830+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 --> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f261c0c6250 con 0x7f2608073040 2023-10-16T19:41:18.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f2618ff9640 1 -- 172.21.15.57:0/1573071399 <== osd.4 v2:172.21.15.110:6800/1242957558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f261400f040 con 0x7f2608073040 2023-10-16T19:41:18.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7f2608073040 msgr2=0x7f2608075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7f2608073040 0x7f2608075460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f260806aea0 msgr2=0x7f260806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f260806aea0 0x7f260806d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f261c0c1250 tx=0x7f2610007990 comp rx=0 tx=0).stop 2023-10-16T19:41:18.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 msgr2=0x7f261c14d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 --2- 172.21.15.57:0/1573071399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f261c1575c0 0x7f261c14d720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f260c033000 tx=0x7f260c004730 comp rx=0 tx=0).stop 2023-10-16T19:41:18.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f2620f19640 1 -- 172.21.15.57:0/1573071399 reap_dead start 2023-10-16T19:41:18.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 shutdown_connections 2023-10-16T19:41:18.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.831+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 >> 172.21.15.57:0/1573071399 conn(0x7f261c0c6f00 msgr2=0x7f261c06cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.832+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 shutdown_connections 2023-10-16T19:41:18.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.832+0000 7f262171a640 1 -- 172.21.15.57:0/1573071399 wait complete. 2023-10-16T19:41:18.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.832+0000 7f17c9d9b640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d414eba0 0x7f17d4153ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c790 tx=0x7f17c400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.838+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf4c03b050 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.839+0000 7fdf437fe640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdf4806aec0 0x7fdf4806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.840+0000 7fdf5a7fc640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdf4806aec0 0x7fdf4806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.841+0000 7fdf5a7fc640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdf4806aec0 0x7fdf4806d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c145850 tx=0x7fdf50007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.843+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf4c07bb30 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.844+0000 7fdf437fe640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fdf48073060 0x7fdf48075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.844+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 --> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf48075b30 con 0x7fdf48073060 2023-10-16T19:41:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.844+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf4c077770 con 0x7fdf5c0c67c0 2023-10-16T19:41:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.844+0000 7fdf5b7fe640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fdf48073060 0x7fdf48075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.846+0000 7fdf5b7fe640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fdf48073060 0x7fdf48075480 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.849+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== osd.7 v2:172.21.15.110:6811/3203439813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdf48075b30 con 0x7fdf48073060 2023-10-16T19:41:18.857 INFO:teuthology.orchestra.run.smithi057.stdout:60129542156 2023-10-16T19:41:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.853+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8030810 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.853+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec8039d90 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.853+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8043630 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.853+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed40c8650 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.854+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed414bf60 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T19:41:18.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.855+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ed415d090 con 0x7f5ed40ca1e0 2023-10-16T19:41:18.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.855+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400cea0 con 0x7f17d414eba0 2023-10-16T19:41:18.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.855+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c40074e0 con 0x7f17d414eba0 2023-10-16T19:41:18.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.856+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4004a20 con 0x7f17d414eba0 2023-10-16T19:41:18.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.856+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d41f6ff0 con 0x7f17d414eba0 2023-10-16T19:41:18.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.856+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d4147d60 con 0x7f17d414eba0 2023-10-16T19:41:18.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.857+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17d40c9750 con 0x7f17d414eba0 2023-10-16T19:41:18.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.866+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f55440043a0 con 0x7f554c151190 2023-10-16T19:41:18.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.867+0000 7f5542ffd640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f553006aec0 0x7f553006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.868+0000 7f5552273640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f553006aec0 0x7f553006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.869+0000 7f5552273640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f553006aec0 0x7f553006d380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5548001560 tx=0x7f5548007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.871+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9514003990 con 0x7f95240c5cd0 2023-10-16T19:41:18.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.872+0000 7f950bfff640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f951006aec0 0x7f951006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.872+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5544012070 con 0x7f554c151190 2023-10-16T19:41:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.873+0000 7f5542ffd640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7f5530073060 0x7f5530075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.873+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 --> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5530075b30 con 0x7f5530073060 2023-10-16T19:41:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.873+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5544055770 con 0x7f554c151190 2023-10-16T19:41:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.873+0000 7f95227fc640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f951006aec0 0x7f951006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.873+0000 7f5551a72640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7f5530073060 0x7f5530075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.875+0000 7f95227fc640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f951006aec0 0x7f951006d380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9518035000 tx=0x7f9518008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.875+0000 7f5551a72640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7f5530073060 0x7f5530075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.876+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 --> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf5c0c5740 con 0x7fdf48073060 2023-10-16T19:41:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.877+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== osd.6 v2:172.21.15.110:6816/492622180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5530075b30 con 0x7f5530073060 2023-10-16T19:41:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.878+0000 7fdf437fe640 1 -- 172.21.15.57:0/24375615 <== osd.7 v2:172.21.15.110:6811/3203439813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf540058b0 con 0x7fdf48073060 2023-10-16T19:41:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.878+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fdf48073060 msgr2=0x7fdf48075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.878+0000 7fdf5bfff640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fdf48073060 0x7fdf48075480 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.878+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9514058560 con 0x7f95240c5cd0 2023-10-16T19:41:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdf4806aec0 msgr2=0x7fdf4806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdf4806aec0 0x7fdf4806d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c145850 tx=0x7fdf50007990 comp rx=0 tx=0).stop 2023-10-16T19:41:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c0c67c0 msgr2=0x7fdf5c1583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 --2- 172.21.15.57:0/24375615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5c0c67c0 0x7fdf5c1583a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009d90 tx=0x7fdf4c004a40 comp rx=0 tx=0).stop 2023-10-16T19:41:18.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7f950bfff640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f9510073060 0x7f9510075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5b7fe640 1 -- 172.21.15.57:0/24375615 reap_dead start 2023-10-16T19:41:18.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 --> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9510075b30 con 0x7f9510073060 2023-10-16T19:41:18.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7f95237fe640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f9510073060 0x7f9510075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 shutdown_connections 2023-10-16T19:41:18.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 >> 172.21.15.57:0/24375615 conn(0x7fdf5c0c6f00 msgr2=0x7fdf5c14bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.879+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 shutdown_connections 2023-10-16T19:41:18.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.880+0000 7fdf5bfff640 1 -- 172.21.15.57:0/24375615 wait complete. 2023-10-16T19:41:18.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.880+0000 7f95237fe640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f9510073060 0x7f9510075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.882+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== osd.2 v2:172.21.15.57:6810/3626764387 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9510075b30 con 0x7f9510073060 2023-10-16T19:41:18.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.884+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9514001140 con 0x7f95240c5cd0 2023-10-16T19:41:18.907 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:18.907 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T19:41:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.904+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 --> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f554c15af20 con 0x7f5530073060 2023-10-16T19:41:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.906+0000 7f5542ffd640 1 -- 172.21.15.57:0/2061373332 <== osd.6 v2:172.21.15.110:6816/492622180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f553c031b40 con 0x7f5530073060 2023-10-16T19:41:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.906+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7f5530073060 msgr2=0x7f5530075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.906+0000 7f55544d7640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7f5530073060 0x7f5530075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.907+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f553006aec0 msgr2=0x7f553006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.907+0000 7f55544d7640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f553006aec0 0x7f553006d380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5548001560 tx=0x7f5548007990 comp rx=0 tx=0).stop 2023-10-16T19:41:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.907+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c151190 msgr2=0x7f554c14d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.907+0000 7f55544d7640 1 --2- 172.21.15.57:0/2061373332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f554c151190 0x7f554c14d670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f554400cd70 tx=0x7f554400a660 comp rx=0 tx=0).stop 2023-10-16T19:41:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.908+0000 7f5552a74640 1 -- 172.21.15.57:0/2061373332 reap_dead start 2023-10-16T19:41:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.908+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 shutdown_connections 2023-10-16T19:41:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.908+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 >> 172.21.15.57:0/2061373332 conn(0x7f554c06c430 msgr2=0x7f554c0bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.910+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 --> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9524161290 con 0x7f9510073060 2023-10-16T19:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.910+0000 7f950bfff640 1 -- 172.21.15.57:0/324578419 <== osd.2 v2:172.21.15.57:6810/3626764387 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9510075b30 con 0x7f9510073060 2023-10-16T19:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.911+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f9510073060 msgr2=0x7f9510075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.911+0000 7f9523fff640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f9510073060 0x7f9510075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.911+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f951006aec0 msgr2=0x7f951006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.911+0000 7f9523fff640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f951006aec0 0x7f951006d380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9518035000 tx=0x7f9518008030 comp rx=0 tx=0).stop 2023-10-16T19:41:18.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.911+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 msgr2=0x7f95240c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.911+0000 7f9523fff640 1 --2- 172.21.15.57:0/324578419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95240c5cd0 0x7f95240c9710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f951400c430 tx=0x7f951400c8f0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.912+0000 7f95237fe640 1 -- 172.21.15.57:0/324578419 reap_dead start 2023-10-16T19:41:18.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.912+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 shutdown_connections 2023-10-16T19:41:18.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.912+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 >> 172.21.15.57:0/324578419 conn(0x7f95240c6f00 msgr2=0x7f95241518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.912+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 shutdown_connections 2023-10-16T19:41:18.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.912+0000 7f9523fff640 1 -- 172.21.15.57:0/324578419 wait complete. 2023-10-16T19:41:18.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.909+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 shutdown_connections 2023-10-16T19:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:18.909+0000 7f55544d7640 1 -- 172.21.15.57:0/2061373332 wait complete. 2023-10-16T19:41:18.937 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:18.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T19:41:18.939 INFO:teuthology.orchestra.run.smithi057.stdout:64424509452 2023-10-16T19:41:18.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T19:41:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.039+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ec804c3b0 con 0x7f5ed40ca1e0 2023-10-16T19:41:19.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.040+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17c4004b80 con 0x7f17d414eba0 2023-10-16T19:41:19.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.042+0000 7f17cb7fe640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f17b406aec0 0x7f17b406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.042+0000 7f5ed17fa640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5eb806aec0 0x7f5eb806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.043+0000 7f17d259c640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f17b406aec0 0x7f17b406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.043+0000 7f5ed3fff640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5eb806aec0 0x7f5eb806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.044+0000 7f5ed3fff640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5eb806aec0 0x7f5eb806d380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4066410 tx=0x7f5ec0007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.045+0000 7f17d259c640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f17b406aec0 0x7f17b406d380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17bc033000 tx=0x7f17bc005000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.045+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17c4007650 con 0x7f17d414eba0 2023-10-16T19:41:19.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.045+0000 7f17cb7fe640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7f17b4073060 0x7f17b4075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.045+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 --> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17b4075b30 con 0x7f17b4073060 2023-10-16T19:41:19.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.046+0000 7f17d2d9d640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7f17b4073060 0x7f17b4075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.047+0000 7f17d2d9d640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7f17b4073060 0x7f17b4075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.049+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== osd.3 v2:172.21.15.57:6826/1613164107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f17b4075b30 con 0x7f17b4073060 2023-10-16T19:41:19.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.051+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ec807b9e0 con 0x7f5ed40ca1e0 2023-10-16T19:41:19.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.052+0000 7f5ed17fa640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7f5eb8073060 0x7f5eb8075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.052+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 --> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5eb8075b30 con 0x7f5eb8073060 2023-10-16T19:41:19.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.053+0000 7f5ed95b7640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7f5eb8073060 0x7f5eb8075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.059+0000 7f5ed95b7640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7f5eb8073060 0x7f5eb8075480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.062+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== osd.5 v2:172.21.15.110:6808/3573598804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5eb8075b30 con 0x7f5eb8073060 2023-10-16T19:41:19.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.066+0000 7f8fa29f5640 1 Processor -- start 2023-10-16T19:41:19.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.066+0000 7f8fa29f5640 1 -- start start 2023-10-16T19:41:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.068+0000 7f8fa29f5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f9c157310 0x7f8f9c071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.068+0000 7f8fa29f5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.069+0000 7f8fa29f5640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c15d420 con 0x7f8f9c06a320 2023-10-16T19:41:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.069+0000 7f8fa29f5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c15d6c0 con 0x7f8f9c157310 2023-10-16T19:41:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.069+0000 7f8fa29f5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c15e220 con 0x7f8f9c06fc00 2023-10-16T19:41:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.070+0000 7f8fa0f92640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8f9c06a320 0x7f8f9c160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51222/0 (socket says 172.21.15.57:51222) 2023-10-16T19:41:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.070+0000 7f8fa0f92640 1 -- 172.21.15.57:0/1539878679 learned_addr learned my addr 172.21.15.57:0/1539878679 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:19.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.076+0000 7f8f9b7fe640 1 --2- 172.21.15.57:0/1539878679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.077+0000 7f8f9affd640 1 -- 172.21.15.57:0/1539878679 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302556186 0 0) 0x7f8f9c15d420 con 0x7f8f9c06a320 2023-10-16T19:41:19.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.077+0000 7f8f9affd640 1 -- 172.21.15.57:0/1539878679 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f84003520 con 0x7f8f9c06a320 2023-10-16T19:41:19.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.082+0000 7f8f9b7fe640 1 -- 172.21.15.57:0/1539878679 >> v2:172.21.15.110:3300/0 conn(0x7f8f9c157310 msgr2=0x7f8f9c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.082+0000 7f8f9b7fe640 1 --2- 172.21.15.57:0/1539878679 >> v2:172.21.15.110:3300/0 conn(0x7f8f9c157310 0x7f8f9c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.082+0000 7f8f9b7fe640 1 -- 172.21.15.57:0/1539878679 >> v1:172.21.15.57:6789/0 conn(0x7f8f9c06a320 legacy=0x7f8f9c160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.082+0000 7f8f9b7fe640 1 -- 172.21.15.57:0/1539878679 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c15d980 con 0x7f8f9c06fc00 2023-10-16T19:41:19.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.087+0000 7f8f9b7fe640 1 --2- 172.21.15.57:0/1539878679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c069de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f900097a0 tx=0x7f8f9002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e580573703c60b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.090+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 --> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f17d40c9470 con 0x7f17b4073060 2023-10-16T19:41:19.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.091+0000 7f17cb7fe640 1 -- 172.21.15.57:0/1484871310 <== osd.3 v2:172.21.15.57:6826/1613164107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f17cc004100 con 0x7f17b4073060 2023-10-16T19:41:19.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.092+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7f17b4073060 msgr2=0x7f17b4075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.092+0000 7f17d8b18640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7f17b4073060 0x7f17b4075480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.094+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f17b406aec0 msgr2=0x7f17b406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.094+0000 7f17d8b18640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f17b406aec0 0x7f17b406d380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17bc033000 tx=0x7f17bc005000 comp rx=0 tx=0).stop 2023-10-16T19:41:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.094+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d414eba0 msgr2=0x7f17d4153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.094+0000 7f17d8b18640 1 --2- 172.21.15.57:0/1484871310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17d414eba0 0x7f17d4153ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c790 tx=0x7f17c400cc50 comp rx=0 tx=0).stop 2023-10-16T19:41:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.094+0000 7f17d2d9d640 1 -- 172.21.15.57:0/1484871310 reap_dead start 2023-10-16T19:41:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.095+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 shutdown_connections 2023-10-16T19:41:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.095+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 >> 172.21.15.57:0/1484871310 conn(0x7f17d4071720 msgr2=0x7f17d41590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.095+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 shutdown_connections 2023-10-16T19:41:19.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.096+0000 7f17d8b18640 1 -- 172.21.15.57:0/1484871310 wait complete. 2023-10-16T19:41:19.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.098+0000 7f8f9affd640 1 -- 172.21.15.57:0/1539878679 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90030840 con 0x7f8f9c06fc00 2023-10-16T19:41:19.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.098+0000 7f8f9affd640 1 -- 172.21.15.57:0/1539878679 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900309a0 con 0x7f8f9c06fc00 2023-10-16T19:41:19.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.099+0000 7f8fa29f5640 1 -- 172.21.15.57:0/1539878679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 msgr2=0x7f8f9c069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.099+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/1539878679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c069de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f900097a0 tx=0x7f8f9002b980 comp rx=0 tx=0).stop 2023-10-16T19:41:19.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.101+0000 7f8fa29f5640 1 -- 172.21.15.57:0/1539878679 shutdown_connections 2023-10-16T19:41:19.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.101+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/1539878679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c069de0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.101+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/1539878679 >> v2:172.21.15.110:3300/0 conn(0x7f8f9c157310 0x7f8f9c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.101+0000 7f8fa29f5640 1 -- 172.21.15.57:0/1539878679 >> 172.21.15.57:0/1539878679 conn(0x7f8f9c0cf6b0 msgr2=0x7f8f9c0cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.103+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 --> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ed415cdb0 con 0x7f5eb8073060 2023-10-16T19:41:19.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.103+0000 7f8fa29f5640 1 -- 172.21.15.57:0/1539878679 shutdown_connections 2023-10-16T19:41:19.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.103+0000 7f8fa29f5640 1 -- 172.21.15.57:0/1539878679 wait complete. 2023-10-16T19:41:19.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.104+0000 7f5ed17fa640 1 -- 172.21.15.57:0/1515097945 <== osd.5 v2:172.21.15.110:6808/3573598804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5eb8075b30 con 0x7f5eb8073060 2023-10-16T19:41:19.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7f5eb8073060 msgr2=0x7f5eb8075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7f5eb8073060 0x7f5eb8075480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5eb806aec0 msgr2=0x7f5eb806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5eb806aec0 0x7f5eb806d380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4066410 tx=0x7f5ec0007990 comp rx=0 tx=0).stop 2023-10-16T19:41:19.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40ca1e0 msgr2=0x7f5ed414c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 --2- 172.21.15.57:0/1515097945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40ca1e0 0x7f5ed414c480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8000c00 tx=0x7f5ec8004730 comp rx=0 tx=0).stop 2023-10-16T19:41:19.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5ed95b7640 1 -- 172.21.15.57:0/1515097945 reap_dead start 2023-10-16T19:41:19.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 shutdown_connections 2023-10-16T19:41:19.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.106+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 >> 172.21.15.57:0/1515097945 conn(0x7f5ed4071510 msgr2=0x7f5ed406ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.107+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 shutdown_connections 2023-10-16T19:41:19.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.107+0000 7f5edb01a640 1 -- 172.21.15.57:0/1515097945 wait complete. 2023-10-16T19:41:19.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.109+0000 7fe877426640 1 Processor -- start 2023-10-16T19:41:19.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.109+0000 7fe877426640 1 -- start start 2023-10-16T19:41:19.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.108+0000 7f8fa29f5640 1 Processor -- start 2023-10-16T19:41:19.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.111+0000 7f8fa29f5640 1 -- start start 2023-10-16T19:41:19.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7fe877426640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8700c4ba0 0x7fe8700c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7f8fa29f5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 0x7f8f9c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7f8fa29f5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c1fada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7f8fa29f5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c157310 0x7f8f9c1fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7f8fa29f5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0ce1a0 con 0x7f8f9c06a320 2023-10-16T19:41:19.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7f8fa29f5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c1fa970 con 0x7f8f9c157310 2023-10-16T19:41:19.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.114+0000 7f8fa29f5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c1600d0 con 0x7f8f9c06fc00 2023-10-16T19:41:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.115+0000 7fe877426640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8700c9a30 con 0x7fe870153170 2023-10-16T19:41:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.115+0000 7fe877426640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8700c4710 con 0x7fe8700ca900 2023-10-16T19:41:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.115+0000 7fe877426640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700c9260 con 0x7fe8700c4ba0 2023-10-16T19:41:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.115+0000 7fe8751c2640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe870153170 0x7fe870158dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51224/0 (socket says 172.21.15.57:51224) 2023-10-16T19:41:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.115+0000 7fe8751c2640 1 -- 172.21.15.57:0/551009817 learned_addr learned my addr 172.21.15.57:0/551009817 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:19.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.118+0000 7fe8749c1640 1 --2- 172.21.15.57:0/551009817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8700c4ba0 0x7fe8700c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.117+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 0x7f8f9c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.117+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 0x7f8f9c152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56448/0 (socket says 172.21.15.57:56448) 2023-10-16T19:41:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.117+0000 7f8f9bfff640 1 -- 172.21.15.57:0/258215968 learned_addr learned my addr 172.21.15.57:0/258215968 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.117+0000 7f8f9b7fe640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c1fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.125+0000 7fe8749c1640 1 -- 172.21.15.57:0/551009817 >> v1:172.21.15.110:6789/0 conn(0x7fe8700ca900 legacy=0x7fe87006b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.125+0000 7fe8749c1640 1 -- 172.21.15.57:0/551009817 >> v1:172.21.15.57:6789/0 conn(0x7fe870153170 legacy=0x7fe870158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.125+0000 7fe8749c1640 1 -- 172.21.15.57:0/551009817 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870153550 con 0x7fe8700c4ba0 2023-10-16T19:41:19.131 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:19.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T19:41:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.129+0000 7f8f9bfff640 1 -- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 msgr2=0x7f8f9c1fada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.129+0000 7f8f9bfff640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c1fada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.129+0000 7f8f9bfff640 1 -- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c157310 msgr2=0x7f8f9c1fb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.129+0000 7f8f9bfff640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c157310 0x7f8f9c1fb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.130+0000 7f8f9bfff640 1 -- 172.21.15.57:0/258215968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90009400 con 0x7f8f9c06a320 2023-10-16T19:41:19.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.136+0000 7f8f9bfff640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 0x7f8f9c152960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00b440 tx=0x7f8f8c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.142 INFO:teuthology.orchestra.run.smithi057.stdout:64424509452 2023-10-16T19:41:19.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T19:41:19.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.140+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c011890 con 0x7f8f9c06a320 2023-10-16T19:41:19.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.140+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0119f0 con 0x7f8f9c06a320 2023-10-16T19:41:19.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.141+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c011da0 con 0x7f8f9c06a320 2023-10-16T19:41:19.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.141+0000 7fe8749c1640 1 --2- 172.21.15.57:0/551009817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8700c4ba0 0x7fe8700c3a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0097d0 tx=0x7fe85c02b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7226d38cdf2c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.141+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c152ea0 con 0x7f8f9c06a320 2023-10-16T19:41:19.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.141+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c15b580 con 0x7f8f9c06a320 2023-10-16T19:41:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.142+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c005250 con 0x7f8f9c06a320 2023-10-16T19:41:19.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.163+0000 7fe86ffff640 1 -- 172.21.15.57:0/551009817 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c030710 con 0x7fe8700c4ba0 2023-10-16T19:41:19.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.163+0000 7fe86ffff640 1 -- 172.21.15.57:0/551009817 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c02e050 con 0x7fe8700c4ba0 2023-10-16T19:41:19.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.163+0000 7fe86ffff640 1 -- 172.21.15.57:0/551009817 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c030a90 con 0x7fe8700c4ba0 2023-10-16T19:41:19.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.167+0000 7fe877426640 1 -- 172.21.15.57:0/551009817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8700c4ba0 msgr2=0x7fe8700c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.167+0000 7fe877426640 1 --2- 172.21.15.57:0/551009817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8700c4ba0 0x7fe8700c3a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0097d0 tx=0x7fe85c02b6e0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.168+0000 7fe877426640 1 -- 172.21.15.57:0/551009817 shutdown_connections 2023-10-16T19:41:19.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.168+0000 7fe877426640 1 --2- 172.21.15.57:0/551009817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8700c4ba0 0x7fe8700c3a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.168+0000 7fe877426640 1 -- 172.21.15.57:0/551009817 >> 172.21.15.57:0/551009817 conn(0x7fe870071720 msgr2=0x7fe87006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.168+0000 7fe877426640 1 -- 172.21.15.57:0/551009817 shutdown_connections 2023-10-16T19:41:19.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.168+0000 7fe877426640 1 -- 172.21.15.57:0/551009817 wait complete. 2023-10-16T19:41:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.172+0000 7f784d6e5640 1 Processor -- start 2023-10-16T19:41:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.172+0000 7f784d6e5640 1 -- start start 2023-10-16T19:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.174+0000 7fe877426640 1 Processor -- start 2023-10-16T19:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.175+0000 7fe877426640 1 -- start start 2023-10-16T19:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.175+0000 7f784d6e5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f78400dac00 0x7f784004b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.175+0000 7f784d6e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f784004ba40 0x7f7840034740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.176+0000 7f784d6e5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7840006680 con 0x7f78400d4d80 2023-10-16T19:41:19.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.176+0000 7f784d6e5640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7840033e90 con 0x7f78400dac00 2023-10-16T19:41:19.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.176+0000 7f784d6e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78400db010 con 0x7f784004ba40 2023-10-16T19:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.177+0000 7fe877426640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8700c4ba0 0x7fe8701f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.178+0000 7fe877426640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8700ca900 0x7fe8701fee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.178+0000 7fe877426640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 0x7fe8701ff360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.178+0000 7fe877426640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701f9430 con 0x7fe8700c4ba0 2023-10-16T19:41:19.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.178+0000 7fe877426640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701ff9e0 con 0x7fe8700ca900 2023-10-16T19:41:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.178+0000 7fe877426640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870130020 con 0x7fe870153170 2023-10-16T19:41:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.180+0000 7fe8759c3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 0x7fe8701ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.181+0000 7fe8759c3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 0x7fe8701ff360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:38980/0 (socket says 172.21.15.57:38980) 2023-10-16T19:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.181+0000 7fe8759c3640 1 -- 172.21.15.57:0/3186956163 learned_addr learned my addr 172.21.15.57:0/3186956163 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.184+0000 7fe8749c1640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8700ca900 0x7fe8701fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.187+0000 7f78477fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f784004ba40 0x7f7840034740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.187+0000 7f7846ffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f78400d4d80 0x7f7840005ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:37218/0 (socket says 172.21.15.57:37218) 2023-10-16T19:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.187+0000 7f7846ffd640 1 -- 172.21.15.57:0/716949082 learned_addr learned my addr 172.21.15.57:0/716949082 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.191+0000 7fe8759c3640 1 -- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8700ca900 msgr2=0x7fe8701fee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.191+0000 7fe8759c3640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8700ca900 0x7fe8701fee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.191+0000 7fe8759c3640 1 -- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8700c4ba0 msgr2=0x7fe8701f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.191+0000 7fe8759c3640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8700c4ba0 0x7fe8701f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.192+0000 7fe8759c3640 1 -- 172.21.15.57:0/3186956163 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c009400 con 0x7fe870153170 2023-10-16T19:41:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.204+0000 7fe8759c3640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 0x7fe8701ff360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c390 tx=0x7fe86800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.205+0000 7f78477fe640 1 -- 172.21.15.57:0/716949082 >> v2:172.21.15.57:3300/0 conn(0x7f78400dac00 msgr2=0x7f784004b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.205+0000 7f78477fe640 1 --2- 172.21.15.57:0/716949082 >> v2:172.21.15.57:3300/0 conn(0x7f78400dac00 0x7f784004b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.205+0000 7f78477fe640 1 -- 172.21.15.57:0/716949082 >> v1:172.21.15.110:6789/0 conn(0x7f78400d4d80 legacy=0x7f7840005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.205+0000 7f78477fe640 1 -- 172.21.15.57:0/716949082 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840006920 con 0x7f784004ba40 2023-10-16T19:41:19.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.210+0000 7ff8c4210640 1 Processor -- start 2023-10-16T19:41:19.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.210+0000 7ff8c4210640 1 -- start start 2023-10-16T19:41:19.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.212+0000 7ff8c4210640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc153170 0x7ff8bc0c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.212+0000 7ff8c4210640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff8bc158dc0 0x7ff8bc0c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.213+0000 7ff8c4210640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0c9a30 con 0x7ff8bc0ca900 2023-10-16T19:41:19.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.213+0000 7ff8c4210640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0c9260 con 0x7ff8bc158dc0 2023-10-16T19:41:19.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.213+0000 7ff8c4210640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0c4710 con 0x7ff8bc153170 2023-10-16T19:41:19.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.215+0000 7f78477fe640 1 --2- 172.21.15.57:0/716949082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f784004ba40 0x7f7840034740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7848000b60 tx=0x7f78480a8270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90407d08b2dc555 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.216+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680035f0 con 0x7fe870153170 2023-10-16T19:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.216+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868003750 con 0x7fe870153170 2023-10-16T19:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.216+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868003b00 con 0x7fe870153170 2023-10-16T19:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.217+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8701e47a0 con 0x7fe870153170 2023-10-16T19:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.217+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87014d610 con 0x7fe870153170 2023-10-16T19:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.219+0000 7ff8c1fac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc153170 0x7ff8bc0c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.219+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe850005250 con 0x7fe870153170 2023-10-16T19:41:19.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.222+0000 7ff8c1fac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc153170 0x7ff8bc0c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:38990/0 (socket says 172.21.15.57:38990) 2023-10-16T19:41:19.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.222+0000 7ff8c1fac640 1 -- 172.21.15.57:0/2862190046 learned_addr learned my addr 172.21.15.57:0/2862190046 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.241+0000 7f7845ffb640 1 -- 172.21.15.57:0/716949082 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480b0640 con 0x7f784004ba40 2023-10-16T19:41:19.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.241+0000 7f7845ffb640 1 -- 172.21.15.57:0/716949082 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78480b07e0 con 0x7f784004ba40 2023-10-16T19:41:19.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.241+0000 7f7845ffb640 1 -- 172.21.15.57:0/716949082 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480b0c10 con 0x7f784004ba40 2023-10-16T19:41:19.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7ff8c17ab640 1 --2- 172.21.15.57:0/2862190046 >> v2:172.21.15.110:3300/0 conn(0x7ff8bc158dc0 0x7ff8bc0c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 -- 172.21.15.57:0/716949082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f784004ba40 msgr2=0x7f7840034740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 --2- 172.21.15.57:0/716949082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f784004ba40 0x7f7840034740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7848000b60 tx=0x7f78480a8270 comp rx=0 tx=0).stop 2023-10-16T19:41:19.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 -- 172.21.15.57:0/716949082 shutdown_connections 2023-10-16T19:41:19.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 --2- 172.21.15.57:0/716949082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f784004ba40 0x7f7840034740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 --2- 172.21.15.57:0/716949082 >> v2:172.21.15.57:3300/0 conn(0x7f78400dac00 0x7f784004b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 -- 172.21.15.57:0/716949082 >> 172.21.15.57:0/716949082 conn(0x7f78400501c0 msgr2=0x7f78400505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.242+0000 7f784d6e5640 1 -- 172.21.15.57:0/716949082 shutdown_connections 2023-10-16T19:41:19.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.243+0000 7f784d6e5640 1 -- 172.21.15.57:0/716949082 wait complete. 2023-10-16T19:41:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.245+0000 7f784d6e5640 1 Processor -- start 2023-10-16T19:41:19.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.246+0000 7f784d6e5640 1 -- start start 2023-10-16T19:41:19.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.248+0000 7f784d6e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784004ba40 0x7f78400d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.248+0000 7f784d6e5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78400d4d80 0x7f7840168540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.248+0000 7f784d6e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 0x7f7840035850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.249+0000 7f784d6e5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784017c7b0 con 0x7f78400d4d80 2023-10-16T19:41:19.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.249+0000 7f784d6e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400d9af0 con 0x7f78400dac00 2023-10-16T19:41:19.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.249+0000 7f784d6e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400d1cd0 con 0x7f784004ba40 2023-10-16T19:41:19.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.252+0000 7ff8c17ab640 1 -- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc153170 msgr2=0x7ff8bc0c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.252+0000 7ff8c17ab640 1 --2- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc153170 0x7ff8bc0c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.252+0000 7ff8c17ab640 1 -- 172.21.15.57:0/2862190046 >> v1:172.21.15.57:6789/0 conn(0x7ff8bc0ca900 legacy=0x7ff8bc06b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.252+0000 7ff8c17ab640 1 -- 172.21.15.57:0/2862190046 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc153550 con 0x7ff8bc158dc0 2023-10-16T19:41:19.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.257+0000 7f78477fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 0x7f7840035850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.258+0000 7ff8c17ab640 1 --2- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc158dc0 0x7ff8bc0c3a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0097a0 tx=0x7ff8ac02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d649af1da60fc88 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.260+0000 7f78477fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 0x7f7840035850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52490/0 (socket says 172.21.15.57:52490) 2023-10-16T19:41:19.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.260+0000 7f78477fe640 1 -- 172.21.15.57:0/3368137762 learned_addr learned my addr 172.21.15.57:0/3368137762 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.271+0000 7f3ab492c640 1 Processor -- start 2023-10-16T19:41:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.271+0000 7f3ab492c640 1 -- start start 2023-10-16T19:41:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.272+0000 7f3ab492c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ab01531a0 0x7f3ab00c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.272+0000 7f3ab492c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ab01599e0 0x7f3ab00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.272+0000 7f3ab492c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab015c5a0 con 0x7f3ab00cb870 2023-10-16T19:41:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.272+0000 7f3ab492c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab015d400 con 0x7f3ab01531a0 2023-10-16T19:41:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.272+0000 7f3ab492c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab015c7f0 con 0x7f3ab01599e0 2023-10-16T19:41:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.273+0000 7f78477fe640 1 -- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784004ba40 msgr2=0x7f78400d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.273+0000 7f78477fe640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784004ba40 0x7f78400d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.273+0000 7f78477fe640 1 -- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78400d4d80 msgr2=0x7f7840168540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.273+0000 7f78477fe640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78400d4d80 0x7f7840168540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.273+0000 7f78477fe640 1 -- 172.21.15.57:0/3368137762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400d9550 con 0x7f78400dac00 2023-10-16T19:41:19.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.275+0000 7ff8c0faa640 1 -- 172.21.15.57:0/2862190046 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac02e070 con 0x7ff8bc158dc0 2023-10-16T19:41:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.283+0000 7ff8c0faa640 1 -- 172.21.15.57:0/2862190046 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0315a0 con 0x7ff8bc158dc0 2023-10-16T19:41:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.283+0000 7ff8c0faa640 1 -- 172.21.15.57:0/2862190046 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac031930 con 0x7ff8bc158dc0 2023-10-16T19:41:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.284+0000 7ff8c4210640 1 -- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc158dc0 msgr2=0x7ff8bc0c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.284+0000 7ff8c4210640 1 --2- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc158dc0 0x7ff8bc0c3a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0097a0 tx=0x7ff8ac02b840 comp rx=0 tx=0).stop 2023-10-16T19:41:19.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.284+0000 7ff8c4210640 1 -- 172.21.15.57:0/2862190046 shutdown_connections 2023-10-16T19:41:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.284+0000 7ff8c4210640 1 --2- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc158dc0 0x7ff8bc0c3a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.284+0000 7ff8c4210640 1 --2- 172.21.15.57:0/2862190046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc153170 0x7ff8bc0c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.284+0000 7ff8c4210640 1 -- 172.21.15.57:0/2862190046 >> 172.21.15.57:0/2862190046 conn(0x7ff8bc071720 msgr2=0x7ff8bc06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.285+0000 7ff8c4210640 1 -- 172.21.15.57:0/2862190046 shutdown_connections 2023-10-16T19:41:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.285+0000 7ff8c4210640 1 -- 172.21.15.57:0/2862190046 wait complete. 2023-10-16T19:41:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.286+0000 7f0c7f17c640 1 Processor -- start 2023-10-16T19:41:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.286+0000 7f0c7f17c640 1 -- start start 2023-10-16T19:41:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.287+0000 7ff8c4210640 1 Processor -- start 2023-10-16T19:41:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7ff8c4210640 1 -- start start 2023-10-16T19:41:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7f0c7f17c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c78151190 0x7f0c780c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7f0c7f17c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c12f0 0x7f0c780c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7f0c7f17c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c78151570 con 0x7f0c7806d5d0 2023-10-16T19:41:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7f0c7f17c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780c4010 con 0x7f0c78151190 2023-10-16T19:41:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7f0c7f17c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c1ce0 con 0x7f0c780c12f0 2023-10-16T19:41:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.288+0000 7f78477fe640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 0x7f7840035850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7848074120 tx=0x7f7848068a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.289+0000 7ff8c4210640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8bc0ca900 0x7ff8bc0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.289+0000 7ff8c4210640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 0x7ff8bc1eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.289+0000 7ff8c4210640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc158dc0 0x7ff8bc1e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.289+0000 7ff8c4210640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1e4250 con 0x7ff8bc0ca900 2023-10-16T19:41:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.289+0000 7ff8c4210640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1e4b10 con 0x7ff8bc153170 2023-10-16T19:41:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.289+0000 7ff8c4210640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc14ec20 con 0x7ff8bc158dc0 2023-10-16T19:41:19.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.299+0000 7f3aadd9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ab01599e0 0x7f3ab00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.301+0000 7f3aadd9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ab01599e0 0x7f3ab00cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52504/0 (socket says 172.21.15.57:52504) 2023-10-16T19:41:19.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.301+0000 7f3aadd9b640 1 -- 172.21.15.57:0/3880636583 learned_addr learned my addr 172.21.15.57:0/3880636583 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.303+0000 7ff8c17ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 0x7ff8bc1eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.305+0000 7ff8c17ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 0x7ff8bc1eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52512/0 (socket says 172.21.15.57:52512) 2023-10-16T19:41:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.305+0000 7ff8c17ab640 1 -- 172.21.15.57:0/1201358450 learned_addr learned my addr 172.21.15.57:0/1201358450 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.310+0000 7f3aadd9b640 1 -- 172.21.15.57:0/3880636583 >> v2:172.21.15.57:3300/0 conn(0x7f3ab01531a0 msgr2=0x7f3ab00c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.310+0000 7f3aadd9b640 1 --2- 172.21.15.57:0/3880636583 >> v2:172.21.15.57:3300/0 conn(0x7f3ab01531a0 0x7f3ab00c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.310+0000 7f3aadd9b640 1 -- 172.21.15.57:0/3880636583 >> v1:172.21.15.57:6789/0 conn(0x7f3ab00cb870 legacy=0x7f3ab00ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.310+0000 7f3aadd9b640 1 -- 172.21.15.57:0/3880636583 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab015cad0 con 0x7f3ab01599e0 2023-10-16T19:41:19.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.321+0000 7ff8c17ab640 1 -- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc158dc0 msgr2=0x7ff8bc1e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.321+0000 7ff8c17ab640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc158dc0 0x7ff8bc1e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.321+0000 7ff8c17ab640 1 -- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8bc0ca900 msgr2=0x7ff8bc0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.321+0000 7ff8c17ab640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8bc0ca900 0x7ff8bc0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.321+0000 7ff8c17ab640 1 -- 172.21.15.57:0/1201358450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009400 con 0x7ff8bc153170 2023-10-16T19:41:19.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480afc20 con 0x7f78400dac00 2023-10-16T19:41:19.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78480afd80 con 0x7f78400dac00 2023-10-16T19:41:19.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480bb640 con 0x7f78400dac00 2023-10-16T19:41:19.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78400d9810 con 0x7f78400dac00 2023-10-16T19:41:19.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784017c3d0 con 0x7f78400dac00 2023-10-16T19:41:19.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f0c7d719640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0c7806d5d0 0x7f0c7806da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:37230/0 (socket says 172.21.15.57:37230) 2023-10-16T19:41:19.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.327+0000 7f0c7d719640 1 -- 172.21.15.57:0/2353333980 learned_addr learned my addr 172.21.15.57:0/2353333980 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:19.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.329+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784017c8f0 con 0x7f78400dac00 2023-10-16T19:41:19.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.339+0000 7ff8c17ab640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 0x7ff8bc1eebd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac034040 tx=0x7ff8ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.354+0000 7f8e44c97640 1 Processor -- start 2023-10-16T19:41:19.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.354+0000 7f8e44c97640 1 -- start start 2023-10-16T19:41:19.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.355+0000 7f8e44c97640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e400ca1e0 0x7f8e400ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.355+0000 7f8e44c97640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4015c5a0 con 0x7f8e400c92a0 2023-10-16T19:41:19.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.355+0000 7f8e44c97640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4015d400 con 0x7f8e401531a0 2023-10-16T19:41:19.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.355+0000 7f8e44c97640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400c96e0 con 0x7f8e400ca1e0 2023-10-16T19:41:19.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.359+0000 7fe1eb34c640 1 Processor -- start 2023-10-16T19:41:19.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.359+0000 7fe1eb34c640 1 -- start start 2023-10-16T19:41:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.360+0000 7fe1eb34c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1e40c4ba0 0x7fe1e40c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.360+0000 7fe1eb34c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40c9a30 con 0x7fe1e4153170 2023-10-16T19:41:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.360+0000 7fe1eb34c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40c4710 con 0x7fe1e40ca900 2023-10-16T19:41:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.360+0000 7fe1eb34c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c9260 con 0x7fe1e40c4ba0 2023-10-16T19:41:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.361+0000 7f0c777fe640 1 -- 172.21.15.57:0/2353333980 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556435676 0 0) 0x7f0c78151570 con 0x7f0c7806d5d0 2023-10-16T19:41:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.361+0000 7f0c777fe640 1 -- 172.21.15.57:0/2353333980 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c68003520 con 0x7f0c7806d5d0 2023-10-16T19:41:19.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.505+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f8c01a400 con 0x7f8f9c06a320 2023-10-16T19:41:19.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.507+0000 7f8f98ff9640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8f8806aec0 0x7f8f8806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.508+0000 7f8f9b7fe640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8f8806aec0 0x7f8f8806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.509+0000 7f8f9b7fe640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8f8806aec0 0x7f8f8806d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f90036000 tx=0x7f8f90030f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.546+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f8c059270 con 0x7f8f9c06a320 2023-10-16T19:41:19.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.547+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f8c054eb0 con 0x7f8f9c06a320 2023-10-16T19:41:19.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.568+0000 7f0c7cf18640 1 --2- 172.21.15.57:0/2353333980 >> v2:172.21.15.57:3300/0 conn(0x7f0c78151190 0x7f0c780c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.569+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe868003c60 con 0x7fe870153170 2023-10-16T19:41:19.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.570+0000 7fe86dffb640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe85406aec0 0x7fe85406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.571+0000 7fe8751c2640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe85406aec0 0x7fe85406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.572+0000 7fe8751c2640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe85406aec0 0x7fe85406d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe864007fd0 tx=0x7fe864007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.575+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe868057e20 con 0x7fe870153170 2023-10-16T19:41:19.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.581+0000 7f0c7cf18640 1 -- 172.21.15.57:0/2353333980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c12f0 msgr2=0x7f0c780c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.581+0000 7f0c7cf18640 1 --2- 172.21.15.57:0/2353333980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c12f0 0x7f0c780c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.581+0000 7f0c7cf18640 1 -- 172.21.15.57:0/2353333980 >> v1:172.21.15.110:6789/0 conn(0x7f0c7806d5d0 legacy=0x7f0c7806da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.581+0000 7f0c7cf18640 1 -- 172.21.15.57:0/2353333980 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780c5530 con 0x7f0c78151190 2023-10-16T19:41:19.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.588+0000 7f0c7cf18640 1 --2- 172.21.15.57:0/2353333980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c78151190 0x7f0c780c2560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c780c4150 tx=0x7f0c6c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ceeb398e2e99155 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.592+0000 7fe1e90e8640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe1e4153170 0x7fe1e4158dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51256/0 (socket says 172.21.15.57:51256) 2023-10-16T19:41:19.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.592+0000 7fe1e90e8640 1 -- 172.21.15.57:0/1204180046 learned_addr learned my addr 172.21.15.57:0/1204180046 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:19.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.593+0000 7f8e3dd9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8e400c92a0 0x7f8e400cb330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51254/0 (socket says 172.21.15.57:51254) 2023-10-16T19:41:19.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.593+0000 7f8e3dd9b640 1 -- 172.21.15.57:0/930718500 learned_addr learned my addr 172.21.15.57:0/930718500 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:19.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.605+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe868054160 con 0x7fe870153170 2023-10-16T19:41:19.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.614+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555224244 0 0) 0x7fe1e40c9a30 con 0x7fe1e4153170 2023-10-16T19:41:19.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.614+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d0003520 con 0x7fe1e4153170 2023-10-16T19:41:19.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.627+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361982841 0 0) 0x7f8e4015c5a0 con 0x7f8e400c92a0 2023-10-16T19:41:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.627+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e28003520 con 0x7f8e400c92a0 2023-10-16T19:41:19.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.628+0000 7f0c777fe640 1 -- 172.21.15.57:0/2353333980 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c02d040 con 0x7f0c78151190 2023-10-16T19:41:19.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.628+0000 7f0c777fe640 1 -- 172.21.15.57:0/2353333980 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c031810 con 0x7f0c78151190 2023-10-16T19:41:19.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.628+0000 7f0c777fe640 1 -- 172.21.15.57:0/2353333980 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031ba0 con 0x7f0c78151190 2023-10-16T19:41:19.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 -- 172.21.15.57:0/2353333980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c78151190 msgr2=0x7f0c780c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/2353333980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c78151190 0x7f0c780c2560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c780c4150 tx=0x7f0c6c02b8b0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 -- 172.21.15.57:0/2353333980 shutdown_connections 2023-10-16T19:41:19.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/2353333980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c12f0 0x7f0c780c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/2353333980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c78151190 0x7f0c780c2560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 -- 172.21.15.57:0/2353333980 >> 172.21.15.57:0/2353333980 conn(0x7f0c7806c430 msgr2=0x7f0c78069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 -- 172.21.15.57:0/2353333980 shutdown_connections 2023-10-16T19:41:19.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.629+0000 7f0c7f17c640 1 -- 172.21.15.57:0/2353333980 wait complete. 2023-10-16T19:41:19.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.631+0000 7f0c7f17c640 1 Processor -- start 2023-10-16T19:41:19.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.632+0000 7f0c7f17c640 1 -- start start 2023-10-16T19:41:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.633+0000 7f0c7f17c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7806d5d0 0x7f0c780bc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.633+0000 7f0c7f17c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780c12f0 0x7f0c781558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.633+0000 7f0c7f17c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 0x7f0c781ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.633+0000 7f0c7f17c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78157570 con 0x7f0c7806d5d0 2023-10-16T19:41:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.633+0000 7f0c7f17c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780ca160 con 0x7f0c780c12f0 2023-10-16T19:41:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.633+0000 7f0c7f17c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780ca440 con 0x7f0c78151190 2023-10-16T19:41:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.635+0000 7f0c7d719640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 0x7f0c781ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7f0c7d719640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 0x7f0c781ee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39022/0 (socket says 172.21.15.57:39022) 2023-10-16T19:41:19.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7f0c7d719640 1 -- 172.21.15.57:0/1838976259 learned_addr learned my addr 172.21.15.57:0/1838976259 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194187469 0 0) 0x7fe1d0003520 con 0x7fe1e4153170 2023-10-16T19:41:19.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 >> v2:172.21.15.110:3300/0 conn(0x7fe1e40c4ba0 msgr2=0x7fe1e40c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 --2- 172.21.15.57:0/1204180046 >> v2:172.21.15.110:3300/0 conn(0x7fe1e40c4ba0 0x7fe1e40c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 >> v1:172.21.15.110:6789/0 conn(0x7fe1e40ca900 legacy=0x7fe1e406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4153550 con 0x7fe1e4153170 2023-10-16T19:41:19.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7fe1e0001670 con 0x7fe1e4153170 2023-10-16T19:41:19.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 >> v1:172.21.15.57:6789/0 conn(0x7fe1e4153170 legacy=0x7fe1e4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d0003970 0x7fe1d0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d00047c0 0x7fe1d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d00052a0 0x7fe1d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c9260 con 0x7fe1d00052a0 2023-10-16T19:41:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d000c1a0 con 0x7fe1d0003970 2023-10-16T19:41:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.636+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d000c360 con 0x7fe1d00047c0 2023-10-16T19:41:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108075336 0 0) 0x7f8e28003520 con 0x7f8e400c92a0 2023-10-16T19:41:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 >> v2:172.21.15.110:3300/0 conn(0x7f8e400ca1e0 msgr2=0x7f8e400ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 --2- 172.21.15.57:0/930718500 >> v2:172.21.15.110:3300/0 conn(0x7f8e400ca1e0 0x7f8e400ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 >> v1:172.21.15.110:6789/0 conn(0x7f8e401531a0 legacy=0x7f8e401599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400cab90 con 0x7f8e400c92a0 2023-10-16T19:41:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f8e34001670 con 0x7f8e400c92a0 2023-10-16T19:41:19.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 >> v1:172.21.15.57:6789/0 conn(0x7f8e400c92a0 legacy=0x7f8e400cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28003970 0x7f8e28003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e280047c0 0x7f8e28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e280052a0 0x7f8e2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c96e0 con 0x7f8e280047c0 2023-10-16T19:41:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2800c190 con 0x7f8e28003970 2023-10-16T19:41:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.641+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2800c350 con 0x7f8e280052a0 2023-10-16T19:41:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.642+0000 7f0c7cf18640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7806d5d0 0x7f0c780bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.645+0000 7fe1e98e9640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d00052a0 0x7fe1d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.647+0000 7f0c7d719640 1 -- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780c12f0 msgr2=0x7f0c781558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.647+0000 7f0c7d719640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780c12f0 0x7f0c781558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.647+0000 7f0c7d719640 1 -- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7806d5d0 msgr2=0x7f0c780bc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.647+0000 7f0c7d719640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7806d5d0 0x7f0c780bc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.647+0000 7f0c7d719640 1 -- 172.21.15.57:0/1838976259 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009400 con 0x7f0c78151190 2023-10-16T19:41:19.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.652+0000 7fe1e88e7640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d00047c0 0x7fe1d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.653+0000 7f8e3ed9d640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e280052a0 0x7f8e2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.653+0000 7f3aadd9b640 1 --2- 172.21.15.57:0/3880636583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01599e0 0x7f3ab00cb330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015d6c0 tx=0x7f3aa402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268d9d771c84143e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.657+0000 7f8e3ed9d640 1 -- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28003970 msgr2=0x7f8e28003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.657+0000 7f8e3ed9d640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28003970 0x7f8e28003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.657+0000 7f8e3ed9d640 1 -- 172.21.15.57:0/930718500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e280047c0 msgr2=0x7f8e28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.657+0000 7f8e3ed9d640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e280047c0 0x7f8e28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.657+0000 7f8e3ed9d640 1 -- 172.21.15.57:0/930718500 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400cab90 con 0x7f8e280052a0 2023-10-16T19:41:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.659+0000 7f8e3ed9d640 1 -- 172.21.15.57:0/930718500 reap_dead start 2023-10-16T19:41:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.660+0000 7fe1e98e9640 1 -- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d00047c0 msgr2=0x7fe1d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.660+0000 7fe1e98e9640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d00047c0 0x7fe1d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.660+0000 7fe1e98e9640 1 -- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d0003970 msgr2=0x7fe1d0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.660+0000 7fe1e98e9640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d0003970 0x7fe1d0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.660+0000 7fe1e98e9640 1 -- 172.21.15.57:0/1204180046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4153550 con 0x7fe1d00052a0 2023-10-16T19:41:19.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.660+0000 7f0c7d719640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 0x7f0c781ee320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000caa0 tx=0x7f0c7000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.661+0000 7fe1e98e9640 1 -- 172.21.15.57:0/1204180046 reap_dead start 2023-10-16T19:41:19.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.663+0000 7fe1e98e9640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d00052a0 0x7fe1d000b980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc001d20 tx=0x7fe1d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93aba20983c40ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.670+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac032840 con 0x7ff8bc153170 2023-10-16T19:41:19.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.670+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc003b70 con 0x7fe1d00052a0 2023-10-16T19:41:19.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.671+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc003cf0 con 0x7fe1d00052a0 2023-10-16T19:41:19.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.670+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0329a0 con 0x7ff8bc153170 2023-10-16T19:41:19.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.671+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac032d50 con 0x7ff8bc153170 2023-10-16T19:41:19.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.671+0000 7fe1dbfff640 1 -- 172.21.15.57:0/1204180046 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc005310 con 0x7fe1d00052a0 2023-10-16T19:41:19.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.671+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc1e2550 con 0x7ff8bc153170 2023-10-16T19:41:19.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.671+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc1e4d80 con 0x7ff8bc153170 2023-10-16T19:41:19.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 -- 172.21.15.57:0/1204180046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d00052a0 msgr2=0x7fe1d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d00052a0 0x7fe1d000b980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc001d20 tx=0x7fe1d00057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 -- 172.21.15.57:0/1204180046 shutdown_connections 2023-10-16T19:41:19.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/1204180046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d00052a0 0x7fe1d000b980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 -- 172.21.15.57:0/1204180046 >> 172.21.15.57:0/1204180046 conn(0x7fe1e4071720 msgr2=0x7fe1e406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 -- 172.21.15.57:0/1204180046 shutdown_connections 2023-10-16T19:41:19.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.672+0000 7fe1eb34c640 1 -- 172.21.15.57:0/1204180046 wait complete. 2023-10-16T19:41:19.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.673+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc04e1d0 con 0x7ff8bc153170 2023-10-16T19:41:19.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.674+0000 7fe1eb34c640 1 Processor -- start 2023-10-16T19:41:19.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.674+0000 7fe1eb34c640 1 -- start start 2023-10-16T19:41:19.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.675+0000 7fe1eb34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d00052a0 0x7fe1e40c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.675+0000 7fe1eb34c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 0x7fe1e40cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.675+0000 7fe1eb34c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e415aae0 0x7fe1e415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.675+0000 7fe1eb34c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415a6c0 con 0x7fe1e40c6e00 2023-10-16T19:41:19.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.675+0000 7fe1eb34c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c73a0 con 0x7fe1d00052a0 2023-10-16T19:41:19.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.675+0000 7fe1eb34c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415b4a0 con 0x7fe1e415aae0 2023-10-16T19:41:19.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.677+0000 7fe1e88e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 0x7fe1e40cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.677+0000 7fe1e88e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 0x7fe1e40cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56538/0 (socket says 172.21.15.57:56538) 2023-10-16T19:41:19.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.677+0000 7fe1e88e7640 1 -- 172.21.15.57:0/750379491 learned_addr learned my addr 172.21.15.57:0/750379491 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:19.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.679+0000 7f8e3ed9d640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e280052a0 0x7f8e2800b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009e10 tx=0x7f8e280057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccab3d4ac9e03976 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.681+0000 7fe1e88e7640 1 -- 172.21.15.57:0/750379491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e415aae0 msgr2=0x7fe1e415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.681+0000 7fe1e88e7640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e415aae0 0x7fe1e415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.681+0000 7fe1e88e7640 1 -- 172.21.15.57:0/750379491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d00052a0 msgr2=0x7fe1e40c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.681+0000 7fe1e88e7640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d00052a0 0x7fe1e40c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.681+0000 7fe1e88e7640 1 -- 172.21.15.57:0/750379491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40c75f0 con 0x7fe1e40c6e00 2023-10-16T19:41:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.683+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000ac00 con 0x7f0c78151190 2023-10-16T19:41:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.684+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7000ad60 con 0x7f0c78151190 2023-10-16T19:41:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.684+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70012620 con 0x7f0c78151190 2023-10-16T19:41:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.684+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c781577e0 con 0x7f0c78151190 2023-10-16T19:41:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.684+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c780bcc80 con 0x7f0c78151190 2023-10-16T19:41:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.684+0000 7fe1e88e7640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 0x7fe1e40cd920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400e870 tx=0x7fe1d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.685+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780ca720 con 0x7f0c78151190 2023-10-16T19:41:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.689+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400ee60 con 0x7fe1e40c6e00 2023-10-16T19:41:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.689+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d4004030 con 0x7fe1e40c6e00 2023-10-16T19:41:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.689+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40043e0 con 0x7fe1e40c6e00 2023-10-16T19:41:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.689+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e415a000 con 0x7fe1e40c6e00 2023-10-16T19:41:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.689+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4145c40 con 0x7fe1e40c6e00 2023-10-16T19:41:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.690+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e415a800 con 0x7fe1e40c6e00 2023-10-16T19:41:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.717+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1d400c940 con 0x7fe1e40c6e00 2023-10-16T19:41:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.718+0000 7fe1d9ffb640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe1c806aec0 0x7fe1c806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.718+0000 7fe1e90e8640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe1c806aec0 0x7fe1c806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.719+0000 7fe1e90e8640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe1c806aec0 0x7fe1c806d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007a00 tx=0x7fe1e00015d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.721+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1d4058f90 con 0x7fe1e40c6e00 2023-10-16T19:41:19.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.780+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f7c0057d0 con 0x7f8f9c06a320 2023-10-16T19:41:19.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.845+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe8500057d0 con 0x7fe870153170 2023-10-16T19:41:19.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.980+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8ac04e430 con 0x7ff8bc153170 2023-10-16T19:41:19.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.981+0000 7ff8b27fc640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff8a006aef0 0x7ff8a006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.982+0000 7ff8c1fac640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff8a006aef0 0x7ff8a006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:19.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.983+0000 7ff8c1fac640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff8a006aef0 0x7ff8a006d3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009770 tx=0x7ff8b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:19.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.985+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8ac07ad10 con 0x7ff8bc153170 2023-10-16T19:41:19.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.987+0000 7f3aad59a640 1 -- 172.21.15.57:0/3880636583 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4030860 con 0x7f3ab01599e0 2023-10-16T19:41:19.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.987+0000 7f3aad59a640 1 -- 172.21.15.57:0/3880636583 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa40309c0 con 0x7f3ab01599e0 2023-10-16T19:41:19.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.987+0000 7f3aad59a640 1 -- 172.21.15.57:0/3880636583 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4030d50 con 0x7f3ab01599e0 2023-10-16T19:41:19.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 -- 172.21.15.57:0/3880636583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01599e0 msgr2=0x7f3ab00cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:19.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 --2- 172.21.15.57:0/3880636583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01599e0 0x7f3ab00cb330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015d6c0 tx=0x7f3aa402b9a0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 -- 172.21.15.57:0/3880636583 shutdown_connections 2023-10-16T19:41:19.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 --2- 172.21.15.57:0/3880636583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01599e0 0x7f3ab00cb330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 --2- 172.21.15.57:0/3880636583 >> v2:172.21.15.57:3300/0 conn(0x7f3ab01531a0 0x7f3ab00c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:19.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 -- 172.21.15.57:0/3880636583 >> 172.21.15.57:0/3880636583 conn(0x7f3ab0071510 msgr2=0x7f3ab00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:19.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.988+0000 7f3ab492c640 1 -- 172.21.15.57:0/3880636583 shutdown_connections 2023-10-16T19:41:19.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.989+0000 7f3ab492c640 1 -- 172.21.15.57:0/3880636583 wait complete. 2023-10-16T19:41:19.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.992+0000 7f3ab492c640 1 Processor -- start 2023-10-16T19:41:19.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.992+0000 7f3ab492c640 1 -- start start 2023-10-16T19:41:19.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.994+0000 7f3ab492c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 0x7f3ab00b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.994+0000 7f3ab492c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01531a0 0x7f3ab01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.994+0000 7f3ab492c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab01599e0 0x7f3ab0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:19.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.994+0000 7f3ab492c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c6360 con 0x7f3ab00cb870 2023-10-16T19:41:19.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.994+0000 7f3ab492c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab01f28f0 con 0x7f3ab01531a0 2023-10-16T19:41:19.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.994+0000 7f3ab492c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c5da0 con 0x7f3ab01599e0 2023-10-16T19:41:20.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:19.998+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1d4054bd0 con 0x7fe1e40c6e00 2023-10-16T19:41:20.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.005+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8ac076950 con 0x7ff8bc153170 2023-10-16T19:41:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.008+0000 7f3aae59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 0x7f3ab00b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.019+0000 7f3aae59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 0x7f3ab00b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56548/0 (socket says 172.21.15.57:56548) 2023-10-16T19:41:20.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.019+0000 7f3aae59c640 1 -- 172.21.15.57:0/661187154 learned_addr learned my addr 172.21.15.57:0/661187154 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:20.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.020+0000 7f8f98ff9640 1 -- 172.21.15.57:0/258215968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f8c015020 con 0x7f8f9c06a320 2023-10-16T19:41:20.023 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:20.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8f8806aec0 msgr2=0x7f8f8806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8f8806aec0 0x7f8f8806d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f90036000 tx=0x7f8f90030f90 comp rx=0 tx=0).stop 2023-10-16T19:41:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 msgr2=0x7f8f9c152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 0x7f8f9c152960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00b440 tx=0x7f8f8c00b900 comp rx=0 tx=0).stop 2023-10-16T19:41:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 shutdown_connections 2023-10-16T19:41:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8f8806aec0 0x7f8f8806d380 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c157310 0x7f8f9c1fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f9c06fc00 0x7f8f9c1fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 --2- 172.21.15.57:0/258215968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9c06a320 0x7f8f9c152960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 >> 172.21.15.57:0/258215968 conn(0x7f8f9c0cf6b0 msgr2=0x7f8f9c06ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 shutdown_connections 2023-10-16T19:41:20.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.024+0000 7f8fa29f5640 1 -- 172.21.15.57:0/258215968 wait complete. 2023-10-16T19:41:20.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.028+0000 7f3aae59c640 1 -- 172.21.15.57:0/661187154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab01599e0 msgr2=0x7f3ab0155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.028+0000 7f3aae59c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab01599e0 0x7f3ab0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.028+0000 7f3aae59c640 1 -- 172.21.15.57:0/661187154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01531a0 msgr2=0x7f3ab01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.028+0000 7f3aae59c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01531a0 0x7f3ab01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.028+0000 7f3aae59c640 1 -- 172.21.15.57:0/661187154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa40094d0 con 0x7f3ab00cb870 2023-10-16T19:41:20.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.037+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0c70007070 con 0x7f0c78151190 2023-10-16T19:41:20.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.037+0000 7f0c757fa640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0c5c06aec0 0x7f0c5c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.038+0000 7f0c7cf18640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0c5c06aec0 0x7f0c5c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.039+0000 7f0c7cf18640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0c5c06aec0 0x7f0c5c06d380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c036000 tx=0x7f0c6c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.045+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c70058840 con 0x7f0c78151190 2023-10-16T19:41:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.049+0000 7f3aae59c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 0x7f3ab00b3610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000b410 tx=0x7f3aa000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.0 2023-10-16T19:41:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.058+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011830 con 0x7f3ab00cb870 2023-10-16T19:41:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.058+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa00119b0 con 0x7f3ab00cb870 2023-10-16T19:41:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.058+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00c6080 con 0x7f3ab00cb870 2023-10-16T19:41:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.058+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011d60 con 0x7f3ab00cb870 2023-10-16T19:41:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.058+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab0154750 con 0x7f3ab00cb870 2023-10-16T19:41:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.059+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab00cb1a0 con 0x7f3ab00cb870 2023-10-16T19:41:20.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.069+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78480c5440 con 0x7f78400dac00 2023-10-16T19:41:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.070+0000 7f782f7fe640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f783406aef0 0x7f783406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.071+0000 7f7846ffd640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f783406aef0 0x7f783406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.072+0000 7f7846ffd640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f783406aef0 0x7f783406d3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f783c0047c0 tx=0x7f783c004cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.077+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c70054b80 con 0x7f0c78151190 2023-10-16T19:41:20.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.082+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3aa001a400 con 0x7f3ab00cb870 2023-10-16T19:41:20.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.083+0000 7f3a9effd640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a9006aec0 0x7f3a9006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.083+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3802cd50 con 0x7f8e280052a0 2023-10-16T19:41:20.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.083+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38003970 con 0x7f8e280052a0 2023-10-16T19:41:20.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.083+0000 7f8e3d59a640 1 -- 172.21.15.57:0/930718500 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38003d20 con 0x7f8e280052a0 2023-10-16T19:41:20.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.084+0000 7f3aadd9b640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a9006aec0 0x7f3a9006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.084+0000 7f8e44c97640 1 -- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e280052a0 msgr2=0x7f8e2800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.084+0000 7f8e44c97640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e280052a0 0x7f8e2800b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009e10 tx=0x7f8e280057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.085+0000 7f8e44c97640 1 -- 172.21.15.57:0/930718500 shutdown_connections 2023-10-16T19:41:20.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.085+0000 7f8e44c97640 1 --2- 172.21.15.57:0/930718500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e280052a0 0x7f8e2800b980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.085+0000 7f8e44c97640 1 -- 172.21.15.57:0/930718500 >> 172.21.15.57:0/930718500 conn(0x7f8e40071510 msgr2=0x7f8e400659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.085+0000 7f8e44c97640 1 -- 172.21.15.57:0/930718500 shutdown_connections 2023-10-16T19:41:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.085+0000 7f8e44c97640 1 -- 172.21.15.57:0/930718500 wait complete. 2023-10-16T19:41:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.085+0000 7f3aadd9b640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a9006aec0 0x7f3a9006d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4036000 tx=0x7f3aa403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.086+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78480f4c80 con 0x7f78400dac00 2023-10-16T19:41:20.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.088+0000 7f8e44c97640 1 Processor -- start 2023-10-16T19:41:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.088+0000 7f8e44c97640 1 -- start start 2023-10-16T19:41:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.089+0000 7f8e44c97640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e280052a0 0x7f8e401eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.089+0000 7f8e44c97640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 0x7f8e400b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.089+0000 7f8e44c97640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4015b3d0 0x7f8e401f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.089+0000 7f8e44c97640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c5fd0 con 0x7f8e4015b3d0 2023-10-16T19:41:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.089+0000 7f8e44c97640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015b930 con 0x7f8e280052a0 2023-10-16T19:41:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.089+0000 7f8e44c97640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015bc10 con 0x7f8e400b3a40 2023-10-16T19:41:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.091+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3aa0059230 con 0x7f3ab00cb870 2023-10-16T19:41:20.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.124+0000 7f8e3dd9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 0x7f8e400b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.127+0000 7f8e3dd9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 0x7f8e400b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39042/0 (socket says 172.21.15.57:39042) 2023-10-16T19:41:20.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.127+0000 7f8e3dd9b640 1 -- 172.21.15.57:0/1714898984 learned_addr learned my addr 172.21.15.57:0/1714898984 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:20.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.128+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78480f08c0 con 0x7f78400dac00 2023-10-16T19:41:20.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.129+0000 7fe86dffb640 1 -- 172.21.15.57:0/3186956163 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe868017020 con 0x7fe870153170 2023-10-16T19:41:20.132 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2023-10-16T19:41:20.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe85406aec0 msgr2=0x7fe85406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe85406aec0 0x7fe85406d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe864007fd0 tx=0x7fe864007d00 comp rx=0 tx=0).stop 2023-10-16T19:41:20.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 msgr2=0x7fe8701ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 0x7fe8701ff360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c390 tx=0x7fe86800c850 comp rx=0 tx=0).stop 2023-10-16T19:41:20.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 shutdown_connections 2023-10-16T19:41:20.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe85406aec0 0x7fe85406d380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe870153170 0x7fe8701ff360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8700ca900 0x7fe8701fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 --2- 172.21.15.57:0/3186956163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8700c4ba0 0x7fe8701f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 >> 172.21.15.57:0/3186956163 conn(0x7fe870071720 msgr2=0x7fe87014ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 shutdown_connections 2023-10-16T19:41:20.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.133+0000 7fe877426640 1 -- 172.21.15.57:0/3186956163 wait complete. 2023-10-16T19:41:20.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.139+0000 7f8e3dd9b640 1 -- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e280052a0 msgr2=0x7f8e401eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.139+0000 7f8e3dd9b640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e280052a0 0x7f8e401eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.139+0000 7f8e3dd9b640 1 -- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4015b3d0 msgr2=0x7f8e401f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.139+0000 7f8e3dd9b640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4015b3d0 0x7f8e401f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.139+0000 7f8e3dd9b640 1 -- 172.21.15.57:0/1714898984 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4015bef0 con 0x7f8e400b3a40 2023-10-16T19:41:20.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.155+0000 7f8e3dd9b640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 0x7f8e400b3100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400c7e0 tx=0x7f8e3400cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.1 2023-10-16T19:41:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.177+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340074e0 con 0x7f8e400b3a40 2023-10-16T19:41:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.177+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34007640 con 0x7f8e400b3a40 2023-10-16T19:41:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.177+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4015c1d0 con 0x7f8e400b3a40 2023-10-16T19:41:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.177+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34004a00 con 0x7f8e400b3a40 2023-10-16T19:41:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.177+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e400c4640 con 0x7f8e400b3a40 2023-10-16T19:41:20.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.179+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e24005250 con 0x7f8e400b3a40 2023-10-16T19:41:20.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.234+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff8bc04e1d0 con 0x7ff8bc153170 2023-10-16T19:41:20.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.247+0000 7ff8b27fc640 1 -- 172.21.15.57:0/1201358450 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8ac079f70 con 0x7ff8bc153170 2023-10-16T19:41:20.250 INFO:teuthology.orchestra.run.smithi057.stdout:64424509450 2023-10-16T19:41:20.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff8a006aef0 msgr2=0x7ff8a006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff8a006aef0 0x7ff8a006d3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009770 tx=0x7ff8b8008040 comp rx=0 tx=0).stop 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 msgr2=0x7ff8bc1eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 0x7ff8bc1eebd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac034040 tx=0x7ff8ac0046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 shutdown_connections 2023-10-16T19:41:20.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff8a006aef0 0x7ff8a006d3b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8bc158dc0 0x7ff8bc1e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc153170 0x7ff8bc1eebd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 --2- 172.21.15.57:0/1201358450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8bc0ca900 0x7ff8bc0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 >> 172.21.15.57:0/1201358450 conn(0x7ff8bc071720 msgr2=0x7ff8bc06b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 shutdown_connections 2023-10-16T19:41:20.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.251+0000 7ff8c4210640 1 -- 172.21.15.57:0/1201358450 wait complete. 2023-10-16T19:41:20.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2023-10-16T19:41:20.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.295+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0c780c4f90 con 0x7f0c78151190 2023-10-16T19:41:20.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.317+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe1e415a800 con 0x7fe1e40c6e00 2023-10-16T19:41:20.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.328+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f78400d9c30 con 0x7f78400dac00 2023-10-16T19:41:20.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.340+0000 7f782f7fe640 1 -- 172.21.15.57:0/3368137762 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78480b5020 con 0x7f78400dac00 2023-10-16T19:41:20.343 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2023-10-16T19:41:20.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.342+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f783406aef0 msgr2=0x7f783406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.342+0000 7f784d6e5640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f783406aef0 0x7f783406d3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f783c0047c0 tx=0x7f783c004cd0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.342+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 msgr2=0x7f7840035850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.342+0000 7f784d6e5640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 0x7f7840035850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7848074120 tx=0x7f7848068a50 comp rx=0 tx=0).stop 2023-10-16T19:41:20.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 shutdown_connections 2023-10-16T19:41:20.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f783406aef0 0x7f783406d3b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78400dac00 0x7f7840035850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78400d4d80 0x7f7840168540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 --2- 172.21.15.57:0/3368137762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784004ba40 0x7f78400d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 >> 172.21.15.57:0/3368137762 conn(0x7f78400501c0 msgr2=0x7f784016a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 shutdown_connections 2023-10-16T19:41:20.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.343+0000 7f784d6e5640 1 -- 172.21.15.57:0/3368137762 wait complete. 2023-10-16T19:41:20.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.4 2023-10-16T19:41:20.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.439+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3aa0054e70 con 0x7f3ab00cb870 2023-10-16T19:41:20.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.494+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8e3400a5e0 con 0x7f8e400b3a40 2023-10-16T19:41:20.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.497+0000 7f8e2effd640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8e2006aec0 0x7f8e2006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.497+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e34089340 con 0x7f8e400b3a40 2023-10-16T19:41:20.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.498+0000 7f8e3e59c640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8e2006aec0 0x7f8e2006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.499+0000 7f8e3e59c640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8e2006aec0 0x7f8e2006d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e300014e0 tx=0x7f8e30007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.504+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e340543d0 con 0x7f8e400b3a40 2023-10-16T19:41:20.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.520+0000 7f0c757fa640 1 -- 172.21.15.57:0/1838976259 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c70017090 con 0x7f0c78151190 2023-10-16T19:41:20.523 INFO:teuthology.orchestra.run.smithi057.stdout:64424509450 2023-10-16T19:41:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.520+0000 7fe1d9ffb640 1 -- 172.21.15.57:0/750379491 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1e415a800 con 0x7fe1e40c6e00 2023-10-16T19:41:20.524 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.522+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0c5c06aec0 msgr2=0x7f0c5c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.522+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0c5c06aec0 0x7f0c5c06d380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c036000 tx=0x7f0c6c03c040 comp rx=0 tx=0).stop 2023-10-16T19:41:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.522+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 msgr2=0x7f0c781ee320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.522+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 0x7f0c781ee320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000caa0 tx=0x7f0c7000cf60 comp rx=0 tx=0).stop 2023-10-16T19:41:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 shutdown_connections 2023-10-16T19:41:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0c5c06aec0 0x7f0c5c06d380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c78151190 0x7f0c781ee320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780c12f0 0x7f0c781558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 --2- 172.21.15.57:0/1838976259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7806d5d0 0x7f0c780bc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 >> 172.21.15.57:0/1838976259 conn(0x7f0c7806c430 msgr2=0x7f0c78069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 shutdown_connections 2023-10-16T19:41:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.523+0000 7f0c7f17c640 1 -- 172.21.15.57:0/1838976259 wait complete. 2023-10-16T19:41:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe1c806aec0 msgr2=0x7fe1c806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe1c806aec0 0x7fe1c806d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007a00 tx=0x7fe1e00015d0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 msgr2=0x7fe1e40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 0x7fe1e40cd920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400e870 tx=0x7fe1d400ed30 comp rx=0 tx=0).stop 2023-10-16T19:41:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 shutdown_connections 2023-10-16T19:41:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fe1c806aec0 0x7fe1c806d380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e415aae0 0x7fe1e415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e40c6e00 0x7fe1e40cd920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 --2- 172.21.15.57:0/750379491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d00052a0 0x7fe1e40c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 >> 172.21.15.57:0/750379491 conn(0x7fe1e4071720 msgr2=0x7fe1e406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 shutdown_connections 2023-10-16T19:41:20.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.524+0000 7fe1eb34c640 1 -- 172.21.15.57:0/750379491 wait complete. 2023-10-16T19:41:20.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2023-10-16T19:41:20.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.5 2023-10-16T19:41:20.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.651+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ab015cd90 con 0x7f3ab00cb870 2023-10-16T19:41:20.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.655+0000 7f3a9effd640 1 -- 172.21.15.57:0/661187154 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ab015cd90 con 0x7f3ab00cb870 2023-10-16T19:41:20.658 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:20.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a9006aec0 msgr2=0x7f3a9006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a9006aec0 0x7f3a9006d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4036000 tx=0x7f3aa403b040 comp rx=0 tx=0).stop 2023-10-16T19:41:20.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 msgr2=0x7f3ab00b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 0x7f3ab00b3610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000b410 tx=0x7f3aa000b8d0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 shutdown_connections 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a9006aec0 0x7f3a9006d380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab01599e0 0x7f3ab0155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab01531a0 0x7f3ab01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 --2- 172.21.15.57:0/661187154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab00cb870 0x7f3ab00b3610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.657+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 >> 172.21.15.57:0/661187154 conn(0x7f3ab0071510 msgr2=0x7f3ab00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.658+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 shutdown_connections 2023-10-16T19:41:20.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.658+0000 7f3ab492c640 1 -- 172.21.15.57:0/661187154 wait complete. 2023-10-16T19:41:20.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2023-10-16T19:41:20.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.713+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e240050c0 con 0x7f8e400b3a40 2023-10-16T19:41:20.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.739+0000 7f8e2effd640 1 -- 172.21.15.57:0/1714898984 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e34018090 con 0x7f8e400b3a40 2023-10-16T19:41:20.742 INFO:teuthology.orchestra.run.smithi057.stdout:64424509450 2023-10-16T19:41:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8e2006aec0 msgr2=0x7f8e2006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8e2006aec0 0x7f8e2006d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e300014e0 tx=0x7f8e30007990 comp rx=0 tx=0).stop 2023-10-16T19:41:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 msgr2=0x7f8e400b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 0x7f8e400b3100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400c7e0 tx=0x7f8e3400cca0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 shutdown_connections 2023-10-16T19:41:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8e2006aec0 0x7f8e2006d380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.742+0000 7f8e44c97640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4015b3d0 0x7f8e401f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.743+0000 7f8e44c97640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e400b3a40 0x7f8e400b3100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.743+0000 7f8e44c97640 1 --2- 172.21.15.57:0/1714898984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e280052a0 0x7f8e401eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.743+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 >> 172.21.15.57:0/1714898984 conn(0x7f8e40071510 msgr2=0x7f8e4014ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.743+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 shutdown_connections 2023-10-16T19:41:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:20.743+0000 7f8e44c97640 1 -- 172.21.15.57:0/1714898984 wait complete. 2023-10-16T19:41:20.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2023-10-16T19:41:21.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T19:41:21.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T19:41:21.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.252+0000 7fd853b39640 1 Processor -- start 2023-10-16T19:41:21.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.252+0000 7fd853b39640 1 -- start start 2023-10-16T19:41:21.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.253+0000 7fd853b39640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd84c14fe90 0x7fd84c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.253+0000 7fd853b39640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd84c0c1d90 0x7fd84c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.253+0000 7fd853b39640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0c6180 con 0x7fd84c0c5d50 2023-10-16T19:41:21.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.253+0000 7fd853b39640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0c4570 con 0x7fd84c14fe90 2023-10-16T19:41:21.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.253+0000 7fd853b39640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0c39f0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.254+0000 7fd8518d5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd84c14fe90 0x7fd84c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.254+0000 7fd8518d5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd84c14fe90 0x7fd84c0c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56570/0 (socket says 172.21.15.57:56570) 2023-10-16T19:41:21.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.254+0000 7fd8518d5640 1 -- 172.21.15.57:0/4123964113 learned_addr learned my addr 172.21.15.57:0/4123964113 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.257+0000 7fd8518d5640 1 -- 172.21.15.57:0/4123964113 >> v2:172.21.15.110:3300/0 conn(0x7fd84c0c1d90 msgr2=0x7fd84c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.257+0000 7fd8518d5640 1 --2- 172.21.15.57:0/4123964113 >> v2:172.21.15.110:3300/0 conn(0x7fd84c0c1d90 0x7fd84c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.257+0000 7fd8518d5640 1 -- 172.21.15.57:0/4123964113 >> v1:172.21.15.110:6789/0 conn(0x7fd84c0c5d50 legacy=0x7fd84c0708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.257+0000 7fd8518d5640 1 -- 172.21.15.57:0/4123964113 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0c3cd0 con 0x7fd84c14fe90 2023-10-16T19:41:21.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.260+0000 7fd8518d5640 1 --2- 172.21.15.57:0/4123964113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c14fe90 0x7fd84c0c1850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0cb550 tx=0x7fd84802e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44187c6436bc6d5a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.263+0000 7fd8508d3640 1 -- 172.21.15.57:0/4123964113 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848036440 con 0x7fd84c14fe90 2023-10-16T19:41:21.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.264+0000 7fd8508d3640 1 -- 172.21.15.57:0/4123964113 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8480365a0 con 0x7fd84c14fe90 2023-10-16T19:41:21.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.264+0000 7fd8508d3640 1 -- 172.21.15.57:0/4123964113 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848036930 con 0x7fd84c14fe90 2023-10-16T19:41:21.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 -- 172.21.15.57:0/4123964113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c14fe90 msgr2=0x7fd84c0c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 --2- 172.21.15.57:0/4123964113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c14fe90 0x7fd84c0c1850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0cb550 tx=0x7fd84802e200 comp rx=0 tx=0).stop 2023-10-16T19:41:21.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 -- 172.21.15.57:0/4123964113 shutdown_connections 2023-10-16T19:41:21.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 --2- 172.21.15.57:0/4123964113 >> v2:172.21.15.110:3300/0 conn(0x7fd84c0c1d90 0x7fd84c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 --2- 172.21.15.57:0/4123964113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c14fe90 0x7fd84c0c1850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 -- 172.21.15.57:0/4123964113 >> 172.21.15.57:0/4123964113 conn(0x7fd84c06aff0 msgr2=0x7fd84c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 -- 172.21.15.57:0/4123964113 shutdown_connections 2023-10-16T19:41:21.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.265+0000 7fd853b39640 1 -- 172.21.15.57:0/4123964113 wait complete. 2023-10-16T19:41:21.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.267+0000 7fd853b39640 1 Processor -- start 2023-10-16T19:41:21.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.267+0000 7fd853b39640 1 -- start start 2023-10-16T19:41:21.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.268+0000 7fd853b39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 0x7fd84c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.268+0000 7fd853b39640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84c0c5d50 0x7fd84c1e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.268+0000 7fd853b39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84c14fe90 0x7fd84c1e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.268+0000 7fd853b39640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c154da0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.268+0000 7fd853b39640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1e0490 con 0x7fd84c14fe90 2023-10-16T19:41:21.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.268+0000 7fd853b39640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1e0160 con 0x7fd84c0c5d50 2023-10-16T19:41:21.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.269+0000 7fd8518d5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 0x7fd84c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.269+0000 7fd8518d5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 0x7fd84c14eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56586/0 (socket says 172.21.15.57:56586) 2023-10-16T19:41:21.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.269+0000 7fd8518d5640 1 -- 172.21.15.57:0/2650927402 learned_addr learned my addr 172.21.15.57:0/2650927402 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.270+0000 7fd8510d4640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84c0c5d50 0x7fd84c1e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.271+0000 7fd8520d6640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84c14fe90 0x7fd84c1e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.273+0000 7fd8518d5640 1 -- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84c0c5d50 msgr2=0x7fd84c1e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.273+0000 7fd8518d5640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84c0c5d50 0x7fd84c1e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.273+0000 7fd8518d5640 1 -- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84c14fe90 msgr2=0x7fd84c1e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.273+0000 7fd8518d5640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84c14fe90 0x7fd84c1e0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.273+0000 7fd8518d5640 1 -- 172.21.15.57:0/2650927402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84800b770 con 0x7fd84c0c1d90 2023-10-16T19:41:21.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.276+0000 7fd8518d5640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 0x7fd84c14eec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd84802e240 tx=0x7fd8480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T19:41:21.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.281+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848036440 con 0x7fd84c0c1d90 2023-10-16T19:41:21.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.281+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848034ba0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.281+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848041440 con 0x7fd84c0c1d90 2023-10-16T19:41:21.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.281+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c154ae0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.281+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0cb010 con 0x7fd84c0c1d90 2023-10-16T19:41:21.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.283+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c04e160 con 0x7fd84c0c1d90 2023-10-16T19:41:21.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.352+0000 7f921f209640 1 Processor -- start 2023-10-16T19:41:21.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.352+0000 7f921f209640 1 -- start start 2023-10-16T19:41:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.353+0000 7f921f209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921806b910 0x7f921806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.353+0000 7f921f209640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f92180c3ad0 0x7f92180c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.354+0000 7f921f209640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180c42d0 con 0x7f92181593e0 2023-10-16T19:41:21.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.354+0000 7f921f209640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921806c230 con 0x7f92180c3ad0 2023-10-16T19:41:21.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.354+0000 7f921f209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c4520 con 0x7f921806b910 2023-10-16T19:41:21.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.355+0000 7f921cfa5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921806b910 0x7f921806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.355+0000 7f9217fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f92180c3ad0 0x7f92180c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.356+0000 7f921cfa5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921806b910 0x7f921806bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39060/0 (socket says 172.21.15.57:39060) 2023-10-16T19:41:21.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.356+0000 7f921cfa5640 1 -- 172.21.15.57:0/3566433396 learned_addr learned my addr 172.21.15.57:0/3566433396 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T19:41:21.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.362+0000 7f9217fff640 1 -- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921806b910 msgr2=0x7f921806bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.362+0000 7f9217fff640 1 --2- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921806b910 0x7f921806bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.362+0000 7f9217fff640 1 -- 172.21.15.57:0/3566433396 >> v1:172.21.15.57:6789/0 conn(0x7f92181593e0 legacy=0x7f921815c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.362+0000 7f9217fff640 1 -- 172.21.15.57:0/3566433396 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180c4800 con 0x7f92180c3ad0 2023-10-16T19:41:21.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.368+0000 7f9217fff640 1 --2- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92180c3ad0 0x7f92180c92a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92040097a0 tx=0x7f920402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a97547ffffc18b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.379+0000 7f92177fe640 1 -- 172.21.15.57:0/3566433396 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204031830 con 0x7f92180c3ad0 2023-10-16T19:41:21.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.379+0000 7f92177fe640 1 -- 172.21.15.57:0/3566433396 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9204031990 con 0x7f92180c3ad0 2023-10-16T19:41:21.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.379+0000 7f92177fe640 1 -- 172.21.15.57:0/3566433396 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204031d20 con 0x7f92180c3ad0 2023-10-16T19:41:21.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.380+0000 7f921f209640 1 -- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92180c3ad0 msgr2=0x7f92180c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.380+0000 7f921f209640 1 --2- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92180c3ad0 0x7f92180c92a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92040097a0 tx=0x7f920402b8d0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.380+0000 7f921f209640 1 -- 172.21.15.57:0/3566433396 shutdown_connections 2023-10-16T19:41:21.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.380+0000 7f921f209640 1 --2- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92180c3ad0 0x7f92180c92a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.380+0000 7f921f209640 1 --2- 172.21.15.57:0/3566433396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921806b910 0x7f921806bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.380+0000 7f921f209640 1 -- 172.21.15.57:0/3566433396 >> 172.21.15.57:0/3566433396 conn(0x7f9218071720 msgr2=0x7f921806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.381+0000 7f921f209640 1 -- 172.21.15.57:0/3566433396 shutdown_connections 2023-10-16T19:41:21.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.381+0000 7f921f209640 1 -- 172.21.15.57:0/3566433396 wait complete. 2023-10-16T19:41:21.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.383+0000 7f921f209640 1 Processor -- start 2023-10-16T19:41:21.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.384+0000 7f921f209640 1 -- start start 2023-10-16T19:41:21.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.385+0000 7f921f209640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f921806b910 0x7f921815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.385+0000 7f921f209640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 0x7f9218158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.385+0000 7f921f209640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92181593e0 0x7f921814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.385+0000 7f921f209640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181ef3c0 con 0x7f921806b910 2023-10-16T19:41:21.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.385+0000 7f921f209640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921815d130 con 0x7f92181593e0 2023-10-16T19:41:21.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.385+0000 7f921f209640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92181ef850 con 0x7f92180c3ad0 2023-10-16T19:41:21.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.387+0000 7f9217fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 0x7f9218158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.388+0000 7f9217fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 0x7f9218158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39076/0 (socket says 172.21.15.57:39076) 2023-10-16T19:41:21.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.388+0000 7f9217fff640 1 -- 172.21.15.57:0/4257320345 learned_addr learned my addr 172.21.15.57:0/4257320345 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.388+0000 7f921d7a6640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92181593e0 0x7f921814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.398+0000 7f9217fff640 1 -- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92181593e0 msgr2=0x7f921814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.398+0000 7f9217fff640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92181593e0 0x7f921814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.398+0000 7f9217fff640 1 -- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f921806b910 msgr2=0x7f921815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.398+0000 7f9217fff640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f921806b910 0x7f921815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.398+0000 7f9217fff640 1 -- 172.21.15.57:0/4257320345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204009400 con 0x7f92180c3ad0 2023-10-16T19:41:21.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.404+0000 7f9217fff640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 0x7f9218158740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9204000c00 tx=0x7f92040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.416+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920403a8f0 con 0x7f92180c3ad0 2023-10-16T19:41:21.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.416+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920403aa50 con 0x7f92180c3ad0 2023-10-16T19:41:21.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.416+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920403ae00 con 0x7f92180c3ad0 2023-10-16T19:41:21.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.417+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921815ce50 con 0x7f92180c3ad0 2023-10-16T19:41:21.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.418+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92181eed70 con 0x7f92180c3ad0 2023-10-16T19:41:21.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.419+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921804e1d0 con 0x7f92180c3ad0 2023-10-16T19:41:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.468+0000 7f0a3e5b8640 1 Processor -- start 2023-10-16T19:41:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.468+0000 7f0a3e5b8640 1 -- start start 2023-10-16T19:41:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.469+0000 7f0a3e5b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a380c5c20 0x7f0a380c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.469+0000 7f0a3e5b8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a380cef90 con 0x7f0a380c9930 2023-10-16T19:41:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.469+0000 7f0a3e5b8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a38159bb0 con 0x7f0a38153180 2023-10-16T19:41:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.469+0000 7f0a3e5b8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380c9d40 con 0x7f0a380c5c20 2023-10-16T19:41:21.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.471+0000 7f0a3d5b6640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0a38153180 0x7f0a380ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:37270/0 (socket says 172.21.15.57:37270) 2023-10-16T19:41:21.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.471+0000 7f0a3d5b6640 1 -- 172.21.15.57:0/566292629 learned_addr learned my addr 172.21.15.57:0/566292629 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:21.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.479+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577139650 0 0) 0x7f0a38159bb0 con 0x7f0a38153180 2023-10-16T19:41:21.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.479+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a24003520 con 0x7f0a38153180 2023-10-16T19:41:21.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.489+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284561989 0 0) 0x7f0a24003520 con 0x7f0a38153180 2023-10-16T19:41:21.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.489+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 >> v2:172.21.15.57:3300/0 conn(0x7f0a380c5c20 msgr2=0x7f0a380c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.489+0000 7f0a2ffff640 1 --2- 172.21.15.57:0/566292629 >> v2:172.21.15.57:3300/0 conn(0x7f0a380c5c20 0x7f0a380c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.489+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 >> v1:172.21.15.57:6789/0 conn(0x7f0a380c9930 legacy=0x7f0a380cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.489+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38153560 con 0x7f0a38153180 2023-10-16T19:41:21.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.489+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f0a34001670 con 0x7f0a38153180 2023-10-16T19:41:21.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 >> v1:172.21.15.110:6789/0 conn(0x7f0a38153180 legacy=0x7f0a380ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a240039c0 0x7f0a24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a240047c0 0x7f0a24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240052a0 0x7f0a2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380c9d40 con 0x7f0a240052a0 2023-10-16T19:41:21.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2400c1f0 con 0x7f0a240039c0 2023-10-16T19:41:21.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.490+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2400c3b0 con 0x7f0a240047c0 2023-10-16T19:41:21.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.499+0000 7f0a3d5b6640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a240039c0 0x7f0a24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.507+0000 7f0a3d5b6640 1 -- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a240047c0 msgr2=0x7f0a24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.507+0000 7f0a3d5b6640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a240047c0 0x7f0a24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.507+0000 7f0a3d5b6640 1 -- 172.21.15.57:0/566292629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240052a0 msgr2=0x7f0a2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.507+0000 7f0a3d5b6640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240052a0 0x7f0a2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.507+0000 7f0a3d5b6640 1 -- 172.21.15.57:0/566292629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24003520 con 0x7f0a240039c0 2023-10-16T19:41:21.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.507+0000 7f0a3ddb7640 1 -- 172.21.15.57:0/566292629 reap_dead start 2023-10-16T19:41:21.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.513+0000 7f0a3d5b6640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a240039c0 0x7f0a24003dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c160 tx=0x7f0a240057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf3e2a7e17eeeab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.524+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34005ad0 con 0x7f0a240039c0 2023-10-16T19:41:21.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.524+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a34005c30 con 0x7f0a240039c0 2023-10-16T19:41:21.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.524+0000 7f0a2ffff640 1 -- 172.21.15.57:0/566292629 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3402c7f0 con 0x7f0a240039c0 2023-10-16T19:41:21.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a240039c0 msgr2=0x7f0a24003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a240039c0 0x7f0a24003dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c160 tx=0x7f0a240057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/566292629 shutdown_connections 2023-10-16T19:41:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/566292629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a240039c0 0x7f0a24003dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/566292629 >> 172.21.15.57:0/566292629 conn(0x7f0a3806c760 msgr2=0x7f0a3806a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/566292629 shutdown_connections 2023-10-16T19:41:21.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.525+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/566292629 wait complete. 2023-10-16T19:41:21.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.528+0000 7f0a3e5b8640 1 Processor -- start 2023-10-16T19:41:21.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.528+0000 7f0a3e5b8640 1 -- start start 2023-10-16T19:41:21.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.529+0000 7f0a3e5b8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240039c0 0x7f0a381e2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.529+0000 7f0a3e5b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a381e2940 0x7f0a3814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.529+0000 7f0a3e5b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 0x7f0a3814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.529+0000 7f0a3e5b8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3814a620 con 0x7f0a240039c0 2023-10-16T19:41:21.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.529+0000 7f0a3e5b8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3814a8c0 con 0x7f0a381495f0 2023-10-16T19:41:21.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.529+0000 7f0a3e5b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3814ab60 con 0x7f0a381e2940 2023-10-16T19:41:21.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.531+0000 7f0a3ddb7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 0x7f0a3814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.532+0000 7f0a3ddb7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 0x7f0a3814c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52646/0 (socket says 172.21.15.57:52646) 2023-10-16T19:41:21.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.532+0000 7f0a3ddb7640 1 -- 172.21.15.57:0/1891947652 learned_addr learned my addr 172.21.15.57:0/1891947652 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.539+0000 7f675a221640 1 Processor -- start 2023-10-16T19:41:21.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.539+0000 7f675a221640 1 -- start start 2023-10-16T19:41:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.540+0000 7f675a221640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6754151030 0x7f67540c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.540+0000 7f675a221640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f675415a760 0x7f675415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.540+0000 7f675a221640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67540c8420 con 0x7f67540c16b0 2023-10-16T19:41:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.540+0000 7f675a221640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540c1ba0 con 0x7f6754151030 2023-10-16T19:41:21.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.540+0000 7f675a221640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540c8fa0 con 0x7f675415a760 2023-10-16T19:41:21.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.541+0000 7f0a3ddb7640 1 -- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a381e2940 msgr2=0x7f0a3814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.541+0000 7f0a3ddb7640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a381e2940 0x7f0a3814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.541+0000 7f0a3ddb7640 1 -- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240039c0 msgr2=0x7f0a381e2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.541+0000 7f0a3ddb7640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240039c0 0x7f0a381e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.541+0000 7f0a3ddb7640 1 -- 172.21.15.57:0/1891947652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3814ae40 con 0x7f0a381495f0 2023-10-16T19:41:21.547 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T19:41:21.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.547+0000 7f0a3ddb7640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 0x7f0a3814c0b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a3806a0d0 tx=0x7f0a3000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T19:41:21.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.559+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30007070 con 0x7f0a381495f0 2023-10-16T19:41:21.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.559+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a300071f0 con 0x7f0a381495f0 2023-10-16T19:41:21.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.559+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300075e0 con 0x7f0a381495f0 2023-10-16T19:41:21.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.559+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a381efb30 con 0x7f0a381495f0 2023-10-16T19:41:21.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.559+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a381f00f0 con 0x7f0a381495f0 2023-10-16T19:41:21.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.560+0000 7f6753fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f675415a760 0x7f675415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.560+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a38159540 con 0x7f0a381495f0 2023-10-16T19:41:21.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.563+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8480403e0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.565+0000 7fd8427fc640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd83006aec0 0x7fd83006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.565+0000 7fd8510d4640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd83006aec0 0x7fd83006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.566+0000 7fd8510d4640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd83006aec0 0x7fd83006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd84c14f810 tx=0x7fd83c009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.577+0000 7f6753fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f675415a760 0x7f675415ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52648/0 (socket says 172.21.15.57:52648) 2023-10-16T19:41:21.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.577+0000 7f6753fff640 1 -- 172.21.15.57:0/792059543 learned_addr learned my addr 172.21.15.57:0/792059543 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.578+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd84807afd0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.579+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd848077310 con 0x7fd84c0c1d90 2023-10-16T19:41:21.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.611+0000 7f67537fe640 1 --2- 172.21.15.57:0/792059543 >> v2:172.21.15.57:3300/0 conn(0x7f6754151030 0x7f67540c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.616+0000 7f67537fe640 1 -- 172.21.15.57:0/792059543 >> v2:172.21.15.110:3300/0 conn(0x7f675415a760 msgr2=0x7f675415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.616+0000 7f67537fe640 1 --2- 172.21.15.57:0/792059543 >> v2:172.21.15.110:3300/0 conn(0x7f675415a760 0x7f675415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.616+0000 7f67537fe640 1 -- 172.21.15.57:0/792059543 >> v1:172.21.15.57:6789/0 conn(0x7f67540c16b0 legacy=0x7f675406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.616+0000 7f67537fe640 1 -- 172.21.15.57:0/792059543 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540c8700 con 0x7f6754151030 2023-10-16T19:41:21.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.628+0000 7f67537fe640 1 --2- 172.21.15.57:0/792059543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6754151030 0x7f67540c7110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67540af5d0 tx=0x7f674402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e7ceb75fcc0acd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.637+0000 7f67527fc640 1 -- 172.21.15.57:0/792059543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744031830 con 0x7f6754151030 2023-10-16T19:41:21.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.637+0000 7f67527fc640 1 -- 172.21.15.57:0/792059543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6744031990 con 0x7f6754151030 2023-10-16T19:41:21.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.637+0000 7f67527fc640 1 -- 172.21.15.57:0/792059543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744031d20 con 0x7f6754151030 2023-10-16T19:41:21.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.638+0000 7f675a221640 1 -- 172.21.15.57:0/792059543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6754151030 msgr2=0x7f67540c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.638+0000 7f675a221640 1 --2- 172.21.15.57:0/792059543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6754151030 0x7f67540c7110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67540af5d0 tx=0x7f674402b8d0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.640+0000 7f675a221640 1 -- 172.21.15.57:0/792059543 shutdown_connections 2023-10-16T19:41:21.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.640+0000 7f675a221640 1 --2- 172.21.15.57:0/792059543 >> v2:172.21.15.110:3300/0 conn(0x7f675415a760 0x7f675415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.640+0000 7f675a221640 1 --2- 172.21.15.57:0/792059543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6754151030 0x7f67540c7110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.640+0000 7f675a221640 1 -- 172.21.15.57:0/792059543 >> 172.21.15.57:0/792059543 conn(0x7f675406eb50 msgr2=0x7f675406ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.640+0000 7f675a221640 1 -- 172.21.15.57:0/792059543 shutdown_connections 2023-10-16T19:41:21.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.640+0000 7f675a221640 1 -- 172.21.15.57:0/792059543 wait complete. 2023-10-16T19:41:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.643+0000 7f675a221640 1 Processor -- start 2023-10-16T19:41:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.643+0000 7f675a221640 1 -- start start 2023-10-16T19:41:21.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.645+0000 7f675a221640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67540c16b0 0x7f6754158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.645+0000 7f675a221640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6754151030 0x7f6754158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.645+0000 7f675a221640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 0x7f6754142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.645+0000 7f675a221640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540b2300 con 0x7f675415a760 2023-10-16T19:41:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.645+0000 7f675a221640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540b0b00 con 0x7f67540c16b0 2023-10-16T19:41:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.645+0000 7f675a221640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540b0de0 con 0x7f6754151030 2023-10-16T19:41:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.646+0000 7f6753fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 0x7f6754142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.647+0000 7f6753fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 0x7f6754142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56624/0 (socket says 172.21.15.57:56624) 2023-10-16T19:41:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.647+0000 7f6753fff640 1 -- 172.21.15.57:0/780173493 learned_addr learned my addr 172.21.15.57:0/780173493 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.652+0000 7f6753fff640 1 -- 172.21.15.57:0/780173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6754151030 msgr2=0x7f6754158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.652+0000 7f6753fff640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6754151030 0x7f6754158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.652+0000 7f6753fff640 1 -- 172.21.15.57:0/780173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67540c16b0 msgr2=0x7f6754158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.652+0000 7f6753fff640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67540c16b0 0x7f6754158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.652+0000 7f6753fff640 1 -- 172.21.15.57:0/780173493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6744009400 con 0x7f675415a760 2023-10-16T19:41:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.657+0000 7f6753fff640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 0x7f6754142010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f674c009fd0 tx=0x7f674c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.663+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c003da0 con 0x7f675415a760 2023-10-16T19:41:21.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.663+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c00f040 con 0x7f675415a760 2023-10-16T19:41:21.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.663+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c00da60 con 0x7f675415a760 2023-10-16T19:41:21.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.664+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6754158130 con 0x7f675415a760 2023-10-16T19:41:21.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.665+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6754145e00 con 0x7f675415a760 2023-10-16T19:41:21.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.667+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6754157f90 con 0x7f675415a760 2023-10-16T19:41:21.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T19:41:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.761+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f920404d450 con 0x7f92180c3ad0 2023-10-16T19:41:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.762+0000 7f92157fa640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f91fc06aec0 0x7f91fc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.763+0000 7f921cfa5640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f91fc06aec0 0x7f91fc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.766 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T19:41:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.764+0000 7f921cfa5640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f91fc06aec0 0x7f91fc06d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f920c006f40 tx=0x7f920c006e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.764+0000 7f3bfa79a640 1 Processor -- start 2023-10-16T19:41:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.765+0000 7f3bfa79a640 1 -- start start 2023-10-16T19:41:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.769+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f920407acb0 con 0x7f92180c3ad0 2023-10-16T19:41:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.767+0000 7f3bfa79a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 0x7f3bf4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.767+0000 7f3bfa79a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bf4153500 0x7f3bf40c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.767+0000 7f3bfa79a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf40c7920 con 0x7f3bf40c5fc0 2023-10-16T19:41:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.767+0000 7f3bfa79a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40c7490 con 0x7f3bf4153500 2023-10-16T19:41:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.767+0000 7f3bfa79a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c65a0 con 0x7f3bf4153120 2023-10-16T19:41:21.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.800+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92040768f0 con 0x7f92180c3ad0 2023-10-16T19:41:21.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.815+0000 7f3bf9798640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 0x7f3bf4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.818+0000 7f3bf9798640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 0x7f3bf4158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39112/0 (socket says 172.21.15.57:39112) 2023-10-16T19:41:21.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.818+0000 7f3bf9798640 1 -- 172.21.15.57:0/2213902369 learned_addr learned my addr 172.21.15.57:0/2213902369 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.825+0000 7f3bf9798640 1 -- 172.21.15.57:0/2213902369 >> v2:172.21.15.57:3300/0 conn(0x7f3bf4153500 msgr2=0x7f3bf40c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.825+0000 7f3bf9798640 1 --2- 172.21.15.57:0/2213902369 >> v2:172.21.15.57:3300/0 conn(0x7f3bf4153500 0x7f3bf40c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.825+0000 7f3bf9798640 1 -- 172.21.15.57:0/2213902369 >> v1:172.21.15.57:6789/0 conn(0x7f3bf40c5fc0 legacy=0x7f3bf40ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.825+0000 7f3bf9798640 1 -- 172.21.15.57:0/2213902369 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf40c6880 con 0x7f3bf4153120 2023-10-16T19:41:21.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.829+0000 7ff1001b6640 1 Processor -- start 2023-10-16T19:41:21.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.829+0000 7ff1001b6640 1 -- start start 2023-10-16T19:41:21.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.830+0000 7f3bf9798640 1 --2- 172.21.15.57:0/2213902369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 0x7f3bf4158f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009870 tx=0x7f3bf002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57708bc95e11e509 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.832+0000 7ff1001b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 0x7ff0f81571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.832+0000 7ff1001b6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff0f806fe70 0x7ff0f8157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.832+0000 7ff1001b6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f81618b0 con 0x7ff0f80c5550 2023-10-16T19:41:21.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.832+0000 7ff1001b6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f8160d30 con 0x7ff0f806fe70 2023-10-16T19:41:21.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.832+0000 7ff1001b6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8161010 con 0x7ff0f80c5930 2023-10-16T19:41:21.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.841+0000 7f3bebfff640 1 -- 172.21.15.57:0/2213902369 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00317c0 con 0x7f3bf4153120 2023-10-16T19:41:21.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.841+0000 7f3bebfff640 1 -- 172.21.15.57:0/2213902369 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0031920 con 0x7f3bf4153120 2023-10-16T19:41:21.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.841+0000 7f3bebfff640 1 -- 172.21.15.57:0/2213902369 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0031cb0 con 0x7f3bf4153120 2023-10-16T19:41:21.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 -- 172.21.15.57:0/2213902369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 msgr2=0x7f3bf4158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/2213902369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 0x7f3bf4158f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009870 tx=0x7f3bf002b860 comp rx=0 tx=0).stop 2023-10-16T19:41:21.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 -- 172.21.15.57:0/2213902369 shutdown_connections 2023-10-16T19:41:21.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/2213902369 >> v2:172.21.15.57:3300/0 conn(0x7f3bf4153500 0x7f3bf40c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/2213902369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf4153120 0x7f3bf4158f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 -- 172.21.15.57:0/2213902369 >> 172.21.15.57:0/2213902369 conn(0x7f3bf406c9c0 msgr2=0x7f3bf406a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.842+0000 7f3bfa79a640 1 -- 172.21.15.57:0/2213902369 shutdown_connections 2023-10-16T19:41:21.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.843+0000 7f3bfa79a640 1 -- 172.21.15.57:0/2213902369 wait complete. 2023-10-16T19:41:21.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.844+0000 7ff0fd751640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 0x7ff0f81571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.844+0000 7ff0fd751640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 0x7ff0f81571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39116/0 (socket says 172.21.15.57:39116) 2023-10-16T19:41:21.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.844+0000 7ff0fd751640 1 -- 172.21.15.57:0/734224241 learned_addr learned my addr 172.21.15.57:0/734224241 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.845+0000 7f3bfa79a640 1 Processor -- start 2023-10-16T19:41:21.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.846+0000 7f3bfa79a640 1 -- start start 2023-10-16T19:41:21.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.848+0000 7f3bfa79a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf40c5fc0 0x7f3bf41562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.849+0000 7f3bfa79a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf4153120 0x7f3bf41f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.849+0000 7f3bfa79a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 0x7f3bf414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.849+0000 7f3bfa79a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4155160 con 0x7f3bf40c5fc0 2023-10-16T19:41:21.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.849+0000 7f3bfa79a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40cbed0 con 0x7f3bf4153120 2023-10-16T19:41:21.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.849+0000 7f3bfa79a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c9730 con 0x7f3bf41f6920 2023-10-16T19:41:21.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.852+0000 7ff0fd751640 1 -- 172.21.15.57:0/734224241 >> v2:172.21.15.110:3300/0 conn(0x7ff0f806fe70 msgr2=0x7ff0f8157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.852+0000 7ff0fd751640 1 --2- 172.21.15.57:0/734224241 >> v2:172.21.15.110:3300/0 conn(0x7ff0f806fe70 0x7ff0f8157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.852+0000 7ff0fd751640 1 -- 172.21.15.57:0/734224241 >> v1:172.21.15.57:6789/0 conn(0x7ff0f80c5550 legacy=0x7ff0f815de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.852+0000 7ff0fd751640 1 -- 172.21.15.57:0/734224241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f81612f0 con 0x7ff0f80c5930 2023-10-16T19:41:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.857+0000 7f3bf9f99640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 0x7f3bf414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.858+0000 7f3bf9f99640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 0x7f3bf414c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39120/0 (socket says 172.21.15.57:39120) 2023-10-16T19:41:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.858+0000 7f3bf9f99640 1 -- 172.21.15.57:0/3660846503 learned_addr learned my addr 172.21.15.57:0/3660846503 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.862+0000 7ff0fd751640 1 --2- 172.21.15.57:0/734224241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 0x7ff0f81571c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009870 tx=0x7ff0e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc2f227b048500c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.869+0000 7f3bf9f99640 1 -- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf4153120 msgr2=0x7f3bf41f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.869+0000 7f3bf9f99640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf4153120 0x7f3bf41f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.869+0000 7f3bf9f99640 1 -- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf40c5fc0 msgr2=0x7f3bf41562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.869+0000 7f3bf9f99640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf40c5fc0 0x7f3bf41562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.870+0000 7f3bf9f99640 1 -- 172.21.15.57:0/3660846503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00094d0 con 0x7f3bf41f6920 2023-10-16T19:41:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.884+0000 7ff0fcf50640 1 -- 172.21.15.57:0/734224241 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8031640 con 0x7ff0f80c5930 2023-10-16T19:41:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.884+0000 7ff0fcf50640 1 -- 172.21.15.57:0/734224241 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80317a0 con 0x7ff0f80c5930 2023-10-16T19:41:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.884+0000 7ff0fcf50640 1 -- 172.21.15.57:0/734224241 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8031b30 con 0x7ff0f80c5930 2023-10-16T19:41:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.885+0000 7ff1001b6640 1 -- 172.21.15.57:0/734224241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 msgr2=0x7ff0f81571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.885+0000 7ff1001b6640 1 --2- 172.21.15.57:0/734224241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 0x7ff0f81571c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009870 tx=0x7ff0e802b8f0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.885+0000 7ff1001b6640 1 -- 172.21.15.57:0/734224241 shutdown_connections 2023-10-16T19:41:21.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.885+0000 7ff1001b6640 1 --2- 172.21.15.57:0/734224241 >> v2:172.21.15.110:3300/0 conn(0x7ff0f806fe70 0x7ff0f8157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.885+0000 7ff1001b6640 1 --2- 172.21.15.57:0/734224241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f80c5930 0x7ff0f81571c0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009870 tx=0x7ff0e802b8f0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.885+0000 7ff1001b6640 1 -- 172.21.15.57:0/734224241 >> 172.21.15.57:0/734224241 conn(0x7ff0f806c430 msgr2=0x7ff0f8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.886+0000 7ff1001b6640 1 -- 172.21.15.57:0/734224241 shutdown_connections 2023-10-16T19:41:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.886+0000 7ff1001b6640 1 -- 172.21.15.57:0/734224241 wait complete. 2023-10-16T19:41:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.888+0000 7ff1001b6640 1 Processor -- start 2023-10-16T19:41:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.889+0000 7ff1001b6640 1 -- start start 2023-10-16T19:41:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.889+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd84c0716a0 con 0x7fd84c0c1d90 2023-10-16T19:41:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7f3bf9f99640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 0x7f3bf414c900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c7e0 tx=0x7f3bec00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7ff1001b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f806fe70 0x7ff0f815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7ff1001b6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f80c5550 0x7ff0f81f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7ff1001b6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0f81f3040 0x7ff0f814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7ff1001b6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80bf860 con 0x7ff0f81f3040 2023-10-16T19:41:21.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7ff1001b6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c4640 con 0x7ff0f80c5550 2023-10-16T19:41:21.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.890+0000 7ff1001b6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f815e4e0 con 0x7ff0f806fe70 2023-10-16T19:41:21.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.904+0000 7ff0fdf52640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f806fe70 0x7ff0f815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec003d80 con 0x7f3bf41f6920 2023-10-16T19:41:21.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf4152960 con 0x7f3bf41f6920 2023-10-16T19:41:21.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf4151db0 con 0x7f3bf41f6920 2023-10-16T19:41:21.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00ce90 con 0x7f3bf41f6920 2023-10-16T19:41:21.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0052b0 con 0x7f3bf41f6920 2023-10-16T19:41:21.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7ff0fdf52640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f806fe70 0x7ff0f815fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39128/0 (socket says 172.21.15.57:39128) 2023-10-16T19:41:21.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.905+0000 7ff0fdf52640 1 -- 172.21.15.57:0/3496437329 learned_addr learned my addr 172.21.15.57:0/3496437329 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:21.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.906+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd4005250 con 0x7f3bf41f6920 2023-10-16T19:41:21.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.912+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a30007740 con 0x7f0a381495f0 2023-10-16T19:41:21.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.912+0000 7f0a2dffb640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0a1c06aec0 0x7f0a1c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.913+0000 7f0a3d5b6640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0a1c06aec0 0x7f0a1c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.914+0000 7f0a3d5b6640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0a1c06aec0 0x7f0a1c06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a34034000 tx=0x7f0a34039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.924+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a3001b2f0 con 0x7f0a381495f0 2023-10-16T19:41:21.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.935+0000 7f85f02d7640 1 Processor -- start 2023-10-16T19:41:21.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.935+0000 7f85f02d7640 1 -- start start 2023-10-16T19:41:21.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.937+0000 7f85f02d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85e8156a00 0x7f85e80c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.938+0000 7f85f02d7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e806c4b0 con 0x7f85e80c8ce0 2023-10-16T19:41:21.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.938+0000 7f85f02d7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e806b8a0 con 0x7f85e806ff60 2023-10-16T19:41:21.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.938+0000 7f85f02d7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e806c970 con 0x7f85e8156a00 2023-10-16T19:41:21.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.947+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f674c00dbc0 con 0x7f675415a760 2023-10-16T19:41:21.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.948+0000 7f673bfff640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f674006aec0 0x7f674006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.949+0000 7f67537fe640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f674006aec0 0x7f674006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.950+0000 7f67537fe640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f674006aec0 0x7f674006d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6744036000 tx=0x7f6744030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.952+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f674c0584c0 con 0x7f675415a760 2023-10-16T19:41:21.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:21.995+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a30054ce0 con 0x7f0a381495f0 2023-10-16T19:41:22.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.026+0000 7ff0fd751640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f80c5550 0x7ff0f81f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.027+0000 7f85ee874640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85e8156a00 0x7f85e80c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.028+0000 7f85ee874640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85e8156a00 0x7f85e80c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:52702/0 (socket says 172.21.15.57:52702) 2023-10-16T19:41:22.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.028+0000 7f85ee874640 1 -- 172.21.15.57:0/2282160506 learned_addr learned my addr 172.21.15.57:0/2282160506 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:22.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.037+0000 7f7889610640 1 Processor -- start 2023-10-16T19:41:22.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.037+0000 7f7889610640 1 -- start start 2023-10-16T19:41:22.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.038+0000 7f7889610640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78840c92a0 0x7f78840cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.038+0000 7f7889610640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788415c5a0 con 0x7f78841531a0 2023-10-16T19:41:22.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.038+0000 7f7889610640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788415d400 con 0x7f78840cb870 2023-10-16T19:41:22.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.039+0000 7f7889610640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78840c96e0 con 0x7f78840c92a0 2023-10-16T19:41:22.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.039+0000 7ff0fd751640 1 -- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f806fe70 msgr2=0x7ff0f815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.039+0000 7ff0fd751640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f806fe70 0x7ff0f815fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.039+0000 7ff0fd751640 1 -- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0f81f3040 msgr2=0x7ff0f814d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.039+0000 7ff0fd751640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0f81f3040 0x7ff0f814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.039+0000 7ff0fd751640 1 -- 172.21.15.57:0/3496437329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80094d0 con 0x7ff0f80c5550 2023-10-16T19:41:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.048+0000 7ff0fd751640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f80c5550 0x7ff0f81f2b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8033000 tx=0x7ff0e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.052+0000 7f85ee874640 1 -- 172.21.15.57:0/2282160506 >> v1:172.21.15.110:6789/0 conn(0x7f85e806ff60 legacy=0x7f85e81562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:22.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.052+0000 7f85ee874640 1 -- 172.21.15.57:0/2282160506 >> v1:172.21.15.57:6789/0 conn(0x7f85e80c8ce0 legacy=0x7f85e815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:22.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.052+0000 7f85ee874640 1 -- 172.21.15.57:0/2282160506 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e806bb80 con 0x7f85e8156a00 2023-10-16T19:41:22.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.063+0000 7f85ee874640 1 --2- 172.21.15.57:0/2282160506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 0x7f85e80c7110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009e50 tx=0x7f85e002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4852ef2158585352 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.068+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92181ef500 con 0x7f92180c3ad0 2023-10-16T19:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.074+0000 7f78837fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f78840cb870 0x7f78840ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:37288/0 (socket says 172.21.15.57:37288) 2023-10-16T19:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.074+0000 7f78837fe640 1 -- 172.21.15.57:0/2827682998 learned_addr learned my addr 172.21.15.57:0/2827682998 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:22.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.084+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8031ea0 con 0x7ff0f80c5550 2023-10-16T19:41:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.084+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8004240 con 0x7ff0f80c5550 2023-10-16T19:41:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.084+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e803a850 con 0x7ff0f80c5550 2023-10-16T19:41:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.084+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f81606d0 con 0x7ff0f80c5550 2023-10-16T19:41:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.085+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f815bc20 con 0x7ff0f80c5550 2023-10-16T19:41:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.086+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f804e1d0 con 0x7ff0f80c5550 2023-10-16T19:41:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.127+0000 7fd8427fc640 1 -- 172.21.15.57:0/2650927402 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd848046020 con 0x7fd84c0c1d90 2023-10-16T19:41:22.131 INFO:teuthology.orchestra.run.smithi057.stdout:64424509452 2023-10-16T19:41:22.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.130+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd83006aec0 msgr2=0x7fd83006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.130+0000 7fd853b39640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd83006aec0 0x7fd83006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd84c14f810 tx=0x7fd83c009110 comp rx=0 tx=0).stop 2023-10-16T19:41:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.130+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 msgr2=0x7fd84c14eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.130+0000 7fd853b39640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 0x7fd84c14eec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd84802e240 tx=0x7fd8480046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 shutdown_connections 2023-10-16T19:41:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd83006aec0 0x7fd83006d380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84c14fe90 0x7fd84c1e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84c0c5d50 0x7fd84c1e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 --2- 172.21.15.57:0/2650927402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd84c0c1d90 0x7fd84c14eec0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 >> 172.21.15.57:0/2650927402 conn(0x7fd84c06aff0 msgr2=0x7fd84c0c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 shutdown_connections 2023-10-16T19:41:22.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.131+0000 7fd853b39640 1 -- 172.21.15.57:0/2650927402 wait complete. 2023-10-16T19:41:22.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.148+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f674c054800 con 0x7f675415a760 2023-10-16T19:41:22.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.0 2023-10-16T19:41:22.154 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:22.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.167+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400364137 0 0) 0x7f788415c5a0 con 0x7f78841531a0 2023-10-16T19:41:22.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.167+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f786c003520 con 0x7f78841531a0 2023-10-16T19:41:22.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.177+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276661883 0 0) 0x7f786c003520 con 0x7f78841531a0 2023-10-16T19:41:22.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.177+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78840c92a0 msgr2=0x7f78840cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:22.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.177+0000 7f7881ffb640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78840c92a0 0x7f78840cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.177+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 >> v1:172.21.15.110:6789/0 conn(0x7f78840cb870 legacy=0x7f78840ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.177+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788415c7f0 con 0x7f78841531a0 2023-10-16T19:41:22.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.177+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f7874001670 con 0x7f78841531a0 2023-10-16T19:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 >> v1:172.21.15.57:6789/0 conn(0x7f78841531a0 legacy=0x7f78841599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78840c92a0 0x7f786c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f786c0040b0 0x7f786c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f786c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840c96e0 con 0x7f786c004e20 2023-10-16T19:41:22.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c005590 con 0x7f786c0040b0 2023-10-16T19:41:22.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.178+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c00bec0 con 0x7f78840c92a0 2023-10-16T19:41:22.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.181+0000 7f78837fe640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f786c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.184+0000 7f78837fe640 1 -- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78840c92a0 msgr2=0x7f786c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:22.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.184+0000 7f78837fe640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78840c92a0 0x7f786c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.184+0000 7f78837fe640 1 -- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f786c0040b0 msgr2=0x7f786c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:22.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.184+0000 7f78837fe640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f786c0040b0 0x7f786c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.184+0000 7f78837fe640 1 -- 172.21.15.57:0/2827682998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788415c7f0 con 0x7f786c004e20 2023-10-16T19:41:22.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.186+0000 7f78837fe640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f786c00b980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c190 tx=0x7f786c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d55724bd448bac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.190+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c02ca50 con 0x7f786c004e20 2023-10-16T19:41:22.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.190+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c02cbb0 con 0x7f786c004e20 2023-10-16T19:41:22.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.190+0000 7f7881ffb640 1 -- 172.21.15.57:0/2827682998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c035470 con 0x7f786c004e20 2023-10-16T19:41:22.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.191+0000 7f7889610640 1 -- 172.21.15.57:0/2827682998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 msgr2=0x7f786c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.191+0000 7f7889610640 1 --2- 172.21.15.57:0/2827682998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f786c00b980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c190 tx=0x7f786c0057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.191+0000 7f78837fe640 1 -- 172.21.15.57:0/2827682998 reap_dead start 2023-10-16T19:41:22.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.191+0000 7f7889610640 1 -- 172.21.15.57:0/2827682998 shutdown_connections 2023-10-16T19:41:22.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.191+0000 7f7889610640 1 -- 172.21.15.57:0/2827682998 >> 172.21.15.57:0/2827682998 conn(0x7f7884071510 msgr2=0x7f78840659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.192+0000 7f7889610640 1 -- 172.21.15.57:0/2827682998 shutdown_connections 2023-10-16T19:41:22.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.192+0000 7f7889610640 1 -- 172.21.15.57:0/2827682998 wait complete. 2023-10-16T19:41:22.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.194+0000 7f7889610640 1 Processor -- start 2023-10-16T19:41:22.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.194+0000 7f7889610640 1 -- start start 2023-10-16T19:41:22.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.195+0000 7f7889610640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f78840c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.195+0000 7f7889610640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f788414f280 0x7f78841ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.195+0000 7f7889610640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7884158e90 0x7f788415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.195+0000 7f7889610640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78841ee630 con 0x7f786c004e20 2023-10-16T19:41:22.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.195+0000 7f7889610640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840c46f0 con 0x7f7884158e90 2023-10-16T19:41:22.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.195+0000 7f7889610640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7884158320 con 0x7f788414f280 2023-10-16T19:41:22.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.196+0000 7f7882ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f78840c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.196+0000 7f7882ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f78840c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56680/0 (socket says 172.21.15.57:56680) 2023-10-16T19:41:22.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.196+0000 7f7882ffd640 1 -- 172.21.15.57:0/3430700968 learned_addr learned my addr 172.21.15.57:0/3430700968 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:22.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.200+0000 7f7882ffd640 1 -- 172.21.15.57:0/3430700968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f788414f280 msgr2=0x7f78841ef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.200+0000 7f7882ffd640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f788414f280 0x7f78841ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.200+0000 7f7882ffd640 1 -- 172.21.15.57:0/3430700968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7884158e90 msgr2=0x7f788415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.200+0000 7f7882ffd640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7884158e90 0x7f788415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.200+0000 7f7882ffd640 1 -- 172.21.15.57:0/3430700968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884158600 con 0x7f786c004e20 2023-10-16T19:41:22.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.202+0000 7f7882ffd640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f78840c6e90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f787400c850 tx=0x7f787400cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.207+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874005480 con 0x7f786c004e20 2023-10-16T19:41:22.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.207+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7874007030 con 0x7f786c004e20 2023-10-16T19:41:22.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.207+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874007400 con 0x7f786c004e20 2023-10-16T19:41:22.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.207+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78841588e0 con 0x7f786c004e20 2023-10-16T19:41:22.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.207+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78841eebd0 con 0x7f786c004e20 2023-10-16T19:41:22.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.208+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78840cb1a0 con 0x7f786c004e20 2023-10-16T19:41:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.230+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7874006790 con 0x7f786c004e20 2023-10-16T19:41:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.230+0000 7f786b7fe640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f787006aec0 0x7f787006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.231+0000 7f78827fc640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f787006aec0 0x7f787006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.232+0000 7f78827fc640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f787006aec0 0x7f787006d380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78840c6930 tx=0x7f7878006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.232+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78740588f0 con 0x7f786c004e20 2023-10-16T19:41:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.242+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0a38159540 con 0x7f0a381495f0 2023-10-16T19:41:22.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.250+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3bec005410 con 0x7f3bf41f6920 2023-10-16T19:41:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.252+0000 7f3be9ffb640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3bd806aef0 0x7f3bd806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.252+0000 7f3bf9798640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3bd806aef0 0x7f3bd806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.253+0000 7f3bf9798640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3bd806aef0 0x7f3bd806d3b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0036000 tx=0x7f3bf0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.255+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bec058760 con 0x7f3bf41f6920 2023-10-16T19:41:22.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.274+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bec0543a0 con 0x7f3bf41f6920 2023-10-16T19:41:22.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.326+0000 7f92157fa640 1 -- 172.21.15.57:0/4257320345 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9204035070 con 0x7f92180c3ad0 2023-10-16T19:41:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:60129542156 2023-10-16T19:41:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.329+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f91fc06aec0 msgr2=0x7f91fc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.329+0000 7f921f209640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f91fc06aec0 0x7f91fc06d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f920c006f40 tx=0x7f920c006e90 comp rx=0 tx=0).stop 2023-10-16T19:41:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.329+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 msgr2=0x7f9218158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.329+0000 7f921f209640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 0x7f9218158740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9204000c00 tx=0x7f92040046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 shutdown_connections 2023-10-16T19:41:22.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f91fc06aec0 0x7f91fc06d380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92181593e0 0x7f921814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92180c3ad0 0x7f9218158740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 --2- 172.21.15.57:0/4257320345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f921806b910 0x7f921815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 >> 172.21.15.57:0/4257320345 conn(0x7f9218071720 msgr2=0x7f921814df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 shutdown_connections 2023-10-16T19:41:22.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.330+0000 7f921f209640 1 -- 172.21.15.57:0/4257320345 wait complete. 2023-10-16T19:41:22.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.1 2023-10-16T19:41:22.357 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:22.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.365+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6754157f90 con 0x7f675415a760 2023-10-16T19:41:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.425+0000 7f85ed071640 1 -- 172.21.15.57:0/2282160506 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e002cb20 con 0x7f85e8156a00 2023-10-16T19:41:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.425+0000 7f85ed071640 1 -- 172.21.15.57:0/2282160506 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e002cc80 con 0x7f85e8156a00 2023-10-16T19:41:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.425+0000 7f85ed071640 1 -- 172.21.15.57:0/2282160506 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00343f0 con 0x7f85e8156a00 2023-10-16T19:41:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.426+0000 7f85f02d7640 1 -- 172.21.15.57:0/2282160506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 msgr2=0x7f85e80c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.426+0000 7f85f02d7640 1 --2- 172.21.15.57:0/2282160506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 0x7f85e80c7110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009e50 tx=0x7f85e002bf80 comp rx=0 tx=0).stop 2023-10-16T19:41:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.427+0000 7f85f02d7640 1 -- 172.21.15.57:0/2282160506 shutdown_connections 2023-10-16T19:41:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.427+0000 7f85f02d7640 1 --2- 172.21.15.57:0/2282160506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 0x7f85e80c7110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.427+0000 7f85f02d7640 1 -- 172.21.15.57:0/2282160506 >> 172.21.15.57:0/2282160506 conn(0x7f85e806eb50 msgr2=0x7f85e806ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.427+0000 7f85f02d7640 1 -- 172.21.15.57:0/2282160506 shutdown_connections 2023-10-16T19:41:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.427+0000 7f85f02d7640 1 -- 172.21.15.57:0/2282160506 wait complete. 2023-10-16T19:41:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.430+0000 7f85f02d7640 1 Processor -- start 2023-10-16T19:41:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.430+0000 7f85f02d7640 1 -- start start 2023-10-16T19:41:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.431+0000 7f85f02d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 0x7f85e81eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.431+0000 7f85f02d7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85e80c8ce0 0x7f85e8150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.431+0000 7f85f02d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 0x7f85e814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.431+0000 7f85f02d7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80ca940 con 0x7f85e80c8ce0 2023-10-16T19:41:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.431+0000 7f85f02d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e81ee1e0 con 0x7f85e8156a00 2023-10-16T19:41:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.431+0000 7f85f02d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80ae2a0 con 0x7f85e806ff60 2023-10-16T19:41:22.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.433+0000 7f85ee073640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 0x7f85e81eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.433+0000 7f85ee073640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 0x7f85e81eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39156/0 (socket says 172.21.15.57:39156) 2023-10-16T19:41:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.433+0000 7f85ee073640 1 -- 172.21.15.57:0/4087258658 learned_addr learned my addr 172.21.15.57:0/4087258658 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.435+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff0e8042070 con 0x7ff0f80c5550 2023-10-16T19:41:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.437+0000 7ff0ee7fc640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff0dc06aef0 0x7ff0dc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.437+0000 7ff0fdf52640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff0dc06aef0 0x7ff0dc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.438+0000 7ff0fdf52640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff0dc06aef0 0x7ff0dc06d3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40099a0 tx=0x7ff0f40090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.438+0000 7f85ee073640 1 -- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 msgr2=0x7f85e814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.438+0000 7f85ee073640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 0x7f85e814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.438+0000 7f85ee073640 1 -- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85e80c8ce0 msgr2=0x7f85e8150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.438+0000 7f85ee073640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85e80c8ce0 0x7f85e8150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.438+0000 7f85ee073640 1 -- 172.21.15.57:0/4087258658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009b30 con 0x7f85e806ff60 2023-10-16T19:41:22.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.445+0000 7f85ee073640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 0x7f85e81eebd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c440 tx=0x7f85e400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.448+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0e807abf0 con 0x7ff0f80c5550 2023-10-16T19:41:22.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.456+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e40035f0 con 0x7f85e806ff60 2023-10-16T19:41:22.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.456+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4003770 con 0x7f85e806ff60 2023-10-16T19:41:22.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.456+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e81ef110 con 0x7f85e806ff60 2023-10-16T19:41:22.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.456+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4003b20 con 0x7f85e806ff60 2023-10-16T19:41:22.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.456+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e80ae7c0 con 0x7f85e806ff60 2023-10-16T19:41:22.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.458+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80ae9e0 con 0x7f85e806ff60 2023-10-16T19:41:22.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.481+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3bd40057d0 con 0x7f3bf41f6920 2023-10-16T19:41:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.484+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0e8076830 con 0x7ff0f80c5550 2023-10-16T19:41:22.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.504+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7874054530 con 0x7f786c004e20 2023-10-16T19:41:22.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.524+0000 7f0a2dffb640 1 -- 172.21.15.57:0/1891947652 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a38159540 con 0x7f0a381495f0 2023-10-16T19:41:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:64424509451 2023-10-16T19:41:22.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0a1c06aec0 msgr2=0x7f0a1c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0a1c06aec0 0x7f0a1c06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a34034000 tx=0x7f0a34039040 comp rx=0 tx=0).stop 2023-10-16T19:41:22.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 msgr2=0x7f0a3814c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 0x7f0a3814c0b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a3806a0d0 tx=0x7f0a3000c8f0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 shutdown_connections 2023-10-16T19:41:22.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0a1c06aec0 0x7f0a1c06d380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a381495f0 0x7f0a3814c0b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a381e2940 0x7f0a3814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 --2- 172.21.15.57:0/1891947652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a240039c0 0x7f0a381e2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 >> 172.21.15.57:0/1891947652 conn(0x7f0a3806c760 msgr2=0x7f0a380cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.527+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 shutdown_connections 2023-10-16T19:41:22.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.528+0000 7f0a3e5b8640 1 -- 172.21.15.57:0/1891947652 wait complete. 2023-10-16T19:41:22.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.531+0000 7f673bfff640 1 -- 172.21.15.57:0/780173493 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f674c022020 con 0x7f675415a760 2023-10-16T19:41:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:60129542156 2023-10-16T19:41:22.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f674006aec0 msgr2=0x7f674006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f674006aec0 0x7f674006d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6744036000 tx=0x7f6744030000 comp rx=0 tx=0).stop 2023-10-16T19:41:22.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 msgr2=0x7f6754142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 0x7f6754142010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f674c009fd0 tx=0x7f674c007f60 comp rx=0 tx=0).stop 2023-10-16T19:41:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 shutdown_connections 2023-10-16T19:41:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f674006aec0 0x7f674006d380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f675415a760 0x7f6754142010 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6754151030 0x7f6754158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 --2- 172.21.15.57:0/780173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67540c16b0 0x7f6754158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.535+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 >> 172.21.15.57:0/780173493 conn(0x7f675406eb50 msgr2=0x7f675414f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.536+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 shutdown_connections 2023-10-16T19:41:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.536+0000 7f675a221640 1 -- 172.21.15.57:0/780173493 wait complete. 2023-10-16T19:41:22.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2023-10-16T19:41:22.553 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:22.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.4 2023-10-16T19:41:22.557 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:22.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.712+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff0f804e1d0 con 0x7ff0f80c5550 2023-10-16T19:41:22.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.718+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78840ccb70 con 0x7f786c004e20 2023-10-16T19:41:22.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.724+0000 7f786b7fe640 1 -- 172.21.15.57:0/3430700968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7874018070 con 0x7f786c004e20 2023-10-16T19:41:22.727 INFO:teuthology.orchestra.run.smithi057.stdout:64424509452 2023-10-16T19:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f787006aec0 msgr2=0x7f787006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f787006aec0 0x7f787006d380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78840c6930 tx=0x7f7878006ca0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 msgr2=0x7f78840c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f78840c6e90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f787400c850 tx=0x7f787400cd10 comp rx=0 tx=0).stop 2023-10-16T19:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 shutdown_connections 2023-10-16T19:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f787006aec0 0x7f787006d380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7884158e90 0x7f788415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f788414f280 0x7f78841ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 --2- 172.21.15.57:0/3430700968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f786c004e20 0x7f78840c6e90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 >> 172.21.15.57:0/3430700968 conn(0x7f7884071510 msgr2=0x7f78840ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 shutdown_connections 2023-10-16T19:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.727+0000 7f7889610640 1 -- 172.21.15.57:0/3430700968 wait complete. 2023-10-16T19:41:22.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.3 2023-10-16T19:41:22.748 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.748+0000 7ff0ee7fc640 1 -- 172.21.15.57:0/3496437329 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0e8079e50 con 0x7ff0f80c5550 2023-10-16T19:41:22.751 INFO:teuthology.orchestra.run.smithi057.stdout:64424509453 2023-10-16T19:41:22.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff0dc06aef0 msgr2=0x7ff0dc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff0dc06aef0 0x7ff0dc06d3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40099a0 tx=0x7ff0f40090e0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f80c5550 msgr2=0x7ff0f81f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f80c5550 0x7ff0f81f2b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8033000 tx=0x7ff0e80046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 shutdown_connections 2023-10-16T19:41:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff0dc06aef0 0x7ff0dc06d3b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0f81f3040 0x7ff0f814d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f80c5550 0x7ff0f81f2b00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 --2- 172.21.15.57:0/3496437329 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0f806fe70 0x7ff0f815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 >> 172.21.15.57:0/3496437329 conn(0x7ff0f806c430 msgr2=0x7ff0f8154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 shutdown_connections 2023-10-16T19:41:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.751+0000 7ff1001b6640 1 -- 172.21.15.57:0/3496437329 wait complete. 2023-10-16T19:41:22.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.5 2023-10-16T19:41:22.770 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.793+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f85e4003c80 con 0x7f85e806ff60 2023-10-16T19:41:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.794+0000 7f85deffd640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f85cc06af40 0x7f85cc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.794+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85e4089180 con 0x7f85e806ff60 2023-10-16T19:41:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.795+0000 7f85ed872640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f85cc06af40 0x7f85cc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.796+0000 7f85ed872640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f85cc06af40 0x7f85cc06d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85e8151110 tx=0x7f85d8007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.810+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85e4054180 con 0x7f85e806ff60 2023-10-16T19:41:22.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.910+0000 7f3be9ffb640 1 -- 172.21.15.57:0/3660846503 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bec017020 con 0x7f3bf41f6920 2023-10-16T19:41:22.913 INFO:teuthology.orchestra.run.smithi057.stdout:64424509452 2023-10-16T19:41:22.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.914+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3bd806aef0 msgr2=0x7f3bd806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.914+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3bd806aef0 0x7f3bd806d3b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0036000 tx=0x7f3bf0030000 comp rx=0 tx=0).stop 2023-10-16T19:41:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.914+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 msgr2=0x7f3bf414c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.914+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 0x7f3bf414c900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c7e0 tx=0x7f3bec00cca0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 shutdown_connections 2023-10-16T19:41:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3bd806aef0 0x7f3bd806d3b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf41f6920 0x7f3bf414c900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf4153120 0x7f3bf41f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 --2- 172.21.15.57:0/3660846503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf40c5fc0 0x7f3bf41562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 >> 172.21.15.57:0/3660846503 conn(0x7f3bf406c9c0 msgr2=0x7f3bf414f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 shutdown_connections 2023-10-16T19:41:22.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:22.915+0000 7f3bfa79a640 1 -- 172.21.15.57:0/3660846503 wait complete. 2023-10-16T19:41:22.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.6 2023-10-16T19:41:22.939 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.073+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f85e804e1d0 con 0x7f85e806ff60 2023-10-16T19:41:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.121+0000 7f85deffd640 1 -- 172.21.15.57:0/4087258658 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85e40577a0 con 0x7f85e806ff60 2023-10-16T19:41:23.124 INFO:teuthology.orchestra.run.smithi057.stdout:64424509453 2023-10-16T19:41:23.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f85cc06af40 msgr2=0x7f85cc06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f85cc06af40 0x7f85cc06d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85e8151110 tx=0x7f85d8007990 comp rx=0 tx=0).stop 2023-10-16T19:41:23.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 msgr2=0x7f85e81eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 0x7f85e81eebd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c440 tx=0x7f85e400c900 comp rx=0 tx=0).stop 2023-10-16T19:41:23.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 shutdown_connections 2023-10-16T19:41:23.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f85cc06af40 0x7f85cc06d400 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85e8151110 tx=0x7f85d8007990 comp rx=0 tx=0).stop 2023-10-16T19:41:23.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e8156a00 0x7f85e814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85e80c8ce0 0x7f85e8150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 --2- 172.21.15.57:0/4087258658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85e806ff60 0x7f85e81eebd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.123+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 >> 172.21.15.57:0/4087258658 conn(0x7f85e806eb50 msgr2=0x7f85e815c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.124+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 shutdown_connections 2023-10-16T19:41:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.124+0000 7f85f02d7640 1 -- 172.21.15.57:0/4087258658 wait complete. 2023-10-16T19:41:23.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.2 2023-10-16T19:41:23.146 DEBUG:teuthology.parallel:result is None 2023-10-16T19:41:23.147 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T19:41:23.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.334+0000 7f4fca867640 1 Processor -- start 2023-10-16T19:41:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.334+0000 7f4fca867640 1 -- start start 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.335+0000 7f4fca867640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 0x7f4fc40ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.335+0000 7f4fca867640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fc40ceb00 0x7f4fc40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.335+0000 7f4fca867640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cef90 con 0x7f4fc40c5c20 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.335+0000 7f4fca867640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc4159bb0 con 0x7f4fc40ceb00 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.335+0000 7f4fca867640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4153560 con 0x7f4fc4153180 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.337+0000 7f4fca066640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4fc40c5c20 0x7f4fc40cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51328/0 (socket says 172.21.15.57:51328) 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.337+0000 7f4fca066640 1 -- 172.21.15.57:0/3511918643 learned_addr learned my addr 172.21.15.57:0/3511918643 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:23.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.337+0000 7f4fc9865640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 0x7f4fc40ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.337+0000 7f4fc9064640 1 --2- 172.21.15.57:0/3511918643 >> v2:172.21.15.110:3300/0 conn(0x7f4fc40ceb00 0x7f4fc40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.341+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974458091 0 0) 0x7f4fc40cef90 con 0x7f4fc40c5c20 2023-10-16T19:41:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.341+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb0003520 con 0x7f4fc40c5c20 2023-10-16T19:41:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232045590 0 0) 0x7f4fb0003520 con 0x7f4fc40c5c20 2023-10-16T19:41:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 msgr2=0x7f4fc40ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 0x7f4fc40ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 >> v2:172.21.15.110:3300/0 conn(0x7f4fc40ceb00 msgr2=0x7f4fc40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 --2- 172.21.15.57:0/3511918643 >> v2:172.21.15.110:3300/0 conn(0x7f4fc40ceb00 0x7f4fc40c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4158fa0 con 0x7f4fc40c5c20 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f4fbc0019f0 con 0x7f4fc40c5c20 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 >> v1:172.21.15.57:6789/0 conn(0x7f4fc40c5c20 legacy=0x7f4fc40cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 0x7f4fb0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb0003f40 0x7f4fb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb0004d00 0x7f4fb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4159bb0 con 0x7f4fb0004d00 2023-10-16T19:41:23.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4153560 con 0x7f4fb0003f40 2023-10-16T19:41:23.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.345+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000ba00 con 0x7f4fc4153180 2023-10-16T19:41:23.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.350+0000 7f4fca066640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb0004d00 0x7f4fb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.354+0000 7f4fca066640 1 -- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 msgr2=0x7f4fb0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.354+0000 7f4fca066640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fc4153180 0x7f4fb0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.354+0000 7f4fca066640 1 -- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb0003f40 msgr2=0x7f4fb00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.354+0000 7f4fca066640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb0003f40 0x7f4fb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.354+0000 7f4fca066640 1 -- 172.21.15.57:0/3511918643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0003520 con 0x7f4fb0004d00 2023-10-16T19:41:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.357+0000 7f4fca066640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb0004d00 0x7f4fb0005180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00a780 tx=0x7f4fb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddf865dc46078f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.364+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc034630 con 0x7f4fb0004d00 2023-10-16T19:41:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.364+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc02f070 con 0x7f4fb0004d00 2023-10-16T19:41:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.364+0000 7f4fc8863640 1 -- 172.21.15.57:0/3511918643 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc034a50 con 0x7f4fb0004d00 2023-10-16T19:41:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca867640 1 -- 172.21.15.57:0/3511918643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb0004d00 msgr2=0x7f4fb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca867640 1 --2- 172.21.15.57:0/3511918643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb0004d00 0x7f4fb0005180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00a780 tx=0x7f4fb00057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca066640 1 -- 172.21.15.57:0/3511918643 reap_dead start 2023-10-16T19:41:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca867640 1 -- 172.21.15.57:0/3511918643 shutdown_connections 2023-10-16T19:41:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca867640 1 -- 172.21.15.57:0/3511918643 >> 172.21.15.57:0/3511918643 conn(0x7f4fc406c760 msgr2=0x7f4fc406a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca867640 1 -- 172.21.15.57:0/3511918643 shutdown_connections 2023-10-16T19:41:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.365+0000 7f4fca867640 1 -- 172.21.15.57:0/3511918643 wait complete. 2023-10-16T19:41:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.368+0000 7f4fca867640 1 Processor -- start 2023-10-16T19:41:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.368+0000 7f4fca867640 1 -- start start 2023-10-16T19:41:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.369+0000 7f4fca867640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb0004d00 0x7f4fc4154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.369+0000 7f4fca867640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc41e0890 0x7f4fc41df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.369+0000 7f4fca867640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 0x7f4fc41f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.369+0000 7f4fca867640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc41536d0 con 0x7f4fc41546e0 2023-10-16T19:41:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.369+0000 7f4fca867640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4154250 con 0x7f4fc41e0890 2023-10-16T19:41:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.370+0000 7f4fca867640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc414f550 con 0x7f4fb0004d00 2023-10-16T19:41:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.370+0000 7f4fca066640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 0x7f4fc41f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.371+0000 7f4fca066640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 0x7f4fc41f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56700/0 (socket says 172.21.15.57:56700) 2023-10-16T19:41:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.371+0000 7f4fca066640 1 -- 172.21.15.57:0/1550303453 learned_addr learned my addr 172.21.15.57:0/1550303453 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.371+0000 7f4fc9064640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc41e0890 0x7f4fc41df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.372+0000 7f4fc9865640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb0004d00 0x7f4fc4154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.377+0000 7f4fca066640 1 -- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb0004d00 msgr2=0x7f4fc4154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.377+0000 7f4fca066640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb0004d00 0x7f4fc4154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.377+0000 7f4fca066640 1 -- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc41e0890 msgr2=0x7f4fc41df0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.377+0000 7f4fca066640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc41e0890 0x7f4fc41df0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.377+0000 7f4fca066640 1 -- 172.21.15.57:0/1550303453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4153920 con 0x7f4fc41546e0 2023-10-16T19:41:23.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.380+0000 7f4fca066640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 0x7f4fc41f1400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02cba0 tx=0x7f4fbc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.386+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0019c0 con 0x7f4fc41546e0 2023-10-16T19:41:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.386+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc034640 con 0x7f4fc41546e0 2023-10-16T19:41:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.386+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0349b0 con 0x7f4fc41546e0 2023-10-16T19:41:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.386+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc4153c00 con 0x7f4fc41546e0 2023-10-16T19:41:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.387+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc41511c0 con 0x7f4fc41546e0 2023-10-16T19:41:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.388+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc404e160 con 0x7f4fc41546e0 2023-10-16T19:41:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.411+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4fbc031030 con 0x7f4fc41546e0 2023-10-16T19:41:23.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.412+0000 7f4fba7fc640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4fa806aef0 0x7f4fa806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.413+0000 7f4fc9865640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4fa806aef0 0x7f4fa806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.414+0000 7f4fc9865640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4fa806aef0 0x7f4fa806d3b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0004770 tx=0x7f4fc0006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.725+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fbc07b7a0 con 0x7f4fc41546e0 2023-10-16T19:41:23.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.726+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4fbc0773e0 con 0x7f4fc41546e0 2023-10-16T19:41:23.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.944+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fc4159560 con 0x7f4fa806aef0 2023-10-16T19:41:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.954+0000 7f4fba7fc640 1 -- 172.21.15.57:0/1550303453 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264618 (secure 0 0 0) 0x7f4fc00119b0 con 0x7f4fa806aef0 2023-10-16T19:41:23.959 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:23.962 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T19:41:23.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.960+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4fa806aef0 msgr2=0x7f4fa806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.960+0000 7f4fca867640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4fa806aef0 0x7f4fa806d3b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0004770 tx=0x7f4fc0006a20 comp rx=0 tx=0).stop 2023-10-16T19:41:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.960+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 msgr2=0x7f4fc41f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.960+0000 7f4fca867640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 0x7f4fc41f1400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02cba0 tx=0x7f4fbc001360 comp rx=0 tx=0).stop 2023-10-16T19:41:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 shutdown_connections 2023-10-16T19:41:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4fa806aef0 0x7f4fa806d3b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc41546e0 0x7f4fc41f1400 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc41e0890 0x7f4fc41df0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 --2- 172.21.15.57:0/1550303453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb0004d00 0x7f4fc4154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 >> 172.21.15.57:0/1550303453 conn(0x7f4fc406c760 msgr2=0x7f4fc4151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 shutdown_connections 2023-10-16T19:41:23.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:23.961+0000 7f4fca867640 1 -- 172.21.15.57:0/1550303453 wait complete. 2023-10-16T19:41:23.981 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-10-16T19:41:23.450408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596996,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":326,"num_write_kb":2466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":263,"ondisk_log_size":263,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230772,"kb_used_data":2164,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743948,"statfs":{"total":773094113280,"available":772857802752,"internally_reserved":0,"allocated":2215936,"data_stored":1864356,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":234016312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3484,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003952"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813951+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T19:41:00.813951+0000","last_peered":"2023-10-16T19:41:00.813951+0000","last_clean":"2023-10-16T19:41:00.813951+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T19:41:00.813951+0000","last_undegraded":"2023-10-16T19:41:00.813951+0000","last_fullsized":"2023-10-16T19:41:00.813951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746317+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T19:41:00.746317+0000","last_peered":"2023-10-16T19:41:00.746317+0000","last_clean":"2023-10-16T19:41:00.746317+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T19:41:00.746317+0000","last_undegraded":"2023-10-16T19:41:00.746317+0000","last_fullsized":"2023-10-16T19:41:00.746317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983894+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T19:41:00.983894+0000","last_peered":"2023-10-16T19:41:00.983894+0000","last_clean":"2023-10-16T19:41:00.983894+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T19:41:00.983894+0000","last_undegraded":"2023-10-16T19:41:00.983894+0000","last_fullsized":"2023-10-16T19:41:00.983894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985780+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T19:41:00.985780+0000","last_peered":"2023-10-16T19:41:00.985780+0000","last_clean":"2023-10-16T19:41:00.985780+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T19:41:00.985780+0000","last_undegraded":"2023-10-16T19:41:00.985780+0000","last_fullsized":"2023-10-16T19:41:00.985780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812868+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T19:41:00.812868+0000","last_peered":"2023-10-16T19:41:00.812868+0000","last_clean":"2023-10-16T19:41:00.812868+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T19:41:00.812868+0000","last_undegraded":"2023-10-16T19:41:00.812868+0000","last_fullsized":"2023-10-16T19:41:00.812868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985163+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T19:41:00.985163+0000","last_peered":"2023-10-16T19:41:00.985163+0000","last_clean":"2023-10-16T19:41:00.985163+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T19:41:00.985163+0000","last_undegraded":"2023-10-16T19:41:00.985163+0000","last_fullsized":"2023-10-16T19:41:00.985163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812522+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T19:41:00.812522+0000","last_peered":"2023-10-16T19:41:00.812522+0000","last_clean":"2023-10-16T19:41:00.812522+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T19:41:00.812522+0000","last_undegraded":"2023-10-16T19:41:00.812522+0000","last_fullsized":"2023-10-16T19:41:00.812522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981033+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T19:41:00.981033+0000","last_peered":"2023-10-16T19:41:00.981033+0000","last_clean":"2023-10-16T19:41:00.981033+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T19:41:00.981033+0000","last_undegraded":"2023-10-16T19:41:00.981033+0000","last_fullsized":"2023-10-16T19:41:00.981033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814034+0000","last_change":"2023-10-16T19:40:59.155274+0000","last_active":"2023-10-16T19:41:00.814034+0000","last_peered":"2023-10-16T19:41:00.814034+0000","last_clean":"2023-10-16T19:41:00.814034+0000","last_became_active":"2023-10-16T19:40:59.155045+0000","last_became_peered":"2023-10-16T19:40:59.155045+0000","last_unstale":"2023-10-16T19:41:00.814034+0000","last_undegraded":"2023-10-16T19:41:00.814034+0000","last_fullsized":"2023-10-16T19:41:00.814034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:09.928086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984830+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T19:41:00.984830+0000","last_peered":"2023-10-16T19:41:00.984830+0000","last_clean":"2023-10-16T19:41:00.984830+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T19:41:00.984830+0000","last_undegraded":"2023-10-16T19:41:00.984830+0000","last_fullsized":"2023-10-16T19:41:00.984830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986814+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T19:41:00.986814+0000","last_peered":"2023-10-16T19:41:00.986814+0000","last_clean":"2023-10-16T19:41:00.986814+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T19:41:00.986814+0000","last_undegraded":"2023-10-16T19:41:00.986814+0000","last_fullsized":"2023-10-16T19:41:00.986814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784889+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T19:41:00.784889+0000","last_peered":"2023-10-16T19:41:00.784889+0000","last_clean":"2023-10-16T19:41:00.784889+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T19:41:00.784889+0000","last_undegraded":"2023-10-16T19:41:00.784889+0000","last_fullsized":"2023-10-16T19:41:00.784889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981729+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T19:41:00.981729+0000","last_peered":"2023-10-16T19:41:00.981729+0000","last_clean":"2023-10-16T19:41:00.981729+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T19:41:00.981729+0000","last_undegraded":"2023-10-16T19:41:00.981729+0000","last_fullsized":"2023-10-16T19:41:00.981729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984167+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T19:41:00.984167+0000","last_peered":"2023-10-16T19:41:00.984167+0000","last_clean":"2023-10-16T19:41:00.984167+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T19:41:00.984167+0000","last_undegraded":"2023-10-16T19:41:00.984167+0000","last_fullsized":"2023-10-16T19:41:00.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745736+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T19:41:00.745736+0000","last_peered":"2023-10-16T19:41:00.745736+0000","last_clean":"2023-10-16T19:41:00.745736+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T19:41:00.745736+0000","last_undegraded":"2023-10-16T19:41:00.745736+0000","last_fullsized":"2023-10-16T19:41:00.745736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984540+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T19:41:00.984540+0000","last_peered":"2023-10-16T19:41:00.984540+0000","last_clean":"2023-10-16T19:41:00.984540+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T19:41:00.984540+0000","last_undegraded":"2023-10-16T19:41:00.984540+0000","last_fullsized":"2023-10-16T19:41:00.984540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987728+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T19:41:00.987728+0000","last_peered":"2023-10-16T19:41:00.987728+0000","last_clean":"2023-10-16T19:41:00.987728+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T19:41:00.987728+0000","last_undegraded":"2023-10-16T19:41:00.987728+0000","last_fullsized":"2023-10-16T19:41:00.987728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.878158+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T19:41:00.878158+0000","last_peered":"2023-10-16T19:41:00.878158+0000","last_clean":"2023-10-16T19:41:00.878158+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T19:41:00.878158+0000","last_undegraded":"2023-10-16T19:41:00.878158+0000","last_fullsized":"2023-10-16T19:41:00.878158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813704+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T19:41:00.813704+0000","last_peered":"2023-10-16T19:41:00.813704+0000","last_clean":"2023-10-16T19:41:00.813704+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T19:41:00.813704+0000","last_undegraded":"2023-10-16T19:41:00.813704+0000","last_fullsized":"2023-10-16T19:41:00.813704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986380+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T19:41:00.986380+0000","last_peered":"2023-10-16T19:41:00.986380+0000","last_clean":"2023-10-16T19:41:00.986380+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T19:41:00.986380+0000","last_undegraded":"2023-10-16T19:41:00.986380+0000","last_fullsized":"2023-10-16T19:41:00.986380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983531+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T19:41:00.983531+0000","last_peered":"2023-10-16T19:41:00.983531+0000","last_clean":"2023-10-16T19:41:00.983531+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T19:41:00.983531+0000","last_undegraded":"2023-10-16T19:41:00.983531+0000","last_fullsized":"2023-10-16T19:41:00.983531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985539+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T19:41:00.985539+0000","last_peered":"2023-10-16T19:41:00.985539+0000","last_clean":"2023-10-16T19:41:00.985539+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T19:41:00.985539+0000","last_undegraded":"2023-10-16T19:41:00.985539+0000","last_fullsized":"2023-10-16T19:41:00.985539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981092+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T19:41:00.981092+0000","last_peered":"2023-10-16T19:41:00.981092+0000","last_clean":"2023-10-16T19:41:00.981092+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T19:41:00.981092+0000","last_undegraded":"2023-10-16T19:41:00.981092+0000","last_fullsized":"2023-10-16T19:41:00.981092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984894+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T19:41:00.984894+0000","last_peered":"2023-10-16T19:41:00.984894+0000","last_clean":"2023-10-16T19:41:00.984894+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T19:41:00.984894+0000","last_undegraded":"2023-10-16T19:41:00.984894+0000","last_fullsized":"2023-10-16T19:41:00.984894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T19:41:00.982954+0000","last_peered":"2023-10-16T19:41:00.982954+0000","last_clean":"2023-10-16T19:41:00.982954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T19:41:00.982954+0000","last_undegraded":"2023-10-16T19:41:00.982954+0000","last_fullsized":"2023-10-16T19:41:00.982954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985192+0000","last_change":"2023-10-16T19:40:59.212253+0000","last_active":"2023-10-16T19:41:00.985192+0000","last_peered":"2023-10-16T19:41:00.985192+0000","last_clean":"2023-10-16T19:41:00.985192+0000","last_became_active":"2023-10-16T19:40:59.210602+0000","last_became_peered":"2023-10-16T19:40:59.210602+0000","last_unstale":"2023-10-16T19:41:00.985192+0000","last_undegraded":"2023-10-16T19:41:00.985192+0000","last_fullsized":"2023-10-16T19:41:00.985192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746131+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T19:41:00.746131+0000","last_peered":"2023-10-16T19:41:00.746131+0000","last_clean":"2023-10-16T19:41:00.746131+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T19:41:00.746131+0000","last_undegraded":"2023-10-16T19:41:00.746131+0000","last_fullsized":"2023-10-16T19:41:00.746131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982276+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T19:41:00.982276+0000","last_peered":"2023-10-16T19:41:00.982276+0000","last_clean":"2023-10-16T19:41:00.982276+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T19:41:00.982276+0000","last_undegraded":"2023-10-16T19:41:00.982276+0000","last_fullsized":"2023-10-16T19:41:00.982276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983687+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T19:41:00.983687+0000","last_peered":"2023-10-16T19:41:00.983687+0000","last_clean":"2023-10-16T19:41:00.983687+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T19:41:00.983687+0000","last_undegraded":"2023-10-16T19:41:00.983687+0000","last_fullsized":"2023-10-16T19:41:00.983687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985872+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T19:41:00.985872+0000","last_peered":"2023-10-16T19:41:00.985872+0000","last_clean":"2023-10-16T19:41:00.985872+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T19:41:00.985872+0000","last_undegraded":"2023-10-16T19:41:00.985872+0000","last_fullsized":"2023-10-16T19:41:00.985872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.877995+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T19:41:00.877995+0000","last_peered":"2023-10-16T19:41:00.877995+0000","last_clean":"2023-10-16T19:41:00.877995+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T19:41:00.877995+0000","last_undegraded":"2023-10-16T19:41:00.877995+0000","last_fullsized":"2023-10-16T19:41:00.877995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984086+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T19:41:00.984086+0000","last_peered":"2023-10-16T19:41:00.984086+0000","last_clean":"2023-10-16T19:41:00.984086+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T19:41:00.984086+0000","last_undegraded":"2023-10-16T19:41:00.984086+0000","last_fullsized":"2023-10-16T19:41:00.984086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.783983+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T19:41:00.783983+0000","last_peered":"2023-10-16T19:41:00.783983+0000","last_clean":"2023-10-16T19:41:00.783983+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T19:41:00.783983+0000","last_undegraded":"2023-10-16T19:41:00.783983+0000","last_fullsized":"2023-10-16T19:41:00.783983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.837461+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T19:41:08.837461+0000","last_peered":"2023-10-16T19:41:08.837461+0000","last_clean":"2023-10-16T19:41:08.837461+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T19:41:08.837461+0000","last_undegraded":"2023-10-16T19:41:08.837461+0000","last_fullsized":"2023-10-16T19:41:08.837461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983824+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T19:41:00.983824+0000","last_peered":"2023-10-16T19:41:00.983824+0000","last_clean":"2023-10-16T19:41:00.983824+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T19:41:00.983824+0000","last_undegraded":"2023-10-16T19:41:00.983824+0000","last_fullsized":"2023-10-16T19:41:00.983824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.965434+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T19:41:18.965434+0000","last_peered":"2023-10-16T19:41:18.965434+0000","last_clean":"2023-10-16T19:41:18.965434+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T19:41:18.965434+0000","last_undegraded":"2023-10-16T19:41:18.965434+0000","last_fullsized":"2023-10-16T19:41:18.965434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.777778+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T19:41:15.777778+0000","last_peered":"2023-10-16T19:41:15.777778+0000","last_clean":"2023-10-16T19:41:15.777778+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T19:41:15.777778+0000","last_undegraded":"2023-10-16T19:41:15.777778+0000","last_fullsized":"2023-10-16T19:41:15.777778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981065+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T19:41:00.981065+0000","last_peered":"2023-10-16T19:41:00.981065+0000","last_clean":"2023-10-16T19:41:00.981065+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T19:41:00.981065+0000","last_undegraded":"2023-10-16T19:41:00.981065+0000","last_fullsized":"2023-10-16T19:41:00.981065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.816951+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T19:41:08.816951+0000","last_peered":"2023-10-16T19:41:08.816951+0000","last_clean":"2023-10-16T19:41:08.816951+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T19:41:08.816951+0000","last_undegraded":"2023-10-16T19:41:08.816951+0000","last_fullsized":"2023-10-16T19:41:08.816951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745738+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T19:41:00.745738+0000","last_peered":"2023-10-16T19:41:00.745738+0000","last_clean":"2023-10-16T19:41:00.745738+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T19:41:00.745738+0000","last_undegraded":"2023-10-16T19:41:00.745738+0000","last_fullsized":"2023-10-16T19:41:00.745738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.746658+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T19:41:08.746658+0000","last_peered":"2023-10-16T19:41:08.746658+0000","last_clean":"2023-10-16T19:41:08.746658+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T19:41:08.746658+0000","last_undegraded":"2023-10-16T19:41:08.746658+0000","last_fullsized":"2023-10-16T19:41:08.746658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985111+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T19:41:00.985111+0000","last_peered":"2023-10-16T19:41:00.985111+0000","last_clean":"2023-10-16T19:41:00.985111+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T19:41:00.985111+0000","last_undegraded":"2023-10-16T19:41:00.985111+0000","last_fullsized":"2023-10-16T19:41:00.985111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.817526+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T19:41:08.817526+0000","last_peered":"2023-10-16T19:41:08.817526+0000","last_clean":"2023-10-16T19:41:08.817526+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T19:41:08.817526+0000","last_undegraded":"2023-10-16T19:41:08.817526+0000","last_fullsized":"2023-10-16T19:41:08.817526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984320+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T19:41:00.984320+0000","last_peered":"2023-10-16T19:41:00.984320+0000","last_clean":"2023-10-16T19:41:00.984320+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T19:41:00.984320+0000","last_undegraded":"2023-10-16T19:41:00.984320+0000","last_fullsized":"2023-10-16T19:41:00.984320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.669931+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T19:41:08.669931+0000","last_peered":"2023-10-16T19:41:08.669931+0000","last_clean":"2023-10-16T19:41:08.669931+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T19:41:08.669931+0000","last_undegraded":"2023-10-16T19:41:08.669931+0000","last_fullsized":"2023-10-16T19:41:08.669931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784901+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T19:41:00.784901+0000","last_peered":"2023-10-16T19:41:00.784901+0000","last_clean":"2023-10-16T19:41:00.784901+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T19:41:00.784901+0000","last_undegraded":"2023-10-16T19:41:00.784901+0000","last_fullsized":"2023-10-16T19:41:00.784901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.742636+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T19:41:08.742636+0000","last_peered":"2023-10-16T19:41:08.742636+0000","last_clean":"2023-10-16T19:41:08.742636+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T19:41:08.742636+0000","last_undegraded":"2023-10-16T19:41:08.742636+0000","last_fullsized":"2023-10-16T19:41:08.742636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813276+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T19:41:00.813276+0000","last_peered":"2023-10-16T19:41:00.813276+0000","last_clean":"2023-10-16T19:41:00.813276+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T19:41:00.813276+0000","last_undegraded":"2023-10-16T19:41:00.813276+0000","last_fullsized":"2023-10-16T19:41:00.813276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.988421+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T19:41:15.988421+0000","last_peered":"2023-10-16T19:41:15.988421+0000","last_clean":"2023-10-16T19:41:15.988421+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T19:41:15.988421+0000","last_undegraded":"2023-10-16T19:41:15.988421+0000","last_fullsized":"2023-10-16T19:41:15.988421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984550+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T19:41:00.984550+0000","last_peered":"2023-10-16T19:41:00.984550+0000","last_clean":"2023-10-16T19:41:00.984550+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T19:41:00.984550+0000","last_undegraded":"2023-10-16T19:41:00.984550+0000","last_fullsized":"2023-10-16T19:41:00.984550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.818520+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T19:41:08.818520+0000","last_peered":"2023-10-16T19:41:08.818520+0000","last_clean":"2023-10-16T19:41:08.818520+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T19:41:08.818520+0000","last_undegraded":"2023-10-16T19:41:08.818520+0000","last_fullsized":"2023-10-16T19:41:08.818520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813025+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T19:41:00.813025+0000","last_peered":"2023-10-16T19:41:00.813025+0000","last_clean":"2023-10-16T19:41:00.813025+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T19:41:00.813025+0000","last_undegraded":"2023-10-16T19:41:00.813025+0000","last_fullsized":"2023-10-16T19:41:00.813025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.963752+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T19:41:18.963752+0000","last_peered":"2023-10-16T19:41:18.963752+0000","last_clean":"2023-10-16T19:41:18.963752+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T19:41:18.963752+0000","last_undegraded":"2023-10-16T19:41:18.963752+0000","last_fullsized":"2023-10-16T19:41:18.963752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984443+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T19:41:00.984443+0000","last_peered":"2023-10-16T19:41:00.984443+0000","last_clean":"2023-10-16T19:41:00.984443+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T19:41:00.984443+0000","last_undegraded":"2023-10-16T19:41:00.984443+0000","last_fullsized":"2023-10-16T19:41:00.984443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'16","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.986888+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T19:41:15.986888+0000","last_peered":"2023-10-16T19:41:15.986888+0000","last_clean":"2023-10-16T19:41:15.986888+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T19:41:15.986888+0000","last_undegraded":"2023-10-16T19:41:15.986888+0000","last_fullsized":"2023-10-16T19:41:15.986888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812555+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T19:41:00.812555+0000","last_peered":"2023-10-16T19:41:00.812555+0000","last_clean":"2023-10-16T19:41:00.812555+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T19:41:00.812555+0000","last_undegraded":"2023-10-16T19:41:00.812555+0000","last_fullsized":"2023-10-16T19:41:00.812555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:01.937048+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T19:41:01.937048+0000","last_peered":"2023-10-16T19:41:01.937048+0000","last_clean":"2023-10-16T19:41:01.937048+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T19:41:01.937048+0000","last_undegraded":"2023-10-16T19:41:01.937048+0000","last_fullsized":"2023-10-16T19:41:01.937048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813811+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T19:41:00.813811+0000","last_peered":"2023-10-16T19:41:00.813811+0000","last_clean":"2023-10-16T19:41:00.813811+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T19:41:00.813811+0000","last_undegraded":"2023-10-16T19:41:00.813811+0000","last_fullsized":"2023-10-16T19:41:00.813811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.122782+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T19:41:02.122782+0000","last_peered":"2023-10-16T19:41:02.122782+0000","last_clean":"2023-10-16T19:41:02.122782+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T19:41:02.122782+0000","last_undegraded":"2023-10-16T19:41:02.122782+0000","last_fullsized":"2023-10-16T19:41:02.122782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814249+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T19:41:00.814249+0000","last_peered":"2023-10-16T19:41:00.814249+0000","last_clean":"2023-10-16T19:41:00.814249+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T19:41:00.814249+0000","last_undegraded":"2023-10-16T19:41:00.814249+0000","last_fullsized":"2023-10-16T19:41:00.814249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.098694+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T19:41:19.098694+0000","last_peered":"2023-10-16T19:41:19.098694+0000","last_clean":"2023-10-16T19:41:19.098694+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T19:41:19.098694+0000","last_undegraded":"2023-10-16T19:41:19.098694+0000","last_fullsized":"2023-10-16T19:41:19.098694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986392+0000","last_change":"2023-10-16T19:40:59.156646+0000","last_active":"2023-10-16T19:41:00.986392+0000","last_peered":"2023-10-16T19:41:00.986392+0000","last_clean":"2023-10-16T19:41:00.986392+0000","last_became_active":"2023-10-16T19:40:59.156121+0000","last_became_peered":"2023-10-16T19:40:59.156121+0000","last_unstale":"2023-10-16T19:41:00.986392+0000","last_undegraded":"2023-10-16T19:41:00.986392+0000","last_fullsized":"2023-10-16T19:41:00.986392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.065069+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T19:41:19.065069+0000","last_peered":"2023-10-16T19:41:19.065069+0000","last_clean":"2023-10-16T19:41:19.065069+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T19:41:19.065069+0000","last_undegraded":"2023-10-16T19:41:19.065069+0000","last_fullsized":"2023-10-16T19:41:19.065069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813302+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T19:41:00.813302+0000","last_peered":"2023-10-16T19:41:00.813302+0000","last_clean":"2023-10-16T19:41:00.813302+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T19:41:00.813302+0000","last_undegraded":"2023-10-16T19:41:00.813302+0000","last_fullsized":"2023-10-16T19:41:00.813302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.500181+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T19:40:59.500181+0000","last_peered":"2023-10-16T19:40:59.500181+0000","last_clean":"2023-10-16T19:40:59.500181+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T19:40:59.500181+0000","last_undegraded":"2023-10-16T19:40:59.500181+0000","last_fullsized":"2023-10-16T19:40:59.500181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.091056+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T19:41:19.091056+0000","last_peered":"2023-10-16T19:41:19.091056+0000","last_clean":"2023-10-16T19:41:19.091056+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T19:41:19.091056+0000","last_undegraded":"2023-10-16T19:41:19.091056+0000","last_fullsized":"2023-10-16T19:41:19.091056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981457+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T19:41:00.981457+0000","last_peered":"2023-10-16T19:41:00.981457+0000","last_clean":"2023-10-16T19:41:00.981457+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T19:41:00.981457+0000","last_undegraded":"2023-10-16T19:41:00.981457+0000","last_fullsized":"2023-10-16T19:41:00.981457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.769883+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T19:41:15.769883+0000","last_peered":"2023-10-16T19:41:15.769883+0000","last_clean":"2023-10-16T19:41:15.769883+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T19:41:15.769883+0000","last_undegraded":"2023-10-16T19:41:15.769883+0000","last_fullsized":"2023-10-16T19:41:15.769883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983753+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T19:41:00.983753+0000","last_peered":"2023-10-16T19:41:00.983753+0000","last_clean":"2023-10-16T19:41:00.983753+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T19:41:00.983753+0000","last_undegraded":"2023-10-16T19:41:00.983753+0000","last_fullsized":"2023-10-16T19:41:00.983753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.982142+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T19:41:15.982142+0000","last_peered":"2023-10-16T19:41:15.982142+0000","last_clean":"2023-10-16T19:41:15.982142+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T19:41:15.982142+0000","last_undegraded":"2023-10-16T19:41:15.982142+0000","last_fullsized":"2023-10-16T19:41:15.982142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745727+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T19:41:00.745727+0000","last_peered":"2023-10-16T19:41:00.745727+0000","last_clean":"2023-10-16T19:41:00.745727+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T19:41:00.745727+0000","last_undegraded":"2023-10-16T19:41:00.745727+0000","last_fullsized":"2023-10-16T19:41:00.745727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986414+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T19:41:00.986414+0000","last_peered":"2023-10-16T19:41:00.986414+0000","last_clean":"2023-10-16T19:41:00.986414+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T19:41:00.986414+0000","last_undegraded":"2023-10-16T19:41:00.986414+0000","last_fullsized":"2023-10-16T19:41:00.986414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784673+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T19:41:00.784673+0000","last_peered":"2023-10-16T19:41:00.784673+0000","last_clean":"2023-10-16T19:41:00.784673+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T19:41:00.784673+0000","last_undegraded":"2023-10-16T19:41:00.784673+0000","last_fullsized":"2023-10-16T19:41:00.784673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746231+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T19:41:00.746231+0000","last_peered":"2023-10-16T19:41:00.746231+0000","last_clean":"2023-10-16T19:41:00.746231+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T19:41:00.746231+0000","last_undegraded":"2023-10-16T19:41:00.746231+0000","last_fullsized":"2023-10-16T19:41:00.746231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987116+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T19:41:00.987116+0000","last_peered":"2023-10-16T19:41:00.987116+0000","last_clean":"2023-10-16T19:41:00.987116+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T19:41:00.987116+0000","last_undegraded":"2023-10-16T19:41:00.987116+0000","last_fullsized":"2023-10-16T19:41:00.987116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.109233+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T19:41:19.109233+0000","last_peered":"2023-10-16T19:41:19.109233+0000","last_clean":"2023-10-16T19:41:19.109233+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T19:41:19.109233+0000","last_undegraded":"2023-10-16T19:41:19.109233+0000","last_fullsized":"2023-10-16T19:41:19.109233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746157+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T19:41:00.746157+0000","last_peered":"2023-10-16T19:41:00.746157+0000","last_clean":"2023-10-16T19:41:00.746157+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T19:41:00.746157+0000","last_undegraded":"2023-10-16T19:41:00.746157+0000","last_fullsized":"2023-10-16T19:41:00.746157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.102565+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T19:41:19.102565+0000","last_peered":"2023-10-16T19:41:19.102565+0000","last_clean":"2023-10-16T19:41:19.102565+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T19:41:19.102565+0000","last_undegraded":"2023-10-16T19:41:19.102565+0000","last_fullsized":"2023-10-16T19:41:19.102565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982757+0000","last_change":"2023-10-16T19:40:59.119901+0000","last_active":"2023-10-16T19:41:00.982757+0000","last_peered":"2023-10-16T19:41:00.982757+0000","last_clean":"2023-10-16T19:41:00.982757+0000","last_became_active":"2023-10-16T19:40:59.118945+0000","last_became_peered":"2023-10-16T19:40:59.118945+0000","last_unstale":"2023-10-16T19:41:00.982757+0000","last_undegraded":"2023-10-16T19:41:00.982757+0000","last_fullsized":"2023-10-16T19:41:00.982757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.744993+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T19:41:08.744993+0000","last_peered":"2023-10-16T19:41:08.744993+0000","last_clean":"2023-10-16T19:41:08.744993+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T19:41:08.744993+0000","last_undegraded":"2023-10-16T19:41:08.744993+0000","last_fullsized":"2023-10-16T19:41:08.744993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983472+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T19:41:00.983472+0000","last_peered":"2023-10-16T19:41:00.983472+0000","last_clean":"2023-10-16T19:41:00.983472+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T19:41:00.983472+0000","last_undegraded":"2023-10-16T19:41:00.983472+0000","last_fullsized":"2023-10-16T19:41:00.983472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.665285+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T19:41:08.665285+0000","last_peered":"2023-10-16T19:41:08.665285+0000","last_clean":"2023-10-16T19:41:08.665285+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T19:41:08.665285+0000","last_undegraded":"2023-10-16T19:41:08.665285+0000","last_fullsized":"2023-10-16T19:41:08.665285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784318+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T19:41:00.784318+0000","last_peered":"2023-10-16T19:41:00.784318+0000","last_clean":"2023-10-16T19:41:00.784318+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T19:41:00.784318+0000","last_undegraded":"2023-10-16T19:41:00.784318+0000","last_fullsized":"2023-10-16T19:41:00.784318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:21.992040+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T19:41:21.992040+0000","last_peered":"2023-10-16T19:41:21.992040+0000","last_clean":"2023-10-16T19:41:21.992040+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T19:41:21.992040+0000","last_undegraded":"2023-10-16T19:41:21.992040+0000","last_fullsized":"2023-10-16T19:41:21.992040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981209+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T19:41:00.981209+0000","last_peered":"2023-10-16T19:41:00.981209+0000","last_clean":"2023-10-16T19:41:00.981209+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T19:41:00.981209+0000","last_undegraded":"2023-10-16T19:41:00.981209+0000","last_fullsized":"2023-10-16T19:41:00.981209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.371389+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T19:41:18.371389+0000","last_peered":"2023-10-16T19:41:18.371389+0000","last_clean":"2023-10-16T19:41:18.371389+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T19:41:18.371389+0000","last_undegraded":"2023-10-16T19:41:18.371389+0000","last_fullsized":"2023-10-16T19:41:18.371389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981819+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T19:41:00.981819+0000","last_peered":"2023-10-16T19:41:00.981819+0000","last_clean":"2023-10-16T19:41:00.981819+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T19:41:00.981819+0000","last_undegraded":"2023-10-16T19:41:00.981819+0000","last_fullsized":"2023-10-16T19:41:00.981819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.668394+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T19:41:08.668394+0000","last_peered":"2023-10-16T19:41:08.668394+0000","last_clean":"2023-10-16T19:41:08.668394+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T19:41:08.668394+0000","last_undegraded":"2023-10-16T19:41:08.668394+0000","last_fullsized":"2023-10-16T19:41:08.668394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985755+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T19:41:00.985755+0000","last_peered":"2023-10-16T19:41:00.985755+0000","last_clean":"2023-10-16T19:41:00.985755+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T19:41:00.985755+0000","last_undegraded":"2023-10-16T19:41:00.985755+0000","last_fullsized":"2023-10-16T19:41:00.985755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986953+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T19:41:00.986953+0000","last_peered":"2023-10-16T19:41:00.986953+0000","last_clean":"2023-10-16T19:41:00.986953+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T19:41:00.986953+0000","last_undegraded":"2023-10-16T19:41:00.986953+0000","last_fullsized":"2023-10-16T19:41:00.986953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.044274+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T19:41:02.044274+0000","last_peered":"2023-10-16T19:41:02.044274+0000","last_clean":"2023-10-16T19:41:02.044274+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T19:41:02.044274+0000","last_undegraded":"2023-10-16T19:41:02.044274+0000","last_fullsized":"2023-10-16T19:41:02.044274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986108+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T19:41:00.986108+0000","last_peered":"2023-10-16T19:41:00.986108+0000","last_clean":"2023-10-16T19:41:00.986108+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T19:41:00.986108+0000","last_undegraded":"2023-10-16T19:41:00.986108+0000","last_fullsized":"2023-10-16T19:41:00.986108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.108108+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T19:41:19.108108+0000","last_peered":"2023-10-16T19:41:19.108108+0000","last_clean":"2023-10-16T19:41:19.108108+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T19:41:19.108108+0000","last_undegraded":"2023-10-16T19:41:19.108108+0000","last_fullsized":"2023-10-16T19:41:19.108108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984216+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T19:41:00.984216+0000","last_peered":"2023-10-16T19:41:00.984216+0000","last_clean":"2023-10-16T19:41:00.984216+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T19:41:00.984216+0000","last_undegraded":"2023-10-16T19:41:00.984216+0000","last_fullsized":"2023-10-16T19:41:00.984216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.126623+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T19:41:02.126623+0000","last_peered":"2023-10-16T19:41:02.126623+0000","last_clean":"2023-10-16T19:41:02.126623+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T19:41:02.126623+0000","last_undegraded":"2023-10-16T19:41:02.126623+0000","last_fullsized":"2023-10-16T19:41:02.126623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982817+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T19:41:00.982817+0000","last_peered":"2023-10-16T19:41:00.982817+0000","last_clean":"2023-10-16T19:41:00.982817+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T19:41:00.982817+0000","last_undegraded":"2023-10-16T19:41:00.982817+0000","last_fullsized":"2023-10-16T19:41:00.982817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'11","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.955554+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T19:41:18.955554+0000","last_peered":"2023-10-16T19:41:18.955554+0000","last_clean":"2023-10-16T19:41:18.955554+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T19:41:18.955554+0000","last_undegraded":"2023-10-16T19:41:18.955554+0000","last_fullsized":"2023-10-16T19:41:18.955554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6628,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":13844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":675428,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":86124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":86450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0659999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.897}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]}]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":86136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":85128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":674784,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":85052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":85254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:23.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:24.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.242+0000 7f01fff39640 1 Processor -- start 2023-10-16T19:41:24.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.242+0000 7f01fff39640 1 -- start start 2023-10-16T19:41:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.244+0000 7f01fff39640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01f815d1c0 0x7f01f8159a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.244+0000 7f01fff39640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f815cd30 con 0x7f01f80c52e0 2023-10-16T19:41:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.244+0000 7f01fff39640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f80c78f0 con 0x7f01f8153110 2023-10-16T19:41:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.244+0000 7f01fff39640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f80c6250 con 0x7f01f815d1c0 2023-10-16T19:41:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.250+0000 7f01fe4d6640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f01f80c52e0 0x7f01f80c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51332/0 (socket says 172.21.15.57:51332) 2023-10-16T19:41:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.250+0000 7f01fe4d6640 1 -- 172.21.15.57:0/2107664015 learned_addr learned my addr 172.21.15.57:0/2107664015 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:24.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.263+0000 7f01fd4d4640 1 --2- 172.21.15.57:0/2107664015 >> v2:172.21.15.110:3300/0 conn(0x7f01f815d1c0 0x7f01f8159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.275+0000 7f01fd4d4640 1 -- 172.21.15.57:0/2107664015 >> v1:172.21.15.110:6789/0 conn(0x7f01f8153110 legacy=0x7f01f80bc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.275+0000 7f01fd4d4640 1 -- 172.21.15.57:0/2107664015 >> v1:172.21.15.57:6789/0 conn(0x7f01f80c52e0 legacy=0x7f01f80c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.276+0000 7f01fd4d4640 1 -- 172.21.15.57:0/2107664015 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80c5c90 con 0x7f01f815d1c0 2023-10-16T19:41:24.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.285+0000 7f01fd4d4640 1 --2- 172.21.15.57:0/2107664015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f815d1c0 0x7f01f8159a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01e80097a0 tx=0x7f01e802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=184c1ac8f7b4f3ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.466+0000 7f01fccd3640 1 -- 172.21.15.57:0/2107664015 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e802f810 con 0x7f01f815d1c0 2023-10-16T19:41:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.466+0000 7f01fccd3640 1 -- 172.21.15.57:0/2107664015 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e802f970 con 0x7f01f815d1c0 2023-10-16T19:41:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.466+0000 7f01fccd3640 1 -- 172.21.15.57:0/2107664015 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e802fd00 con 0x7f01f815d1c0 2023-10-16T19:41:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.467+0000 7f01fff39640 1 -- 172.21.15.57:0/2107664015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f815d1c0 msgr2=0x7f01f8159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.467+0000 7f01fff39640 1 --2- 172.21.15.57:0/2107664015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f815d1c0 0x7f01f8159a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01e80097a0 tx=0x7f01e802b9f0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.467+0000 7f01fff39640 1 -- 172.21.15.57:0/2107664015 shutdown_connections 2023-10-16T19:41:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.467+0000 7f01fff39640 1 --2- 172.21.15.57:0/2107664015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f815d1c0 0x7f01f8159a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.467+0000 7f01fff39640 1 -- 172.21.15.57:0/2107664015 >> 172.21.15.57:0/2107664015 conn(0x7f01f806c430 msgr2=0x7f01f8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.468+0000 7f01fff39640 1 -- 172.21.15.57:0/2107664015 shutdown_connections 2023-10-16T19:41:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.468+0000 7f01fff39640 1 -- 172.21.15.57:0/2107664015 wait complete. 2023-10-16T19:41:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.471+0000 7f01fff39640 1 Processor -- start 2023-10-16T19:41:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.472+0000 7f01fff39640 1 -- start start 2023-10-16T19:41:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.474+0000 7f01fff39640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f80c52e0 0x7f01f81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.474+0000 7f01fff39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f8153110 0x7f01f81474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.474+0000 7f01fff39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 0x7f01f806d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.474+0000 7f01fff39640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815ac80 con 0x7f01f815d1c0 2023-10-16T19:41:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.474+0000 7f01fff39640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f81eebd0 con 0x7f01f8153110 2023-10-16T19:41:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.474+0000 7f01fff39640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815aa10 con 0x7f01f80c52e0 2023-10-16T19:41:24.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.475+0000 7f01fe4d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 0x7f01f806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.476+0000 7f01fe4d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 0x7f01f806d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56712/0 (socket says 172.21.15.57:56712) 2023-10-16T19:41:24.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.476+0000 7f01fe4d6640 1 -- 172.21.15.57:0/1763715020 learned_addr learned my addr 172.21.15.57:0/1763715020 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:24.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.480+0000 7f01fe4d6640 1 -- 172.21.15.57:0/1763715020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f80c52e0 msgr2=0x7f01f81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.480+0000 7f01fe4d6640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f80c52e0 0x7f01f81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.480+0000 7f01fe4d6640 1 -- 172.21.15.57:0/1763715020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f8153110 msgr2=0x7f01f81474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.480+0000 7f01fe4d6640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f8153110 0x7f01f81474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.480+0000 7f01fe4d6640 1 -- 172.21.15.57:0/1763715020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8009400 con 0x7f01f815d1c0 2023-10-16T19:41:24.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.483+0000 7f01fe4d6640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 0x7f01f806d800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f01f000cbc0 tx=0x7f01f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.488+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000ad40 con 0x7f01f815d1c0 2023-10-16T19:41:24.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.488+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0012400 con 0x7f01f815d1c0 2023-10-16T19:41:24.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.489+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f8148720 con 0x7f01f815d1c0 2023-10-16T19:41:24.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.489+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000aea0 con 0x7f01f815d1c0 2023-10-16T19:41:24.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.489+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f81ee860 con 0x7f01f815d1c0 2023-10-16T19:41:24.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.490+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f81ee3e0 con 0x7f01f815d1c0 2023-10-16T19:41:24.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.773+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f01f0007070 con 0x7f01f815d1c0 2023-10-16T19:41:24.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.775+0000 7f01ee7fc640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01dc06aef0 0x7f01dc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.776+0000 7f01fdcd5640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01dc06aef0 0x7f01dc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.777+0000 7f01fdcd5640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01dc06aef0 0x7f01dc06d3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000f60 tx=0x7f01f40079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.794+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f01f0058680 con 0x7f01f815d1c0 2023-10-16T19:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:24.795+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01f0058450 con 0x7f01f815d1c0 2023-10-16T19:41:25.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.019+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01f815c6e0 con 0x7f01dc06aef0 2023-10-16T19:41:25.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.029+0000 7f01ee7fc640 1 -- 172.21.15.57:0/1763715020 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264618 (secure 0 0 0) 0x7f01f4005080 con 0x7f01dc06aef0 2023-10-16T19:41:25.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T19:41:25.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01dc06aef0 msgr2=0x7f01dc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01dc06aef0 0x7f01dc06d3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000f60 tx=0x7f01f40079b0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 msgr2=0x7f01f806d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 0x7f01f806d800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f01f000cbc0 tx=0x7f01f000a430 comp rx=0 tx=0).stop 2023-10-16T19:41:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 shutdown_connections 2023-10-16T19:41:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01dc06aef0 0x7f01dc06d3b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f815d1c0 0x7f01f806d800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f8153110 0x7f01f81474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 --2- 172.21.15.57:0/1763715020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f80c52e0 0x7f01f81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.034+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 >> 172.21.15.57:0/1763715020 conn(0x7f01f806c430 msgr2=0x7f01f80cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.035+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 shutdown_connections 2023-10-16T19:41:25.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.035+0000 7f01fff39640 1 -- 172.21.15.57:0/1763715020 wait complete. 2023-10-16T19:41:25.058 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-10-16T19:41:24.470835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596996,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":326,"num_write_kb":2466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":263,"ondisk_log_size":263,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230772,"kb_used_data":2164,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743948,"statfs":{"total":773094113280,"available":772857802752,"internally_reserved":0,"allocated":2215936,"data_stored":1864356,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":234016312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.023469"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813951+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T19:41:00.813951+0000","last_peered":"2023-10-16T19:41:00.813951+0000","last_clean":"2023-10-16T19:41:00.813951+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T19:41:00.813951+0000","last_undegraded":"2023-10-16T19:41:00.813951+0000","last_fullsized":"2023-10-16T19:41:00.813951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746317+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T19:41:00.746317+0000","last_peered":"2023-10-16T19:41:00.746317+0000","last_clean":"2023-10-16T19:41:00.746317+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T19:41:00.746317+0000","last_undegraded":"2023-10-16T19:41:00.746317+0000","last_fullsized":"2023-10-16T19:41:00.746317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983894+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T19:41:00.983894+0000","last_peered":"2023-10-16T19:41:00.983894+0000","last_clean":"2023-10-16T19:41:00.983894+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T19:41:00.983894+0000","last_undegraded":"2023-10-16T19:41:00.983894+0000","last_fullsized":"2023-10-16T19:41:00.983894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985780+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T19:41:00.985780+0000","last_peered":"2023-10-16T19:41:00.985780+0000","last_clean":"2023-10-16T19:41:00.985780+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T19:41:00.985780+0000","last_undegraded":"2023-10-16T19:41:00.985780+0000","last_fullsized":"2023-10-16T19:41:00.985780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812868+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T19:41:00.812868+0000","last_peered":"2023-10-16T19:41:00.812868+0000","last_clean":"2023-10-16T19:41:00.812868+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T19:41:00.812868+0000","last_undegraded":"2023-10-16T19:41:00.812868+0000","last_fullsized":"2023-10-16T19:41:00.812868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985163+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T19:41:00.985163+0000","last_peered":"2023-10-16T19:41:00.985163+0000","last_clean":"2023-10-16T19:41:00.985163+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T19:41:00.985163+0000","last_undegraded":"2023-10-16T19:41:00.985163+0000","last_fullsized":"2023-10-16T19:41:00.985163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812522+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T19:41:00.812522+0000","last_peered":"2023-10-16T19:41:00.812522+0000","last_clean":"2023-10-16T19:41:00.812522+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T19:41:00.812522+0000","last_undegraded":"2023-10-16T19:41:00.812522+0000","last_fullsized":"2023-10-16T19:41:00.812522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981033+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T19:41:00.981033+0000","last_peered":"2023-10-16T19:41:00.981033+0000","last_clean":"2023-10-16T19:41:00.981033+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T19:41:00.981033+0000","last_undegraded":"2023-10-16T19:41:00.981033+0000","last_fullsized":"2023-10-16T19:41:00.981033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814034+0000","last_change":"2023-10-16T19:40:59.155274+0000","last_active":"2023-10-16T19:41:00.814034+0000","last_peered":"2023-10-16T19:41:00.814034+0000","last_clean":"2023-10-16T19:41:00.814034+0000","last_became_active":"2023-10-16T19:40:59.155045+0000","last_became_peered":"2023-10-16T19:40:59.155045+0000","last_unstale":"2023-10-16T19:41:00.814034+0000","last_undegraded":"2023-10-16T19:41:00.814034+0000","last_fullsized":"2023-10-16T19:41:00.814034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:09.928086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984830+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T19:41:00.984830+0000","last_peered":"2023-10-16T19:41:00.984830+0000","last_clean":"2023-10-16T19:41:00.984830+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T19:41:00.984830+0000","last_undegraded":"2023-10-16T19:41:00.984830+0000","last_fullsized":"2023-10-16T19:41:00.984830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986814+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T19:41:00.986814+0000","last_peered":"2023-10-16T19:41:00.986814+0000","last_clean":"2023-10-16T19:41:00.986814+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T19:41:00.986814+0000","last_undegraded":"2023-10-16T19:41:00.986814+0000","last_fullsized":"2023-10-16T19:41:00.986814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784889+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T19:41:00.784889+0000","last_peered":"2023-10-16T19:41:00.784889+0000","last_clean":"2023-10-16T19:41:00.784889+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T19:41:00.784889+0000","last_undegraded":"2023-10-16T19:41:00.784889+0000","last_fullsized":"2023-10-16T19:41:00.784889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981729+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T19:41:00.981729+0000","last_peered":"2023-10-16T19:41:00.981729+0000","last_clean":"2023-10-16T19:41:00.981729+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T19:41:00.981729+0000","last_undegraded":"2023-10-16T19:41:00.981729+0000","last_fullsized":"2023-10-16T19:41:00.981729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984167+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T19:41:00.984167+0000","last_peered":"2023-10-16T19:41:00.984167+0000","last_clean":"2023-10-16T19:41:00.984167+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T19:41:00.984167+0000","last_undegraded":"2023-10-16T19:41:00.984167+0000","last_fullsized":"2023-10-16T19:41:00.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745736+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T19:41:00.745736+0000","last_peered":"2023-10-16T19:41:00.745736+0000","last_clean":"2023-10-16T19:41:00.745736+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T19:41:00.745736+0000","last_undegraded":"2023-10-16T19:41:00.745736+0000","last_fullsized":"2023-10-16T19:41:00.745736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984540+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T19:41:00.984540+0000","last_peered":"2023-10-16T19:41:00.984540+0000","last_clean":"2023-10-16T19:41:00.984540+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T19:41:00.984540+0000","last_undegraded":"2023-10-16T19:41:00.984540+0000","last_fullsized":"2023-10-16T19:41:00.984540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987728+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T19:41:00.987728+0000","last_peered":"2023-10-16T19:41:00.987728+0000","last_clean":"2023-10-16T19:41:00.987728+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T19:41:00.987728+0000","last_undegraded":"2023-10-16T19:41:00.987728+0000","last_fullsized":"2023-10-16T19:41:00.987728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.878158+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T19:41:00.878158+0000","last_peered":"2023-10-16T19:41:00.878158+0000","last_clean":"2023-10-16T19:41:00.878158+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T19:41:00.878158+0000","last_undegraded":"2023-10-16T19:41:00.878158+0000","last_fullsized":"2023-10-16T19:41:00.878158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813704+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T19:41:00.813704+0000","last_peered":"2023-10-16T19:41:00.813704+0000","last_clean":"2023-10-16T19:41:00.813704+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T19:41:00.813704+0000","last_undegraded":"2023-10-16T19:41:00.813704+0000","last_fullsized":"2023-10-16T19:41:00.813704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986380+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T19:41:00.986380+0000","last_peered":"2023-10-16T19:41:00.986380+0000","last_clean":"2023-10-16T19:41:00.986380+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T19:41:00.986380+0000","last_undegraded":"2023-10-16T19:41:00.986380+0000","last_fullsized":"2023-10-16T19:41:00.986380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983531+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T19:41:00.983531+0000","last_peered":"2023-10-16T19:41:00.983531+0000","last_clean":"2023-10-16T19:41:00.983531+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T19:41:00.983531+0000","last_undegraded":"2023-10-16T19:41:00.983531+0000","last_fullsized":"2023-10-16T19:41:00.983531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985539+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T19:41:00.985539+0000","last_peered":"2023-10-16T19:41:00.985539+0000","last_clean":"2023-10-16T19:41:00.985539+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T19:41:00.985539+0000","last_undegraded":"2023-10-16T19:41:00.985539+0000","last_fullsized":"2023-10-16T19:41:00.985539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981092+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T19:41:00.981092+0000","last_peered":"2023-10-16T19:41:00.981092+0000","last_clean":"2023-10-16T19:41:00.981092+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T19:41:00.981092+0000","last_undegraded":"2023-10-16T19:41:00.981092+0000","last_fullsized":"2023-10-16T19:41:00.981092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984894+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T19:41:00.984894+0000","last_peered":"2023-10-16T19:41:00.984894+0000","last_clean":"2023-10-16T19:41:00.984894+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T19:41:00.984894+0000","last_undegraded":"2023-10-16T19:41:00.984894+0000","last_fullsized":"2023-10-16T19:41:00.984894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T19:41:00.982954+0000","last_peered":"2023-10-16T19:41:00.982954+0000","last_clean":"2023-10-16T19:41:00.982954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T19:41:00.982954+0000","last_undegraded":"2023-10-16T19:41:00.982954+0000","last_fullsized":"2023-10-16T19:41:00.982954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985192+0000","last_change":"2023-10-16T19:40:59.212253+0000","last_active":"2023-10-16T19:41:00.985192+0000","last_peered":"2023-10-16T19:41:00.985192+0000","last_clean":"2023-10-16T19:41:00.985192+0000","last_became_active":"2023-10-16T19:40:59.210602+0000","last_became_peered":"2023-10-16T19:40:59.210602+0000","last_unstale":"2023-10-16T19:41:00.985192+0000","last_undegraded":"2023-10-16T19:41:00.985192+0000","last_fullsized":"2023-10-16T19:41:00.985192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746131+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T19:41:00.746131+0000","last_peered":"2023-10-16T19:41:00.746131+0000","last_clean":"2023-10-16T19:41:00.746131+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T19:41:00.746131+0000","last_undegraded":"2023-10-16T19:41:00.746131+0000","last_fullsized":"2023-10-16T19:41:00.746131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982276+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T19:41:00.982276+0000","last_peered":"2023-10-16T19:41:00.982276+0000","last_clean":"2023-10-16T19:41:00.982276+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T19:41:00.982276+0000","last_undegraded":"2023-10-16T19:41:00.982276+0000","last_fullsized":"2023-10-16T19:41:00.982276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983687+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T19:41:00.983687+0000","last_peered":"2023-10-16T19:41:00.983687+0000","last_clean":"2023-10-16T19:41:00.983687+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T19:41:00.983687+0000","last_undegraded":"2023-10-16T19:41:00.983687+0000","last_fullsized":"2023-10-16T19:41:00.983687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985872+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T19:41:00.985872+0000","last_peered":"2023-10-16T19:41:00.985872+0000","last_clean":"2023-10-16T19:41:00.985872+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T19:41:00.985872+0000","last_undegraded":"2023-10-16T19:41:00.985872+0000","last_fullsized":"2023-10-16T19:41:00.985872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.877995+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T19:41:00.877995+0000","last_peered":"2023-10-16T19:41:00.877995+0000","last_clean":"2023-10-16T19:41:00.877995+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T19:41:00.877995+0000","last_undegraded":"2023-10-16T19:41:00.877995+0000","last_fullsized":"2023-10-16T19:41:00.877995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984086+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T19:41:00.984086+0000","last_peered":"2023-10-16T19:41:00.984086+0000","last_clean":"2023-10-16T19:41:00.984086+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T19:41:00.984086+0000","last_undegraded":"2023-10-16T19:41:00.984086+0000","last_fullsized":"2023-10-16T19:41:00.984086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.783983+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T19:41:00.783983+0000","last_peered":"2023-10-16T19:41:00.783983+0000","last_clean":"2023-10-16T19:41:00.783983+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T19:41:00.783983+0000","last_undegraded":"2023-10-16T19:41:00.783983+0000","last_fullsized":"2023-10-16T19:41:00.783983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.837461+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T19:41:08.837461+0000","last_peered":"2023-10-16T19:41:08.837461+0000","last_clean":"2023-10-16T19:41:08.837461+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T19:41:08.837461+0000","last_undegraded":"2023-10-16T19:41:08.837461+0000","last_fullsized":"2023-10-16T19:41:08.837461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983824+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T19:41:00.983824+0000","last_peered":"2023-10-16T19:41:00.983824+0000","last_clean":"2023-10-16T19:41:00.983824+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T19:41:00.983824+0000","last_undegraded":"2023-10-16T19:41:00.983824+0000","last_fullsized":"2023-10-16T19:41:00.983824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.965434+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T19:41:18.965434+0000","last_peered":"2023-10-16T19:41:18.965434+0000","last_clean":"2023-10-16T19:41:18.965434+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T19:41:18.965434+0000","last_undegraded":"2023-10-16T19:41:18.965434+0000","last_fullsized":"2023-10-16T19:41:18.965434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.777778+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T19:41:15.777778+0000","last_peered":"2023-10-16T19:41:15.777778+0000","last_clean":"2023-10-16T19:41:15.777778+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T19:41:15.777778+0000","last_undegraded":"2023-10-16T19:41:15.777778+0000","last_fullsized":"2023-10-16T19:41:15.777778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981065+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T19:41:00.981065+0000","last_peered":"2023-10-16T19:41:00.981065+0000","last_clean":"2023-10-16T19:41:00.981065+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T19:41:00.981065+0000","last_undegraded":"2023-10-16T19:41:00.981065+0000","last_fullsized":"2023-10-16T19:41:00.981065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.816951+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T19:41:08.816951+0000","last_peered":"2023-10-16T19:41:08.816951+0000","last_clean":"2023-10-16T19:41:08.816951+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T19:41:08.816951+0000","last_undegraded":"2023-10-16T19:41:08.816951+0000","last_fullsized":"2023-10-16T19:41:08.816951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745738+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T19:41:00.745738+0000","last_peered":"2023-10-16T19:41:00.745738+0000","last_clean":"2023-10-16T19:41:00.745738+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T19:41:00.745738+0000","last_undegraded":"2023-10-16T19:41:00.745738+0000","last_fullsized":"2023-10-16T19:41:00.745738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.746658+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T19:41:08.746658+0000","last_peered":"2023-10-16T19:41:08.746658+0000","last_clean":"2023-10-16T19:41:08.746658+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T19:41:08.746658+0000","last_undegraded":"2023-10-16T19:41:08.746658+0000","last_fullsized":"2023-10-16T19:41:08.746658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985111+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T19:41:00.985111+0000","last_peered":"2023-10-16T19:41:00.985111+0000","last_clean":"2023-10-16T19:41:00.985111+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T19:41:00.985111+0000","last_undegraded":"2023-10-16T19:41:00.985111+0000","last_fullsized":"2023-10-16T19:41:00.985111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.817526+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T19:41:08.817526+0000","last_peered":"2023-10-16T19:41:08.817526+0000","last_clean":"2023-10-16T19:41:08.817526+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T19:41:08.817526+0000","last_undegraded":"2023-10-16T19:41:08.817526+0000","last_fullsized":"2023-10-16T19:41:08.817526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984320+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T19:41:00.984320+0000","last_peered":"2023-10-16T19:41:00.984320+0000","last_clean":"2023-10-16T19:41:00.984320+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T19:41:00.984320+0000","last_undegraded":"2023-10-16T19:41:00.984320+0000","last_fullsized":"2023-10-16T19:41:00.984320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.669931+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T19:41:08.669931+0000","last_peered":"2023-10-16T19:41:08.669931+0000","last_clean":"2023-10-16T19:41:08.669931+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T19:41:08.669931+0000","last_undegraded":"2023-10-16T19:41:08.669931+0000","last_fullsized":"2023-10-16T19:41:08.669931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784901+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T19:41:00.784901+0000","last_peered":"2023-10-16T19:41:00.784901+0000","last_clean":"2023-10-16T19:41:00.784901+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T19:41:00.784901+0000","last_undegraded":"2023-10-16T19:41:00.784901+0000","last_fullsized":"2023-10-16T19:41:00.784901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.742636+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T19:41:08.742636+0000","last_peered":"2023-10-16T19:41:08.742636+0000","last_clean":"2023-10-16T19:41:08.742636+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T19:41:08.742636+0000","last_undegraded":"2023-10-16T19:41:08.742636+0000","last_fullsized":"2023-10-16T19:41:08.742636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813276+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T19:41:00.813276+0000","last_peered":"2023-10-16T19:41:00.813276+0000","last_clean":"2023-10-16T19:41:00.813276+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T19:41:00.813276+0000","last_undegraded":"2023-10-16T19:41:00.813276+0000","last_fullsized":"2023-10-16T19:41:00.813276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.988421+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T19:41:15.988421+0000","last_peered":"2023-10-16T19:41:15.988421+0000","last_clean":"2023-10-16T19:41:15.988421+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T19:41:15.988421+0000","last_undegraded":"2023-10-16T19:41:15.988421+0000","last_fullsized":"2023-10-16T19:41:15.988421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984550+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T19:41:00.984550+0000","last_peered":"2023-10-16T19:41:00.984550+0000","last_clean":"2023-10-16T19:41:00.984550+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T19:41:00.984550+0000","last_undegraded":"2023-10-16T19:41:00.984550+0000","last_fullsized":"2023-10-16T19:41:00.984550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.818520+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T19:41:08.818520+0000","last_peered":"2023-10-16T19:41:08.818520+0000","last_clean":"2023-10-16T19:41:08.818520+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T19:41:08.818520+0000","last_undegraded":"2023-10-16T19:41:08.818520+0000","last_fullsized":"2023-10-16T19:41:08.818520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813025+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T19:41:00.813025+0000","last_peered":"2023-10-16T19:41:00.813025+0000","last_clean":"2023-10-16T19:41:00.813025+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T19:41:00.813025+0000","last_undegraded":"2023-10-16T19:41:00.813025+0000","last_fullsized":"2023-10-16T19:41:00.813025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.963752+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T19:41:18.963752+0000","last_peered":"2023-10-16T19:41:18.963752+0000","last_clean":"2023-10-16T19:41:18.963752+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T19:41:18.963752+0000","last_undegraded":"2023-10-16T19:41:18.963752+0000","last_fullsized":"2023-10-16T19:41:18.963752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984443+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T19:41:00.984443+0000","last_peered":"2023-10-16T19:41:00.984443+0000","last_clean":"2023-10-16T19:41:00.984443+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T19:41:00.984443+0000","last_undegraded":"2023-10-16T19:41:00.984443+0000","last_fullsized":"2023-10-16T19:41:00.984443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'16","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.986888+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T19:41:15.986888+0000","last_peered":"2023-10-16T19:41:15.986888+0000","last_clean":"2023-10-16T19:41:15.986888+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T19:41:15.986888+0000","last_undegraded":"2023-10-16T19:41:15.986888+0000","last_fullsized":"2023-10-16T19:41:15.986888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.812555+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T19:41:00.812555+0000","last_peered":"2023-10-16T19:41:00.812555+0000","last_clean":"2023-10-16T19:41:00.812555+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T19:41:00.812555+0000","last_undegraded":"2023-10-16T19:41:00.812555+0000","last_fullsized":"2023-10-16T19:41:00.812555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:01.937048+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T19:41:01.937048+0000","last_peered":"2023-10-16T19:41:01.937048+0000","last_clean":"2023-10-16T19:41:01.937048+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T19:41:01.937048+0000","last_undegraded":"2023-10-16T19:41:01.937048+0000","last_fullsized":"2023-10-16T19:41:01.937048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813811+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T19:41:00.813811+0000","last_peered":"2023-10-16T19:41:00.813811+0000","last_clean":"2023-10-16T19:41:00.813811+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T19:41:00.813811+0000","last_undegraded":"2023-10-16T19:41:00.813811+0000","last_fullsized":"2023-10-16T19:41:00.813811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.122782+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T19:41:02.122782+0000","last_peered":"2023-10-16T19:41:02.122782+0000","last_clean":"2023-10-16T19:41:02.122782+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T19:41:02.122782+0000","last_undegraded":"2023-10-16T19:41:02.122782+0000","last_fullsized":"2023-10-16T19:41:02.122782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.814249+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T19:41:00.814249+0000","last_peered":"2023-10-16T19:41:00.814249+0000","last_clean":"2023-10-16T19:41:00.814249+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T19:41:00.814249+0000","last_undegraded":"2023-10-16T19:41:00.814249+0000","last_fullsized":"2023-10-16T19:41:00.814249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.098694+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T19:41:19.098694+0000","last_peered":"2023-10-16T19:41:19.098694+0000","last_clean":"2023-10-16T19:41:19.098694+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T19:41:19.098694+0000","last_undegraded":"2023-10-16T19:41:19.098694+0000","last_fullsized":"2023-10-16T19:41:19.098694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986392+0000","last_change":"2023-10-16T19:40:59.156646+0000","last_active":"2023-10-16T19:41:00.986392+0000","last_peered":"2023-10-16T19:41:00.986392+0000","last_clean":"2023-10-16T19:41:00.986392+0000","last_became_active":"2023-10-16T19:40:59.156121+0000","last_became_peered":"2023-10-16T19:40:59.156121+0000","last_unstale":"2023-10-16T19:41:00.986392+0000","last_undegraded":"2023-10-16T19:41:00.986392+0000","last_fullsized":"2023-10-16T19:41:00.986392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.065069+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T19:41:19.065069+0000","last_peered":"2023-10-16T19:41:19.065069+0000","last_clean":"2023-10-16T19:41:19.065069+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T19:41:19.065069+0000","last_undegraded":"2023-10-16T19:41:19.065069+0000","last_fullsized":"2023-10-16T19:41:19.065069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.813302+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T19:41:00.813302+0000","last_peered":"2023-10-16T19:41:00.813302+0000","last_clean":"2023-10-16T19:41:00.813302+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T19:41:00.813302+0000","last_undegraded":"2023-10-16T19:41:00.813302+0000","last_fullsized":"2023-10-16T19:41:00.813302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T19:40:59.500181+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T19:40:59.500181+0000","last_peered":"2023-10-16T19:40:59.500181+0000","last_clean":"2023-10-16T19:40:59.500181+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T19:40:59.500181+0000","last_undegraded":"2023-10-16T19:40:59.500181+0000","last_fullsized":"2023-10-16T19:40:59.500181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.091056+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T19:41:19.091056+0000","last_peered":"2023-10-16T19:41:19.091056+0000","last_clean":"2023-10-16T19:41:19.091056+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T19:41:19.091056+0000","last_undegraded":"2023-10-16T19:41:19.091056+0000","last_fullsized":"2023-10-16T19:41:19.091056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981457+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T19:41:00.981457+0000","last_peered":"2023-10-16T19:41:00.981457+0000","last_clean":"2023-10-16T19:41:00.981457+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T19:41:00.981457+0000","last_undegraded":"2023-10-16T19:41:00.981457+0000","last_fullsized":"2023-10-16T19:41:00.981457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.769883+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T19:41:15.769883+0000","last_peered":"2023-10-16T19:41:15.769883+0000","last_clean":"2023-10-16T19:41:15.769883+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T19:41:15.769883+0000","last_undegraded":"2023-10-16T19:41:15.769883+0000","last_fullsized":"2023-10-16T19:41:15.769883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983753+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T19:41:00.983753+0000","last_peered":"2023-10-16T19:41:00.983753+0000","last_clean":"2023-10-16T19:41:00.983753+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T19:41:00.983753+0000","last_undegraded":"2023-10-16T19:41:00.983753+0000","last_fullsized":"2023-10-16T19:41:00.983753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:15.982142+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T19:41:15.982142+0000","last_peered":"2023-10-16T19:41:15.982142+0000","last_clean":"2023-10-16T19:41:15.982142+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T19:41:15.982142+0000","last_undegraded":"2023-10-16T19:41:15.982142+0000","last_fullsized":"2023-10-16T19:41:15.982142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.745727+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T19:41:00.745727+0000","last_peered":"2023-10-16T19:41:00.745727+0000","last_clean":"2023-10-16T19:41:00.745727+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T19:41:00.745727+0000","last_undegraded":"2023-10-16T19:41:00.745727+0000","last_fullsized":"2023-10-16T19:41:00.745727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986414+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T19:41:00.986414+0000","last_peered":"2023-10-16T19:41:00.986414+0000","last_clean":"2023-10-16T19:41:00.986414+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T19:41:00.986414+0000","last_undegraded":"2023-10-16T19:41:00.986414+0000","last_fullsized":"2023-10-16T19:41:00.986414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784673+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T19:41:00.784673+0000","last_peered":"2023-10-16T19:41:00.784673+0000","last_clean":"2023-10-16T19:41:00.784673+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T19:41:00.784673+0000","last_undegraded":"2023-10-16T19:41:00.784673+0000","last_fullsized":"2023-10-16T19:41:00.784673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746231+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T19:41:00.746231+0000","last_peered":"2023-10-16T19:41:00.746231+0000","last_clean":"2023-10-16T19:41:00.746231+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T19:41:00.746231+0000","last_undegraded":"2023-10-16T19:41:00.746231+0000","last_fullsized":"2023-10-16T19:41:00.746231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.987116+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T19:41:00.987116+0000","last_peered":"2023-10-16T19:41:00.987116+0000","last_clean":"2023-10-16T19:41:00.987116+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T19:41:00.987116+0000","last_undegraded":"2023-10-16T19:41:00.987116+0000","last_fullsized":"2023-10-16T19:41:00.987116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.109233+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T19:41:19.109233+0000","last_peered":"2023-10-16T19:41:19.109233+0000","last_clean":"2023-10-16T19:41:19.109233+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T19:41:19.109233+0000","last_undegraded":"2023-10-16T19:41:19.109233+0000","last_fullsized":"2023-10-16T19:41:19.109233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.746157+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T19:41:00.746157+0000","last_peered":"2023-10-16T19:41:00.746157+0000","last_clean":"2023-10-16T19:41:00.746157+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T19:41:00.746157+0000","last_undegraded":"2023-10-16T19:41:00.746157+0000","last_fullsized":"2023-10-16T19:41:00.746157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.102565+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T19:41:19.102565+0000","last_peered":"2023-10-16T19:41:19.102565+0000","last_clean":"2023-10-16T19:41:19.102565+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T19:41:19.102565+0000","last_undegraded":"2023-10-16T19:41:19.102565+0000","last_fullsized":"2023-10-16T19:41:19.102565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982757+0000","last_change":"2023-10-16T19:40:59.119901+0000","last_active":"2023-10-16T19:41:00.982757+0000","last_peered":"2023-10-16T19:41:00.982757+0000","last_clean":"2023-10-16T19:41:00.982757+0000","last_became_active":"2023-10-16T19:40:59.118945+0000","last_became_peered":"2023-10-16T19:40:59.118945+0000","last_unstale":"2023-10-16T19:41:00.982757+0000","last_undegraded":"2023-10-16T19:41:00.982757+0000","last_fullsized":"2023-10-16T19:41:00.982757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'5","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.744993+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T19:41:08.744993+0000","last_peered":"2023-10-16T19:41:08.744993+0000","last_clean":"2023-10-16T19:41:08.744993+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T19:41:08.744993+0000","last_undegraded":"2023-10-16T19:41:08.744993+0000","last_fullsized":"2023-10-16T19:41:08.744993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.983472+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T19:41:00.983472+0000","last_peered":"2023-10-16T19:41:00.983472+0000","last_clean":"2023-10-16T19:41:00.983472+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T19:41:00.983472+0000","last_undegraded":"2023-10-16T19:41:00.983472+0000","last_fullsized":"2023-10-16T19:41:00.983472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.665285+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T19:41:08.665285+0000","last_peered":"2023-10-16T19:41:08.665285+0000","last_clean":"2023-10-16T19:41:08.665285+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T19:41:08.665285+0000","last_undegraded":"2023-10-16T19:41:08.665285+0000","last_fullsized":"2023-10-16T19:41:08.665285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.784318+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T19:41:00.784318+0000","last_peered":"2023-10-16T19:41:00.784318+0000","last_clean":"2023-10-16T19:41:00.784318+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T19:41:00.784318+0000","last_undegraded":"2023-10-16T19:41:00.784318+0000","last_fullsized":"2023-10-16T19:41:00.784318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:21.992040+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T19:41:21.992040+0000","last_peered":"2023-10-16T19:41:21.992040+0000","last_clean":"2023-10-16T19:41:21.992040+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T19:41:21.992040+0000","last_undegraded":"2023-10-16T19:41:21.992040+0000","last_fullsized":"2023-10-16T19:41:21.992040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981209+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T19:41:00.981209+0000","last_peered":"2023-10-16T19:41:00.981209+0000","last_clean":"2023-10-16T19:41:00.981209+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T19:41:00.981209+0000","last_undegraded":"2023-10-16T19:41:00.981209+0000","last_fullsized":"2023-10-16T19:41:00.981209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.371389+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T19:41:18.371389+0000","last_peered":"2023-10-16T19:41:18.371389+0000","last_clean":"2023-10-16T19:41:18.371389+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T19:41:18.371389+0000","last_undegraded":"2023-10-16T19:41:18.371389+0000","last_fullsized":"2023-10-16T19:41:18.371389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.981819+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T19:41:00.981819+0000","last_peered":"2023-10-16T19:41:00.981819+0000","last_clean":"2023-10-16T19:41:00.981819+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T19:41:00.981819+0000","last_undegraded":"2023-10-16T19:41:00.981819+0000","last_fullsized":"2023-10-16T19:41:00.981819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.668394+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T19:41:08.668394+0000","last_peered":"2023-10-16T19:41:08.668394+0000","last_clean":"2023-10-16T19:41:08.668394+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T19:41:08.668394+0000","last_undegraded":"2023-10-16T19:41:08.668394+0000","last_fullsized":"2023-10-16T19:41:08.668394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.985755+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T19:41:00.985755+0000","last_peered":"2023-10-16T19:41:00.985755+0000","last_clean":"2023-10-16T19:41:00.985755+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T19:41:00.985755+0000","last_undegraded":"2023-10-16T19:41:00.985755+0000","last_fullsized":"2023-10-16T19:41:00.985755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986953+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T19:41:00.986953+0000","last_peered":"2023-10-16T19:41:00.986953+0000","last_clean":"2023-10-16T19:41:00.986953+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T19:41:00.986953+0000","last_undegraded":"2023-10-16T19:41:00.986953+0000","last_fullsized":"2023-10-16T19:41:00.986953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.044274+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T19:41:02.044274+0000","last_peered":"2023-10-16T19:41:02.044274+0000","last_clean":"2023-10-16T19:41:02.044274+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T19:41:02.044274+0000","last_undegraded":"2023-10-16T19:41:02.044274+0000","last_fullsized":"2023-10-16T19:41:02.044274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.986108+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T19:41:00.986108+0000","last_peered":"2023-10-16T19:41:00.986108+0000","last_clean":"2023-10-16T19:41:00.986108+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T19:41:00.986108+0000","last_undegraded":"2023-10-16T19:41:00.986108+0000","last_fullsized":"2023-10-16T19:41:00.986108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:19.108108+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T19:41:19.108108+0000","last_peered":"2023-10-16T19:41:19.108108+0000","last_clean":"2023-10-16T19:41:19.108108+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T19:41:19.108108+0000","last_undegraded":"2023-10-16T19:41:19.108108+0000","last_fullsized":"2023-10-16T19:41:19.108108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.984216+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T19:41:00.984216+0000","last_peered":"2023-10-16T19:41:00.984216+0000","last_clean":"2023-10-16T19:41:00.984216+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T19:41:00.984216+0000","last_undegraded":"2023-10-16T19:41:00.984216+0000","last_fullsized":"2023-10-16T19:41:00.984216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:02.126623+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T19:41:02.126623+0000","last_peered":"2023-10-16T19:41:02.126623+0000","last_clean":"2023-10-16T19:41:02.126623+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T19:41:02.126623+0000","last_undegraded":"2023-10-16T19:41:02.126623+0000","last_fullsized":"2023-10-16T19:41:02.126623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.982817+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T19:41:00.982817+0000","last_peered":"2023-10-16T19:41:00.982817+0000","last_clean":"2023-10-16T19:41:00.982817+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T19:41:00.982817+0000","last_undegraded":"2023-10-16T19:41:00.982817+0000","last_fullsized":"2023-10-16T19:41:00.982817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'11","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T19:41:18.955554+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T19:41:18.955554+0000","last_peered":"2023-10-16T19:41:18.955554+0000","last_clean":"2023-10-16T19:41:18.955554+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T19:41:18.955554+0000","last_undegraded":"2023-10-16T19:41:18.955554+0000","last_fullsized":"2023-10-16T19:41:18.955554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6628,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":13844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":675428,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":86124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":86450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0659999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.897}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]}]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":86136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":85128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":674784,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":85052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":85254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:25.063 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T19:41:25.063 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T19:41:25.064 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T19:41:25.064 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T19:41:25.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.319+0000 7f4e697b6640 1 Processor -- start 2023-10-16T19:41:25.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.319+0000 7f4e697b6640 1 -- start start 2023-10-16T19:41:25.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.321+0000 7f4e697b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 0x7f4e6406b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.321+0000 7f4e697b6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4e640ca130 0x7f4e6406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.321+0000 7f4e697b6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e640cbeb0 con 0x7f4e640cadd0 2023-10-16T19:41:25.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.321+0000 7f4e697b6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640c5290 con 0x7f4e640ca130 2023-10-16T19:41:25.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.321+0000 7f4e697b6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6415c750 con 0x7f4e641532d0 2023-10-16T19:41:25.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.346+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 0x7f4e6406b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.350+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 0x7f4e6406b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39198/0 (socket says 172.21.15.57:39198) 2023-10-16T19:41:25.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.350+0000 7f4e62ffd640 1 -- 172.21.15.57:0/174054967 learned_addr learned my addr 172.21.15.57:0/174054967 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:25.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.439+0000 7f4e5bfff640 1 --2- 172.21.15.57:0/174054967 >> v2:172.21.15.110:3300/0 conn(0x7f4e640ca130 0x7f4e6406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.442+0000 7f4e62ffd640 1 -- 172.21.15.57:0/174054967 >> v2:172.21.15.110:3300/0 conn(0x7f4e640ca130 msgr2=0x7f4e6406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.442+0000 7f4e62ffd640 1 --2- 172.21.15.57:0/174054967 >> v2:172.21.15.110:3300/0 conn(0x7f4e640ca130 0x7f4e6406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.442+0000 7f4e62ffd640 1 -- 172.21.15.57:0/174054967 >> v1:172.21.15.110:6789/0 conn(0x7f4e640cadd0 legacy=0x7f4e6415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.442+0000 7f4e62ffd640 1 -- 172.21.15.57:0/174054967 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640cc100 con 0x7f4e641532d0 2023-10-16T19:41:25.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.442+0000 7f4e5bfff640 1 --2- 172.21.15.57:0/174054967 >> v2:172.21.15.110:3300/0 conn(0x7f4e640ca130 0x7f4e6406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:25.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.458+0000 7f4e62ffd640 1 --2- 172.21.15.57:0/174054967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 0x7f4e6406b8a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098a0 tx=0x7f4e5402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d764c874d5d3e9b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.483+0000 7f4e627fc640 1 -- 172.21.15.57:0/174054967 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54031640 con 0x7f4e641532d0 2023-10-16T19:41:25.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.483+0000 7f4e627fc640 1 -- 172.21.15.57:0/174054967 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e540317a0 con 0x7f4e641532d0 2023-10-16T19:41:25.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.483+0000 7f4e627fc640 1 -- 172.21.15.57:0/174054967 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54031b30 con 0x7f4e641532d0 2023-10-16T19:41:25.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.484+0000 7f4e697b6640 1 -- 172.21.15.57:0/174054967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 msgr2=0x7f4e6406b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.484+0000 7f4e697b6640 1 --2- 172.21.15.57:0/174054967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 0x7f4e6406b8a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098a0 tx=0x7f4e5402b8f0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.484+0000 7f4e697b6640 1 -- 172.21.15.57:0/174054967 shutdown_connections 2023-10-16T19:41:25.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.484+0000 7f4e697b6640 1 --2- 172.21.15.57:0/174054967 >> v2:172.21.15.110:3300/0 conn(0x7f4e640ca130 0x7f4e6406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.484+0000 7f4e697b6640 1 --2- 172.21.15.57:0/174054967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e641532d0 0x7f4e6406b8a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.484+0000 7f4e697b6640 1 -- 172.21.15.57:0/174054967 >> 172.21.15.57:0/174054967 conn(0x7f4e64071510 msgr2=0x7f4e6406ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.485+0000 7f4e697b6640 1 -- 172.21.15.57:0/174054967 shutdown_connections 2023-10-16T19:41:25.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.485+0000 7f4e697b6640 1 -- 172.21.15.57:0/174054967 wait complete. 2023-10-16T19:41:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.489+0000 7f4e697b6640 1 Processor -- start 2023-10-16T19:41:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.490+0000 7f4e697b6640 1 -- start start 2023-10-16T19:41:25.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.491+0000 7f4e697b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 0x7f4e641587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.491+0000 7f4e697b6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e640cadd0 0x7f4e640cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.491+0000 7f4e697b6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e641532d0 0x7f4e640cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.491+0000 7f4e697b6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640ce930 con 0x7f4e640cadd0 2023-10-16T19:41:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.491+0000 7f4e697b6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64158ce0 con 0x7f4e641532d0 2023-10-16T19:41:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.491+0000 7f4e697b6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640cd570 con 0x7f4e640ca130 2023-10-16T19:41:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.493+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 0x7f4e641587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.494+0000 7f4e637fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e641532d0 0x7f4e640cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.494+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 0x7f4e641587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:39200/0 (socket says 172.21.15.57:39200) 2023-10-16T19:41:25.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.494+0000 7f4e62ffd640 1 -- 172.21.15.57:0/3477276345 learned_addr learned my addr 172.21.15.57:0/3477276345 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:25.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.504+0000 7f4e62ffd640 1 -- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e641532d0 msgr2=0x7f4e640cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.504+0000 7f4e62ffd640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e641532d0 0x7f4e640cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.504+0000 7f4e62ffd640 1 -- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e640cadd0 msgr2=0x7f4e640cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.504+0000 7f4e62ffd640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e640cadd0 0x7f4e640cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.504+0000 7f4e62ffd640 1 -- 172.21.15.57:0/3477276345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540094d0 con 0x7f4e640ca130 2023-10-16T19:41:25.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.510+0000 7f4e62ffd640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 0x7f4e641587a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098a0 tx=0x7f4e540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.521+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5403ac60 con 0x7f4e640ca130 2023-10-16T19:41:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.522+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5403ade0 con 0x7f4e640ca130 2023-10-16T19:41:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.522+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54044630 con 0x7f4e640ca130 2023-10-16T19:41:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.522+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e640cc960 con 0x7f4e640ca130 2023-10-16T19:41:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.522+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e640ccf20 con 0x7f4e640ca130 2023-10-16T19:41:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.524+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6404e1d0 con 0x7f4e640ca130 2023-10-16T19:41:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.580+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4e5402f050 con 0x7f4e640ca130 2023-10-16T19:41:25.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.582+0000 7f4e5b7fe640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4e4406aef0 0x7f4e4406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.582+0000 7f4e5bfff640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4e4406aef0 0x7f4e4406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.584+0000 7f4e5bfff640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4e4406aef0 0x7f4e4406d3b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006fd0 tx=0x7f4e4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.880+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4e5407aba0 con 0x7f4e640ca130 2023-10-16T19:41:25.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:25.912+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e540767e0 con 0x7f4e640ca130 2023-10-16T19:41:26.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.175+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e64152130 con 0x7f4e640ca130 2023-10-16T19:41:26.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.188+0000 7f4e5b7fe640 1 -- 172.21.15.57:0/3477276345 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4e54079e00 con 0x7f4e640ca130 2023-10-16T19:41:26.190 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:26.190 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T19:41:26.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4e4406aef0 msgr2=0x7f4e4406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4e4406aef0 0x7f4e4406d3b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006fd0 tx=0x7f4e4c008040 comp rx=0 tx=0).stop 2023-10-16T19:41:26.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 msgr2=0x7f4e641587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 0x7f4e641587a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098a0 tx=0x7f4e540046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 shutdown_connections 2023-10-16T19:41:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4e4406aef0 0x7f4e4406d3b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e641532d0 0x7f4e640cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e640cadd0 0x7f4e640cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 --2- 172.21.15.57:0/3477276345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e640ca130 0x7f4e641587a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 >> 172.21.15.57:0/3477276345 conn(0x7f4e64071510 msgr2=0x7f4e6414d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 shutdown_connections 2023-10-16T19:41:26.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.190+0000 7f4e697b6640 1 -- 172.21.15.57:0/3477276345 wait complete. 2023-10-16T19:41:26.210 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T19:41:26.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:26.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.433+0000 7f164ffff640 1 Processor -- start 2023-10-16T19:41:26.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.433+0000 7f164ffff640 1 -- start start 2023-10-16T19:41:26.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.434+0000 7f164ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c7a20 0x7f165006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.434+0000 7f164ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16500c5f10 0x7f16500c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.434+0000 7f164ffff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16501502c0 con 0x7f165014fee0 2023-10-16T19:41:26.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.434+0000 7f164ffff640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165006fc00 con 0x7f16500c5f10 2023-10-16T19:41:26.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.434+0000 7f164ffff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500c4830 con 0x7f16500c7a20 2023-10-16T19:41:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.435+0000 7f164f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16500c5f10 0x7f16500c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.436+0000 7f164f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16500c5f10 0x7f16500c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34850/0 (socket says 172.21.15.57:34850) 2023-10-16T19:41:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.436+0000 7f164f7fe640 1 -- 172.21.15.57:0/4180872880 learned_addr learned my addr 172.21.15.57:0/4180872880 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:26.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.438+0000 7f164f7fe640 1 -- 172.21.15.57:0/4180872880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c7a20 msgr2=0x7f165006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:26.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.438+0000 7f164f7fe640 1 --2- 172.21.15.57:0/4180872880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c7a20 0x7f165006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.438+0000 7f164f7fe640 1 -- 172.21.15.57:0/4180872880 >> v1:172.21.15.110:6789/0 conn(0x7f165014fee0 legacy=0x7f16500c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:26.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.438+0000 7f164f7fe640 1 -- 172.21.15.57:0/4180872880 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165006fea0 con 0x7f16500c5f10 2023-10-16T19:41:26.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.441+0000 7f164f7fe640 1 --2- 172.21.15.57:0/4180872880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c5f10 0x7f16500c6340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1648009870 tx=0x7f164802db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3990799d95621 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.446+0000 7f164dffb640 1 -- 172.21.15.57:0/4180872880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164802e940 con 0x7f16500c5f10 2023-10-16T19:41:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.446+0000 7f164dffb640 1 -- 172.21.15.57:0/4180872880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164802eaa0 con 0x7f16500c5f10 2023-10-16T19:41:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.446+0000 7f164dffb640 1 -- 172.21.15.57:0/4180872880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164802ee30 con 0x7f16500c5f10 2023-10-16T19:41:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 -- 172.21.15.57:0/4180872880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c5f10 msgr2=0x7f16500c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 --2- 172.21.15.57:0/4180872880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c5f10 0x7f16500c6340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1648009870 tx=0x7f164802db90 comp rx=0 tx=0).stop 2023-10-16T19:41:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 -- 172.21.15.57:0/4180872880 shutdown_connections 2023-10-16T19:41:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 --2- 172.21.15.57:0/4180872880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c5f10 0x7f16500c6340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 --2- 172.21.15.57:0/4180872880 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c7a20 0x7f165006cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 -- 172.21.15.57:0/4180872880 >> 172.21.15.57:0/4180872880 conn(0x7f16500c6f00 msgr2=0x7f16500c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 -- 172.21.15.57:0/4180872880 shutdown_connections 2023-10-16T19:41:26.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.447+0000 7f164ffff640 1 -- 172.21.15.57:0/4180872880 wait complete. 2023-10-16T19:41:26.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.449+0000 7f164ffff640 1 Processor -- start 2023-10-16T19:41:26.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.449+0000 7f164ffff640 1 -- start start 2023-10-16T19:41:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.450+0000 7f164ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c5f10 0x7f16500c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.450+0000 7f164ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 0x7f165014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.451+0000 7f164ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f165014fee0 0x7f1650143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.451+0000 7f164ffff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650157670 con 0x7f16500c7a20 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.451+0000 7f164ffff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165014c030 con 0x7f165014fee0 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.451+0000 7f164ffff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650154e20 con 0x7f16500c5f10 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.451+0000 7f164e7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 0x7f165014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.452+0000 7f164e7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 0x7f165014c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34856/0 (socket says 172.21.15.57:34856) 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.452+0000 7f164e7fc640 1 -- 172.21.15.57:0/1082404587 learned_addr learned my addr 172.21.15.57:0/1082404587 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.455+0000 7f164e7fc640 1 -- 172.21.15.57:0/1082404587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c5f10 msgr2=0x7f16500c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.455+0000 7f164e7fc640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c5f10 0x7f16500c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.455+0000 7f164e7fc640 1 -- 172.21.15.57:0/1082404587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f165014fee0 msgr2=0x7f1650143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.455+0000 7f164e7fc640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f165014fee0 0x7f1650143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.455+0000 7f164e7fc640 1 -- 172.21.15.57:0/1082404587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480094d0 con 0x7f16500c7a20 2023-10-16T19:41:26.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.458+0000 7f164e7fc640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 0x7f165014c4c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f163800b4a0 tx=0x7f163800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.462+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638005a10 con 0x7f16500c7a20 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.462+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638005b70 con 0x7f16500c7a20 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.462+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638010610 con 0x7f16500c7a20 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.462+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16501578c0 con 0x7f16500c7a20 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.462+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1650157e80 con 0x7f16500c7a20 2023-10-16T19:41:26.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.463+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650068d50 con 0x7f16500c7a20 2023-10-16T19:41:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.767+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1638010770 con 0x7f16500c7a20 2023-10-16T19:41:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.770+0000 7f1647fff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f163006aec0 0x7f163006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.771+0000 7f164effd640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f163006aec0 0x7f163006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.772+0000 7f164effd640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f163006aec0 0x7f163006d380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f164000abb0 tx=0x7f1640009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.809+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f16380587e0 con 0x7f16500c7a20 2023-10-16T19:41:26.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:26.810+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1638057eb0 con 0x7f16500c7a20 2023-10-16T19:41:27.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.026+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f165004e160 con 0x7f16500c7a20 2023-10-16T19:41:27.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.169+0000 7f1647fff640 1 -- 172.21.15.57:0/1082404587 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f1638014020 con 0x7f16500c7a20 2023-10-16T19:41:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:27.175 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f163006aec0 msgr2=0x7f163006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f163006aec0 0x7f163006d380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f164000abb0 tx=0x7f1640009250 comp rx=0 tx=0).stop 2023-10-16T19:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 msgr2=0x7f165014c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 0x7f165014c4c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f163800b4a0 tx=0x7f163800b960 comp rx=0 tx=0).stop 2023-10-16T19:41:27.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 shutdown_connections 2023-10-16T19:41:27.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f163006aec0 0x7f163006d380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f165014fee0 0x7f1650143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500c7a20 0x7f165014c4c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 --2- 172.21.15.57:0/1082404587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16500c5f10 0x7f16500c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 >> 172.21.15.57:0/1082404587 conn(0x7f16500c6f00 msgr2=0x7f165014ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:27.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 shutdown_connections 2023-10-16T19:41:27.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.173+0000 7f164ffff640 1 -- 172.21.15.57:0/1082404587 wait complete. 2023-10-16T19:41:27.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:40:38.255594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:40:53.908842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:40:56.364727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:41:27.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:41:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.429+0000 7f6b695b0640 1 Processor -- start 2023-10-16T19:41:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.430+0000 7f6b695b0640 1 -- start start 2023-10-16T19:41:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.431+0000 7f6b695b0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b640ae730 0x7f6b6406b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.431+0000 7f6b695b0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 0x7f6b6406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.431+0000 7f6b695b0640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640aeb10 con 0x7f6b6406efe0 2023-10-16T19:41:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.431+0000 7f6b695b0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6415cf60 con 0x7f6b640ae730 2023-10-16T19:41:27.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.431+0000 7f6b695b0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406dd60 con 0x7f6b640c8460 2023-10-16T19:41:27.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.432+0000 7f6b637fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6b6406efe0 0x7f6b6406e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34320/0 (socket says 172.21.15.57:34320) 2023-10-16T19:41:27.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.432+0000 7f6b637fe640 1 -- 172.21.15.57:0/1239166947 learned_addr learned my addr 172.21.15.57:0/1239166947 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:27.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.433+0000 7f6b62ffd640 1 --2- 172.21.15.57:0/1239166947 >> v2:172.21.15.110:3300/0 conn(0x7f6b640ae730 0x7f6b6406b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.433+0000 7f6b627fc640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 0x7f6b6406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.436+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146759819 0 0) 0x7f6b640aeb10 con 0x7f6b6406efe0 2023-10-16T19:41:27.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.436+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b4c003520 con 0x7f6b6406efe0 2023-10-16T19:41:27.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721988791 0 0) 0x7f6b4c003520 con 0x7f6b6406efe0 2023-10-16T19:41:27.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 msgr2=0x7f6b6406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 0x7f6b6406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 >> v2:172.21.15.110:3300/0 conn(0x7f6b640ae730 msgr2=0x7f6b6406b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 --2- 172.21.15.57:0/1239166947 >> v2:172.21.15.110:3300/0 conn(0x7f6b640ae730 0x7f6b6406b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6415d450 con 0x7f6b6406efe0 2023-10-16T19:41:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f6b5c0019f0 con 0x7f6b6406efe0 2023-10-16T19:41:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 >> v1:172.21.15.57:6789/0 conn(0x7f6b6406efe0 legacy=0x7f6b6406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b4c003970 0x7f6b4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 0x7f6b4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.439+0000 7f6b61ffb640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c004d00 0x7f6b4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.440+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6415cf60 con 0x7f6b4c004d00 2023-10-16T19:41:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.440+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406dd60 con 0x7f6b4c003970 2023-10-16T19:41:27.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.440+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c00b980 con 0x7f6b640c8460 2023-10-16T19:41:27.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.443+0000 7f6b637fe640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c004d00 0x7f6b4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.446+0000 7f6b637fe640 1 -- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 msgr2=0x7f6b4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:27.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.446+0000 7f6b637fe640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b640c8460 0x7f6b4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.446+0000 7f6b637fe640 1 -- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b4c003970 msgr2=0x7f6b4c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:27.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.446+0000 7f6b637fe640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b4c003970 0x7f6b4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.446+0000 7f6b637fe640 1 -- 172.21.15.57:0/1239166947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c003520 con 0x7f6b4c004d00 2023-10-16T19:41:27.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.449+0000 7f6b637fe640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c004d00 0x7f6b4c005180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00a840 tx=0x7f6b4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf45922483e85126 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.452+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c034630 con 0x7f6b4c004d00 2023-10-16T19:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.452+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c02f070 con 0x7f6b4c004d00 2023-10-16T19:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.452+0000 7f6b61ffb640 1 -- 172.21.15.57:0/1239166947 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0349f0 con 0x7f6b4c004d00 2023-10-16T19:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b695b0640 1 -- 172.21.15.57:0/1239166947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c004d00 msgr2=0x7f6b4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b695b0640 1 --2- 172.21.15.57:0/1239166947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c004d00 0x7f6b4c005180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00a840 tx=0x7f6b4c0057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b637fe640 1 -- 172.21.15.57:0/1239166947 reap_dead start 2023-10-16T19:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b695b0640 1 -- 172.21.15.57:0/1239166947 shutdown_connections 2023-10-16T19:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b695b0640 1 -- 172.21.15.57:0/1239166947 >> 172.21.15.57:0/1239166947 conn(0x7f6b6406f940 msgr2=0x7f6b6406fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b695b0640 1 -- 172.21.15.57:0/1239166947 shutdown_connections 2023-10-16T19:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.453+0000 7f6b695b0640 1 -- 172.21.15.57:0/1239166947 wait complete. 2023-10-16T19:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.455+0000 7f6b695b0640 1 Processor -- start 2023-10-16T19:41:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.455+0000 7f6b695b0640 1 -- start start 2023-10-16T19:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.456+0000 7f6b695b0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 0x7f6b640b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.456+0000 7f6b695b0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b64153950 0x7f6b64155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.456+0000 7f6b695b0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b641ef980 0x7f6b64155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.456+0000 7f6b695b0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64154e70 con 0x7f6b6414cf00 2023-10-16T19:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.456+0000 7f6b695b0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64155bb0 con 0x7f6b641ef980 2023-10-16T19:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.456+0000 7f6b695b0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64156110 con 0x7f6b64153950 2023-10-16T19:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.457+0000 7f6b62ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 0x7f6b640b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.457+0000 7f6b62ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 0x7f6b640b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34866/0 (socket says 172.21.15.57:34866) 2023-10-16T19:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.457+0000 7f6b62ffd640 1 -- 172.21.15.57:0/2104807661 learned_addr learned my addr 172.21.15.57:0/2104807661 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.458+0000 7f6b627fc640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b64153950 0x7f6b64155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.461+0000 7f6b62ffd640 1 -- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b64153950 msgr2=0x7f6b64155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.461+0000 7f6b62ffd640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b64153950 0x7f6b64155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.461+0000 7f6b637fe640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b641ef980 0x7f6b64155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.461+0000 7f6b62ffd640 1 -- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b641ef980 msgr2=0x7f6b64155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.461+0000 7f6b62ffd640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b641ef980 0x7f6b64155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.461+0000 7f6b62ffd640 1 -- 172.21.15.57:0/2104807661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64155e30 con 0x7f6b6414cf00 2023-10-16T19:41:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.464+0000 7f6b62ffd640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 0x7f6b640b10f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400e7c0 tx=0x7f6b5400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:27.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.487+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400c6d0 con 0x7f6b6414cf00 2023-10-16T19:41:27.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.488+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400c850 con 0x7f6b6414cf00 2023-10-16T19:41:27.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.488+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400cc00 con 0x7f6b6414cf00 2023-10-16T19:41:27.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.488+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b640b0610 con 0x7f6b6414cf00 2023-10-16T19:41:27.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.488+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b640b0bd0 con 0x7f6b6414cf00 2023-10-16T19:41:27.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.489+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b640b1630 con 0x7f6b6414cf00 2023-10-16T19:41:27.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.512+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b54026480 con 0x7f6b6414cf00 2023-10-16T19:41:27.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.513+0000 7f6b4b7fe640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b5006aef0 0x7f6b5006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:27.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.513+0000 7f6b627fc640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b5006aef0 0x7f6b5006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:27.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.514+0000 7f6b627fc640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b5006aef0 0x7f6b5006d3b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b6415a0f0 tx=0x7f6b58006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:27.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.517+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6b54059250 con 0x7f6b6414cf00 2023-10-16T19:41:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:27.906+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b54054e90 con 0x7f6b6414cf00 2023-10-16T19:41:28.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.128+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b640b0d60 con 0x7f6b6414cf00 2023-10-16T19:41:28.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.238+0000 7f6b4b7fe640 1 -- 172.21.15.57:0/2104807661 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b54021020 con 0x7f6b6414cf00 2023-10-16T19:41:28.241 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-16T19:41:28.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.242+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b5006aef0 msgr2=0x7f6b5006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:28.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.242+0000 7f6b695b0640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b5006aef0 0x7f6b5006d3b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b6415a0f0 tx=0x7f6b58006a20 comp rx=0 tx=0).stop 2023-10-16T19:41:28.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.242+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 msgr2=0x7f6b640b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:28.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.242+0000 7f6b695b0640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 0x7f6b640b10f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400e7c0 tx=0x7f6b5400ebc0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 shutdown_connections 2023-10-16T19:41:28.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b5006aef0 0x7f6b5006d3b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b641ef980 0x7f6b64155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b64153950 0x7f6b64155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 --2- 172.21.15.57:0/2104807661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6414cf00 0x7f6b640b10f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 >> 172.21.15.57:0/2104807661 conn(0x7f6b6406f940 msgr2=0x7f6b640cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 shutdown_connections 2023-10-16T19:41:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.243+0000 7f6b695b0640 1 -- 172.21.15.57:0/2104807661 wait complete. 2023-10-16T19:41:28.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:41:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.480+0000 7f435674c640 1 Processor -- start 2023-10-16T19:41:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.481+0000 7f435674c640 1 -- start start 2023-10-16T19:41:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.482+0000 7f435674c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f43500cc880 0x7f43500c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.482+0000 7f435674c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43500ccc60 0x7f4350157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.482+0000 7f435674c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cbee0 0x7f435015a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.482+0000 7f435674c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43501574a0 con 0x7f43500cc880 2023-10-16T19:41:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.482+0000 7f435674c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435015ace0 con 0x7f43500ccc60 2023-10-16T19:41:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.482+0000 7f435674c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435015af80 con 0x7f43500cbee0 2023-10-16T19:41:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.483+0000 7f434ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f43500cc880 0x7f43500c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.484+0000 7f434ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f43500cc880 0x7f43500c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34870/0 (socket says 172.21.15.57:34870) 2023-10-16T19:41:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.484+0000 7f434ffff640 1 -- 172.21.15.57:0/2780627062 learned_addr learned my addr 172.21.15.57:0/2780627062 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.484+0000 7f434f7fe640 1 --2- 172.21.15.57:0/2780627062 >> v2:172.21.15.110:3300/0 conn(0x7f43500ccc60 0x7f4350157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.484+0000 7f4354ce9640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cbee0 0x7f435015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.486+0000 7f434ffff640 1 -- 172.21.15.57:0/2780627062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cbee0 msgr2=0x7f435015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.486+0000 7f434ffff640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cbee0 0x7f435015a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.486+0000 7f434ffff640 1 -- 172.21.15.57:0/2780627062 >> v2:172.21.15.110:3300/0 conn(0x7f43500ccc60 msgr2=0x7f4350157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.486+0000 7f434ffff640 1 --2- 172.21.15.57:0/2780627062 >> v2:172.21.15.110:3300/0 conn(0x7f43500ccc60 0x7f4350157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.486+0000 7f434ffff640 1 -- 172.21.15.57:0/2780627062 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435015b240 con 0x7f43500cc880 2023-10-16T19:41:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.486+0000 7f4354ce9640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cbee0 0x7f435015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.489+0000 7f434ffff640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cc880 0x7f43500c7f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43500c90f0 tx=0x7f434002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1234d350cb67dcbe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.494+0000 7f434effd640 1 -- 172.21.15.57:0/2780627062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434002c9e0 con 0x7f43500cc880 2023-10-16T19:41:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.494+0000 7f434effd640 1 -- 172.21.15.57:0/2780627062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434002cb40 con 0x7f43500cc880 2023-10-16T19:41:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.494+0000 7f434effd640 1 -- 172.21.15.57:0/2780627062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400343f0 con 0x7f43500cc880 2023-10-16T19:41:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 -- 172.21.15.57:0/2780627062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cc880 msgr2=0x7f43500c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cc880 0x7f43500c7f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43500c90f0 tx=0x7f434002be40 comp rx=0 tx=0).stop 2023-10-16T19:41:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 -- 172.21.15.57:0/2780627062 shutdown_connections 2023-10-16T19:41:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 --2- 172.21.15.57:0/2780627062 >> v2:172.21.15.110:3300/0 conn(0x7f43500ccc60 0x7f4350157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cbee0 0x7f435015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 --2- 172.21.15.57:0/2780627062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cc880 0x7f43500c7f30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 -- 172.21.15.57:0/2780627062 >> 172.21.15.57:0/2780627062 conn(0x7f43500659d0 msgr2=0x7f4350065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 -- 172.21.15.57:0/2780627062 shutdown_connections 2023-10-16T19:41:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.495+0000 7f435674c640 1 -- 172.21.15.57:0/2780627062 wait complete. 2023-10-16T19:41:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.497+0000 7f435674c640 1 Processor -- start 2023-10-16T19:41:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.497+0000 7f435674c640 1 -- start start 2023-10-16T19:41:28.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.498+0000 7f435674c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 0x7f43501edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.498+0000 7f435674c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cc880 0x7f43501ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.498+0000 7f435674c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43500ccc60 0x7f43500c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.498+0000 7f435674c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435006ef80 con 0x7f43500cbee0 2023-10-16T19:41:28.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.498+0000 7f435674c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500c6520 con 0x7f43500ccc60 2023-10-16T19:41:28.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.498+0000 7f435674c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435006b300 con 0x7f43500cc880 2023-10-16T19:41:28.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.499+0000 7f434ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 0x7f43501edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.500+0000 7f4354ce9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43500ccc60 0x7f43500c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.500+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cc880 0x7f43501ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.500+0000 7f434ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 0x7f43501edf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34880/0 (socket says 172.21.15.57:34880) 2023-10-16T19:41:28.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.500+0000 7f434ffff640 1 -- 172.21.15.57:0/1664471831 learned_addr learned my addr 172.21.15.57:0/1664471831 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.509+0000 7f434ffff640 1 -- 172.21.15.57:0/1664471831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cc880 msgr2=0x7f43501ee4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.509+0000 7f434ffff640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cc880 0x7f43501ee4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.509+0000 7f434ffff640 1 -- 172.21.15.57:0/1664471831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43500ccc60 msgr2=0x7f43500c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.509+0000 7f434ffff640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43500ccc60 0x7f43500c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.509+0000 7f434ffff640 1 -- 172.21.15.57:0/1664471831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340009b30 con 0x7f43500cbee0 2023-10-16T19:41:28.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.516+0000 7f434ffff640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 0x7f43501edf60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4340036040 tx=0x7f4340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.526+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434003e450 con 0x7f43500cbee0 2023-10-16T19:41:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.526+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434003e5d0 con 0x7f43500cbee0 2023-10-16T19:41:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.526+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434003e980 con 0x7f43500cbee0 2023-10-16T19:41:28.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.526+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500c7cd0 con 0x7f43500cbee0 2023-10-16T19:41:28.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.527+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435006f190 con 0x7f43500cbee0 2023-10-16T19:41:28.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.528+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435004e160 con 0x7f43500cbee0 2023-10-16T19:41:28.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.571+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f434003eae0 con 0x7f43500cbee0 2023-10-16T19:41:28.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.573+0000 7f434cff9640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.574+0000 7f434f7fe640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:28.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.576+0000 7f434f7fe640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f433006aec0 0x7f433006d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43500ca7d0 tx=0x7f4338009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.578+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f434007b800 con 0x7f43500cbee0 2023-10-16T19:41:28.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:28.914+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4340077b40 con 0x7f43500cbee0 2023-10-16T19:41:29.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.128+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43500c71d0 con 0x7f43500cbee0 2023-10-16T19:41:29.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.250+0000 7f434cff9640 1 -- 172.21.15.57:0/1664471831 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f434007b160 con 0x7f43500cbee0 2023-10-16T19:41:29.254 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-16T19:41:29.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.254+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f433006aec0 msgr2=0x7f433006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:29.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.254+0000 7f435674c640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f433006aec0 0x7f433006d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43500ca7d0 tx=0x7f4338009190 comp rx=0 tx=0).stop 2023-10-16T19:41:29.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 msgr2=0x7f43501edf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:29.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 0x7f43501edf60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4340036040 tx=0x7f4340004a40 comp rx=0 tx=0).stop 2023-10-16T19:41:29.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 shutdown_connections 2023-10-16T19:41:29.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43500ccc60 0x7f43500c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43500cc880 0x7f43501ee4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 --2- 172.21.15.57:0/1664471831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43500cbee0 0x7f43501edf60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 >> 172.21.15.57:0/1664471831 conn(0x7f43500659d0 msgr2=0x7f4350154ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 shutdown_connections 2023-10-16T19:41:29.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.255+0000 7f435674c640 1 -- 172.21.15.57:0/1664471831 wait complete. 2023-10-16T19:41:29.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:41:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.507+0000 7f56def0c640 1 Processor -- start 2023-10-16T19:41:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.507+0000 7f56def0c640 1 -- start start 2023-10-16T19:41:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.508+0000 7f56def0c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56d8153260 0x7f56d806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.509+0000 7f56def0c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56d80c60c0 0x7f56d80c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.509+0000 7f56def0c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80c7cc0 con 0x7f56d80c8490 2023-10-16T19:41:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.509+0000 7f56def0c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80c7530 con 0x7f56d80c60c0 2023-10-16T19:41:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.509+0000 7f56def0c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80c7720 con 0x7f56d8153260 2023-10-16T19:41:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.510+0000 7f56dcca8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56d8153260 0x7f56d806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:29.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.514+0000 7f56dcca8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56d8153260 0x7f56d806b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:45776/0 (socket says 172.21.15.57:45776) 2023-10-16T19:41:29.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.514+0000 7f56dcca8640 1 -- 172.21.15.57:0/3590406777 learned_addr learned my addr 172.21.15.57:0/3590406777 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.516+0000 7f56d7fff640 1 --2- 172.21.15.57:0/3590406777 >> v2:172.21.15.57:3300/0 conn(0x7f56d80c60c0 0x7f56d80c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:29.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.520+0000 7f56d7fff640 1 -- 172.21.15.57:0/3590406777 >> v2:172.21.15.110:3300/0 conn(0x7f56d8153260 msgr2=0x7f56d806b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:29.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.520+0000 7f56d7fff640 1 --2- 172.21.15.57:0/3590406777 >> v2:172.21.15.110:3300/0 conn(0x7f56d8153260 0x7f56d806b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.520+0000 7f56d7fff640 1 -- 172.21.15.57:0/3590406777 >> v1:172.21.15.57:6789/0 conn(0x7f56d80c8490 legacy=0x7f56d815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:29.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.520+0000 7f56d7fff640 1 -- 172.21.15.57:0/3590406777 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80c79e0 con 0x7f56d80c60c0 2023-10-16T19:41:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.524+0000 7f56d7fff640 1 --2- 172.21.15.57:0/3590406777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d80c60c0 0x7f56d80c7f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f56d80c8fe0 tx=0x7f56cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a7abeba773f7fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.531+0000 7f56d77fe640 1 -- 172.21.15.57:0/3590406777 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc02cc80 con 0x7f56d80c60c0 2023-10-16T19:41:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.531+0000 7f56d77fe640 1 -- 172.21.15.57:0/3590406777 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc02cde0 con 0x7f56d80c60c0 2023-10-16T19:41:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.531+0000 7f56d77fe640 1 -- 172.21.15.57:0/3590406777 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc034660 con 0x7f56d80c60c0 2023-10-16T19:41:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.532+0000 7f56def0c640 1 -- 172.21.15.57:0/3590406777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d80c60c0 msgr2=0x7f56d80c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.532+0000 7f56def0c640 1 --2- 172.21.15.57:0/3590406777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d80c60c0 0x7f56d80c7f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f56d80c8fe0 tx=0x7f56cc02bed0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.532+0000 7f56def0c640 1 -- 172.21.15.57:0/3590406777 shutdown_connections 2023-10-16T19:41:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.532+0000 7f56def0c640 1 --2- 172.21.15.57:0/3590406777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d80c60c0 0x7f56d80c7f50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.532+0000 7f56def0c640 1 --2- 172.21.15.57:0/3590406777 >> v2:172.21.15.110:3300/0 conn(0x7f56d8153260 0x7f56d806b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.532+0000 7f56def0c640 1 -- 172.21.15.57:0/3590406777 >> 172.21.15.57:0/3590406777 conn(0x7f56d806e790 msgr2=0x7f56d806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:29.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.533+0000 7f56def0c640 1 -- 172.21.15.57:0/3590406777 shutdown_connections 2023-10-16T19:41:29.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.533+0000 7f56def0c640 1 -- 172.21.15.57:0/3590406777 wait complete. 2023-10-16T19:41:29.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.535+0000 7f56def0c640 1 Processor -- start 2023-10-16T19:41:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.535+0000 7f56def0c640 1 -- start start 2023-10-16T19:41:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.536+0000 7f56def0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d80c60c0 0x7f56d8157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.536+0000 7f56def0c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d80c8490 0x7f56d8141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.536+0000 7f56def0c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 0x7f56d8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.537+0000 7f56def0c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d81409e0 con 0x7f56d8153260 2023-10-16T19:41:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.537+0000 7f56def0c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8142070 con 0x7f56d80c60c0 2023-10-16T19:41:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.537+0000 7f56def0c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d814dea0 con 0x7f56d80c8490 2023-10-16T19:41:29.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.537+0000 7f56dd4a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 0x7f56d8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:29.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.538+0000 7f56dd4a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 0x7f56d8159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34898/0 (socket says 172.21.15.57:34898) 2023-10-16T19:41:29.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.538+0000 7f56dd4a9640 1 -- 172.21.15.57:0/1125054929 learned_addr learned my addr 172.21.15.57:0/1125054929 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:29.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.538+0000 7f56d7fff640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d80c8490 0x7f56d8141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:29.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.538+0000 7f56dcca8640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d80c60c0 0x7f56d8157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:29.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.543+0000 7f56dd4a9640 1 -- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d80c8490 msgr2=0x7f56d8141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:29.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.543+0000 7f56dd4a9640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d80c8490 0x7f56d8141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.543+0000 7f56dd4a9640 1 -- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d80c60c0 msgr2=0x7f56d8157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:29.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.543+0000 7f56dd4a9640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d80c60c0 0x7f56d8157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:29.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.543+0000 7f56dd4a9640 1 -- 172.21.15.57:0/1125054929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc009a70 con 0x7f56d8153260 2023-10-16T19:41:29.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.546+0000 7f56dd4a9640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 0x7f56d8159130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c3c0 tx=0x7f56d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.550+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00052d0 con 0x7f56d8153260 2023-10-16T19:41:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.550+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0005430 con 0x7f56d8153260 2023-10-16T19:41:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.550+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0003810 con 0x7f56d8153260 2023-10-16T19:41:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.550+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d81584c0 con 0x7f56d8153260 2023-10-16T19:41:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.551+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d81ef2c0 con 0x7f56d8153260 2023-10-16T19:41:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.552+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d804e160 con 0x7f56d8153260 2023-10-16T19:41:29.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.856+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f56d0003970 con 0x7f56d8153260 2023-10-16T19:41:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.859+0000 7f56d57fa640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f56c406aec0 0x7f56c406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:29.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.860+0000 7f56dcca8640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f56c406aec0 0x7f56c406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:29.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.862+0000 7f56dcca8640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f56c406aec0 0x7f56c406d380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009b30 tx=0x7f56c8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.889+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f56d0057da0 con 0x7f56d8153260 2023-10-16T19:41:29.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:29.890+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56d00540e0 con 0x7f56d8153260 2023-10-16T19:41:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.116+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56d80c6c20 con 0x7f56d8153260 2023-10-16T19:41:30.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.133+0000 7f56d57fa640 1 -- 172.21.15.57:0/1125054929 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56d0017020 con 0x7f56d8153260 2023-10-16T19:41:30.136 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-16T19:41:30.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.136+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f56c406aec0 msgr2=0x7f56c406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:30.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.136+0000 7f56def0c640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f56c406aec0 0x7f56c406d380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009b30 tx=0x7f56c8009240 comp rx=0 tx=0).stop 2023-10-16T19:41:30.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.136+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 msgr2=0x7f56d8159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:30.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.136+0000 7f56def0c640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 0x7f56d8159130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c3c0 tx=0x7f56d000c880 comp rx=0 tx=0).stop 2023-10-16T19:41:30.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 shutdown_connections 2023-10-16T19:41:30.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f56c406aec0 0x7f56c406d380 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56d8153260 0x7f56d8159130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56d80c8490 0x7f56d8141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 --2- 172.21.15.57:0/1125054929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d80c60c0 0x7f56d8157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 >> 172.21.15.57:0/1125054929 conn(0x7f56d806e790 msgr2=0x7f56d80c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 shutdown_connections 2023-10-16T19:41:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.137+0000 7f56def0c640 1 -- 172.21.15.57:0/1125054929 wait complete. 2023-10-16T19:41:30.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:41:30.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.376+0000 7ff25aa6b640 1 Processor -- start 2023-10-16T19:41:30.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.376+0000 7ff25aa6b640 1 -- start start 2023-10-16T19:41:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.377+0000 7ff25aa6b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff254151190 0x7ff2540c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.377+0000 7ff25aa6b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 0x7ff2540c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.377+0000 7ff25aa6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff25406da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.377+0000 7ff25aa6b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540c4010 con 0x7ff254151190 2023-10-16T19:41:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.377+0000 7ff25aa6b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540c1ce0 con 0x7ff2540c12f0 2023-10-16T19:41:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.377+0000 7ff25aa6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff254151570 con 0x7ff25406d5d0 2023-10-16T19:41:30.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.380+0000 7ff253fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 0x7ff2540c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:30.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.380+0000 7ff259008640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff25406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.381+0000 7ff253fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 0x7ff2540c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:45792/0 (socket says 172.21.15.57:45792) 2023-10-16T19:41:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.381+0000 7ff253fff640 1 -- 172.21.15.57:0/3016417180 learned_addr learned my addr 172.21.15.57:0/3016417180 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:30.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.389+0000 7ff259008640 1 -- 172.21.15.57:0/3016417180 >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 msgr2=0x7ff2540c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:30.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.389+0000 7ff259008640 1 --2- 172.21.15.57:0/3016417180 >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 0x7ff2540c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.389+0000 7ff259008640 1 -- 172.21.15.57:0/3016417180 >> v2:172.21.15.57:3300/0 conn(0x7ff254151190 msgr2=0x7ff2540c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:30.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.389+0000 7ff259008640 1 --2- 172.21.15.57:0/3016417180 >> v2:172.21.15.57:3300/0 conn(0x7ff254151190 0x7ff2540c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.389+0000 7ff259008640 1 -- 172.21.15.57:0/3016417180 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540c5530 con 0x7ff25406d5d0 2023-10-16T19:41:30.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.389+0000 7ff253fff640 1 --2- 172.21.15.57:0/3016417180 >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 0x7ff2540c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:41:30.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.396+0000 7ff259008640 1 --2- 172.21.15.57:0/3016417180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff25406da60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff254072140 tx=0x7ff24c02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1184b863fab8cc87 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.510+0000 7ff2537fe640 1 -- 172.21.15.57:0/3016417180 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02cbd0 con 0x7ff25406d5d0 2023-10-16T19:41:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.511+0000 7ff2537fe640 1 -- 172.21.15.57:0/3016417180 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c02cd30 con 0x7ff25406d5d0 2023-10-16T19:41:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.511+0000 7ff2537fe640 1 -- 172.21.15.57:0/3016417180 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02cea0 con 0x7ff25406d5d0 2023-10-16T19:41:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.512+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3016417180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 msgr2=0x7ff25406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.512+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3016417180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff25406da60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff254072140 tx=0x7ff24c02be20 comp rx=0 tx=0).stop 2023-10-16T19:41:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3016417180 shutdown_connections 2023-10-16T19:41:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3016417180 >> v2:172.21.15.110:3300/0 conn(0x7ff2540c12f0 0x7ff2540c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3016417180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff25406da60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3016417180 >> v2:172.21.15.57:3300/0 conn(0x7ff254151190 0x7ff2540c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3016417180 >> 172.21.15.57:0/3016417180 conn(0x7ff25406c430 msgr2=0x7ff254069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:30.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3016417180 shutdown_connections 2023-10-16T19:41:30.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.513+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3016417180 wait complete. 2023-10-16T19:41:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.516+0000 7ff25aa6b640 1 Processor -- start 2023-10-16T19:41:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.516+0000 7ff25aa6b640 1 -- start start 2023-10-16T19:41:30.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.518+0000 7ff25aa6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff254146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.518+0000 7ff25aa6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2540c12f0 0x7ff2540cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.518+0000 7ff25aa6b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff254151190 0x7ff254148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.518+0000 7ff25aa6b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff254157d30 con 0x7ff254151190 2023-10-16T19:41:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.518+0000 7ff25aa6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541ef6b0 con 0x7ff2540c12f0 2023-10-16T19:41:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.518+0000 7ff25aa6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541f0510 con 0x7ff25406d5d0 2023-10-16T19:41:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.520+0000 7ff253fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2540c12f0 0x7ff2540cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.520+0000 7ff258807640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff254146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:30.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.521+0000 7ff258807640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff254146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:42122/0 (socket says 172.21.15.57:42122) 2023-10-16T19:41:30.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.521+0000 7ff253fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2540c12f0 0x7ff2540cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:45794/0 (socket says 172.21.15.57:45794) 2023-10-16T19:41:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.521+0000 7ff258807640 1 -- 172.21.15.57:0/3510924469 learned_addr learned my addr 172.21.15.57:0/3510924469 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.522+0000 7ff259008640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff254151190 0x7ff254148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.527+0000 7ff259008640 1 -- 172.21.15.57:0/3510924469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 msgr2=0x7ff254146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.527+0000 7ff259008640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff254146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.527+0000 7ff259008640 1 -- 172.21.15.57:0/3510924469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2540c12f0 msgr2=0x7ff2540cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.527+0000 7ff259008640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2540c12f0 0x7ff2540cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.527+0000 7ff259008640 1 -- 172.21.15.57:0/3510924469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400094d0 con 0x7ff254151190 2023-10-16T19:41:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.531+0000 7ff259008640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff254151190 0x7ff254148870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff24c033000 tx=0x7ff24c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:30.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.539+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02cea0 con 0x7ff254151190 2023-10-16T19:41:30.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.539+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c040450 con 0x7ff254151190 2023-10-16T19:41:30.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.539+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c009a70 con 0x7ff254151190 2023-10-16T19:41:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.539+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c040800 con 0x7ff254151190 2023-10-16T19:41:30.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.540+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2541efbe0 con 0x7ff254151190 2023-10-16T19:41:30.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.541+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2540c1fd0 con 0x7ff254151190 2023-10-16T19:41:30.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.822+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff24c040960 con 0x7ff254151190 2023-10-16T19:41:30.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.825+0000 7ff2517fa640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff23806aec0 0x7ff23806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:30.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.825+0000 7ff258807640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff23806aec0 0x7ff23806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:30.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.826+0000 7ff258807640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff23806aec0 0x7ff23806d380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff248009a40 tx=0x7ff2480091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.838+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff24c07b5f0 con 0x7ff254151190 2023-10-16T19:41:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:30.839+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff24c077930 con 0x7ff254151190 2023-10-16T19:41:31.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.093+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff254148650 con 0x7ff254151190 2023-10-16T19:41:31.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.132+0000 7ff2517fa640 1 -- 172.21.15.57:0/3510924469 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6550 (secure 0 0 0) 0x7ff24c07af50 con 0x7ff254151190 2023-10-16T19:41:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:40:59.056046+0000","modified":"2023-10-16T19:41:22.177275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4250,"mds_1":4247,"mds_2":4244,"mds_3":4231,"mds_4":4224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4224":{"gid":4224,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4231":{"gid":4231,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"d","rank":1,"incarnation":8,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:41:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2023-10-16T19:41:31.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff23806aec0 msgr2=0x7ff23806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff23806aec0 0x7ff23806d380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff248009a40 tx=0x7ff2480091c0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff254151190 msgr2=0x7ff254148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff254151190 0x7ff254148870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff24c033000 tx=0x7ff24c004a40 comp rx=0 tx=0).stop 2023-10-16T19:41:31.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 shutdown_connections 2023-10-16T19:41:31.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7ff23806aec0 0x7ff23806d380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff254151190 0x7ff254148870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2540c12f0 0x7ff2540cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 --2- 172.21.15.57:0/3510924469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25406d5d0 0x7ff254146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 >> 172.21.15.57:0/3510924469 conn(0x7ff25406c430 msgr2=0x7ff254069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:31.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 shutdown_connections 2023-10-16T19:41:31.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.136+0000 7ff25aa6b640 1 -- 172.21.15.57:0/3510924469 wait complete. 2023-10-16T19:41:31.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:31.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.379+0000 7f251e318640 1 Processor -- start 2023-10-16T19:41:31.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.379+0000 7f251e318640 1 -- start start 2023-10-16T19:41:31.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.381+0000 7f251e318640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.381+0000 7f251e318640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180c7680 con 0x7f251806c390 2023-10-16T19:41:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.381+0000 7f251e318640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180c83e0 con 0x7f251815cfb0 2023-10-16T19:41:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.381+0000 7f251e318640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180c9060 con 0x7f2518156650 2023-10-16T19:41:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.382+0000 7f25177fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f251806c390 0x7f251815c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34324/0 (socket says 172.21.15.57:34324) 2023-10-16T19:41:31.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.382+0000 7f25177fe640 1 -- 172.21.15.57:0/1023735426 learned_addr learned my addr 172.21.15.57:0/1023735426 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:31.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.383+0000 7f2517fff640 1 --2- 172.21.15.57:0/1023735426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.386+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044835439 0 0) 0x7f25180c7680 con 0x7f251806c390 2023-10-16T19:41:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.386+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2500003520 con 0x7f251806c390 2023-10-16T19:41:31.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.389+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993470704 0 0) 0x7f25180c83e0 con 0x7f251815cfb0 2023-10-16T19:41:31.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.390+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25180c7680 con 0x7f251815cfb0 2023-10-16T19:41:31.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.390+0000 7f2517fff640 1 -- 172.21.15.57:0/1023735426 >> v1:172.21.15.110:6789/0 conn(0x7f251815cfb0 legacy=0x7f2518163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.390+0000 7f2517fff640 1 -- 172.21.15.57:0/1023735426 >> v1:172.21.15.57:6789/0 conn(0x7f251806c390 legacy=0x7f251815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.390+0000 7f2517fff640 1 -- 172.21.15.57:0/1023735426 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180c86c0 con 0x7f2518156650 2023-10-16T19:41:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.396+0000 7f2517fff640 1 --2- 172.21.15.57:0/1023735426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251806fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2508009dc0 tx=0x7f250802bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f203fa297e2d56e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:31.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250802cd60 con 0x7f2518156650 2023-10-16T19:41:31.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508034440 con 0x7f2518156650 2023-10-16T19:41:31.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f2516ffd640 1 -- 172.21.15.57:0/1023735426 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080347d0 con 0x7f2518156650 2023-10-16T19:41:31.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f251e318640 1 -- 172.21.15.57:0/1023735426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 msgr2=0x7f251806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f251e318640 1 --2- 172.21.15.57:0/1023735426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251806fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2508009dc0 tx=0x7f250802bfb0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f251e318640 1 -- 172.21.15.57:0/1023735426 shutdown_connections 2023-10-16T19:41:31.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f251e318640 1 --2- 172.21.15.57:0/1023735426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251806fd50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f251e318640 1 -- 172.21.15.57:0/1023735426 >> 172.21.15.57:0/1023735426 conn(0x7f251806ebc0 msgr2=0x7f251806efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:31.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.406+0000 7f251e318640 1 -- 172.21.15.57:0/1023735426 shutdown_connections 2023-10-16T19:41:31.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.407+0000 7f251e318640 1 -- 172.21.15.57:0/1023735426 wait complete. 2023-10-16T19:41:31.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.408+0000 7f251e318640 1 Processor -- start 2023-10-16T19:41:31.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.409+0000 7f251e318640 1 -- start start 2023-10-16T19:41:31.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.410+0000 7f251e318640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 0x7f25180ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:31.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.410+0000 7f251e318640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:31.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.410+0000 7f251e318640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251815cfb0 0x7f25181edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:31.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.410+0000 7f251e318640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180ad210 con 0x7f251806c390 2023-10-16T19:41:31.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.410+0000 7f251e318640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25181ee8b0 con 0x7f251815cfb0 2023-10-16T19:41:31.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.410+0000 7f251e318640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25181eeb70 con 0x7f2518156650 2023-10-16T19:41:31.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.411+0000 7f2517fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 0x7f25180ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:31.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.411+0000 7f2517fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 0x7f25180ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34916/0 (socket says 172.21.15.57:34916) 2023-10-16T19:41:31.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.411+0000 7f2517fff640 1 -- 172.21.15.57:0/3446178028 learned_addr learned my addr 172.21.15.57:0/3446178028 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.411+0000 7f251c8b5640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251815cfb0 0x7f25181edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.412+0000 7f25177fe640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:31.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.416+0000 7f2517fff640 1 -- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 msgr2=0x7f251814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.416+0000 7f2517fff640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.416+0000 7f2517fff640 1 -- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251815cfb0 msgr2=0x7f25181edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.416+0000 7f2517fff640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251815cfb0 0x7f25181edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.416+0000 7f2517fff640 1 -- 172.21.15.57:0/3446178028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508009a70 con 0x7f251806c390 2023-10-16T19:41:31.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.419+0000 7f2517fff640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 0x7f25180ca560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2508000f80 tx=0x7f2508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.425+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250803e410 con 0x7f251806c390 2023-10-16T19:41:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.425+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250803e570 con 0x7f251806c390 2023-10-16T19:41:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.425+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25181eee50 con 0x7f251806c390 2023-10-16T19:41:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.425+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250803e920 con 0x7f251806c390 2023-10-16T19:41:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.425+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25180acbc0 con 0x7f251806c390 2023-10-16T19:41:31.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.426+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251804e1d0 con 0x7f251806c390 2023-10-16T19:41:31.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.727+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f250803b050 con 0x7f251806c390 2023-10-16T19:41:31.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.729+0000 7f2514ff9640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f250406aec0 0x7f250406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:31.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.730+0000 7f25177fe640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f250406aec0 0x7f250406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.731+0000 7f25177fe640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f250406aec0 0x7f250406d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f251814aca0 tx=0x7f250c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.765+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f250807b020 con 0x7f251806c390 2023-10-16T19:41:31.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.767+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2508077360 con 0x7f251806c390 2023-10-16T19:41:31.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:31.983+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25180731a0 con 0x7f251806c390 2023-10-16T19:41:32.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.076+0000 7f2514ff9640 1 -- 172.21.15.57:0/3446178028 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f250804e070 con 0x7f251806c390 2023-10-16T19:41:32.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:32.080 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f250406aec0 msgr2=0x7f250406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f250406aec0 0x7f250406d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f251814aca0 tx=0x7f250c007d30 comp rx=0 tx=0).stop 2023-10-16T19:41:32.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 msgr2=0x7f25180ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 0x7f25180ca560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2508000f80 tx=0x7f2508004a40 comp rx=0 tx=0).stop 2023-10-16T19:41:32.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 shutdown_connections 2023-10-16T19:41:32.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f250406aec0 0x7f250406d380 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251815cfb0 0x7f25181edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518156650 0x7f251814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 --2- 172.21.15.57:0/3446178028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251806c390 0x7f25180ca560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.080+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 >> 172.21.15.57:0/3446178028 conn(0x7f251806ebc0 msgr2=0x7f2518151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:32.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.081+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 shutdown_connections 2023-10-16T19:41:32.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.081+0000 7f251e318640 1 -- 172.21.15.57:0/3446178028 wait complete. 2023-10-16T19:41:32.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:40:38.255594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:40:53.908842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:40:56.364727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:41:32.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:41:32.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.325+0000 7fac11eec640 1 Processor -- start 2023-10-16T19:41:32.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.325+0000 7fac11eec640 1 -- start start 2023-10-16T19:41:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.327+0000 7fac11eec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac0c14fcb0 0x7fac0c159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.327+0000 7fac11eec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c159e90 con 0x7fac0c0c91e0 2023-10-16T19:41:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.327+0000 7fac11eec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c15c620 con 0x7fac0c066450 2023-10-16T19:41:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.327+0000 7fac11eec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0c97b0 con 0x7fac0c14fcb0 2023-10-16T19:41:32.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.328+0000 7fac0bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fac0c0c91e0 0x7fac0c0ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34336/0 (socket says 172.21.15.57:34336) 2023-10-16T19:41:32.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.328+0000 7fac0bfff640 1 -- 172.21.15.57:0/2831187964 learned_addr learned my addr 172.21.15.57:0/2831187964 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:32.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.331+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033697695 0 0) 0x7fac04001490 con 0x7fac0c0c91e0 2023-10-16T19:41:32.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.331+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf8003520 con 0x7fac0c0c91e0 2023-10-16T19:41:32.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722715173 0 0) 0x7fabf8003520 con 0x7fac0c0c91e0 2023-10-16T19:41:32.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac0c14fcb0 msgr2=0x7fac0c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:32.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac0c14fcb0 0x7fac0c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 >> v1:172.21.15.110:6789/0 conn(0x7fac0c066450 legacy=0x7fac0c0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c15c8c0 con 0x7fac0c0c91e0 2023-10-16T19:41:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7fac04001b80 con 0x7fac0c0c91e0 2023-10-16T19:41:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 >> v1:172.21.15.57:6789/0 conn(0x7fac0c0c91e0 legacy=0x7fac0c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac0c14fcb0 0x7fabf80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf80040e0 0x7fabf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabf8004e20 0x7fabf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0c97b0 con 0x7fabf8004e20 2023-10-16T19:41:32.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80055c0 con 0x7fabf80040e0 2023-10-16T19:41:32.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.335+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf800bec0 con 0x7fac0c14fcb0 2023-10-16T19:41:32.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.340+0000 7fac0bfff640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabf8004e20 0x7fabf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.342+0000 7fac0bfff640 1 -- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac0c14fcb0 msgr2=0x7fabf80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.342+0000 7fac0bfff640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac0c14fcb0 0x7fabf80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.342+0000 7fac0bfff640 1 -- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf80040e0 msgr2=0x7fabf80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:32.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.342+0000 7fac0bfff640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf80040e0 0x7fabf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.342+0000 7fac0bfff640 1 -- 172.21.15.57:0/2831187964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8003520 con 0x7fabf8004e20 2023-10-16T19:41:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.345+0000 7fac0bfff640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabf8004e20 0x7fabf800b980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a760 tx=0x7fabf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7ff8bf03490ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:32.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040072d0 con 0x7fabf8004e20 2023-10-16T19:41:32.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0402f070 con 0x7fabf8004e20 2023-10-16T19:41:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac0affd640 1 -- 172.21.15.57:0/2831187964 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040076b0 con 0x7fabf8004e20 2023-10-16T19:41:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac11eec640 1 -- 172.21.15.57:0/2831187964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabf8004e20 msgr2=0x7fabf800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac11eec640 1 --2- 172.21.15.57:0/2831187964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabf8004e20 0x7fabf800b980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a760 tx=0x7fabf80057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac0bfff640 1 -- 172.21.15.57:0/2831187964 reap_dead start 2023-10-16T19:41:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac11eec640 1 -- 172.21.15.57:0/2831187964 shutdown_connections 2023-10-16T19:41:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac11eec640 1 -- 172.21.15.57:0/2831187964 >> 172.21.15.57:0/2831187964 conn(0x7fac0c069f70 msgr2=0x7fac0c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac11eec640 1 -- 172.21.15.57:0/2831187964 shutdown_connections 2023-10-16T19:41:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.349+0000 7fac11eec640 1 -- 172.21.15.57:0/2831187964 wait complete. 2023-10-16T19:41:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.352+0000 7fac11eec640 1 Processor -- start 2023-10-16T19:41:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.352+0000 7fac11eec640 1 -- start start 2023-10-16T19:41:32.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.353+0000 7fac11eec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabf8004e20 0x7fac0c1ef070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.353+0000 7fac11eec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac0c158c00 0x7fac0c0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.353+0000 7fac11eec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 0x7fac0c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.353+0000 7fac11eec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c156b30 con 0x7fac0c0c89c0 2023-10-16T19:41:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.353+0000 7fac11eec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1530a0 con 0x7fac0c158c00 2023-10-16T19:41:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.353+0000 7fac11eec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c157600 con 0x7fabf8004e20 2023-10-16T19:41:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.354+0000 7fac0bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 0x7fac0c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.354+0000 7fac0bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 0x7fac0c1470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34934/0 (socket says 172.21.15.57:34934) 2023-10-16T19:41:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.354+0000 7fac0bfff640 1 -- 172.21.15.57:0/3576969602 learned_addr learned my addr 172.21.15.57:0/3576969602 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.360+0000 7fac0bfff640 1 -- 172.21.15.57:0/3576969602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabf8004e20 msgr2=0x7fac0c1ef070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.360+0000 7fac0bfff640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabf8004e20 0x7fac0c1ef070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.360+0000 7fac0bfff640 1 -- 172.21.15.57:0/3576969602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac0c158c00 msgr2=0x7fac0c0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.360+0000 7fac0bfff640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac0c158c00 0x7fac0c0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.360+0000 7fac0bfff640 1 -- 172.21.15.57:0/3576969602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c156d60 con 0x7fac0c0c89c0 2023-10-16T19:41:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.363+0000 7fac0bfff640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 0x7fac0c1470b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a880 tx=0x7fac0c0b1d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.368+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04042070 con 0x7fac0c0c89c0 2023-10-16T19:41:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.368+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04001ad0 con 0x7fac0c0c89c0 2023-10-16T19:41:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.368+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04004b60 con 0x7fac0c0c89c0 2023-10-16T19:41:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.368+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c157040 con 0x7fac0c0c89c0 2023-10-16T19:41:32.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.368+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c1ee870 con 0x7fac0c0c89c0 2023-10-16T19:41:32.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.369+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c1ee6d0 con 0x7fac0c0c89c0 2023-10-16T19:41:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.665+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac04031030 con 0x7fac0c0c89c0 2023-10-16T19:41:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.666+0000 7fac08ff9640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fabec06aec0 0x7fabec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.667+0000 7fac0b7fe640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fabec06aec0 0x7fabec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:32.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.668+0000 7fac0b7fe640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fabec06aec0 0x7fabec06d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0096b0 tx=0x7fabfc006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:32.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.678+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fac0407a770 con 0x7fac0c0c89c0 2023-10-16T19:41:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.679+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac040763b0 con 0x7fac0c0c89c0 2023-10-16T19:41:32.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.900+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac0c15cb80 con 0x7fac0c0c89c0 2023-10-16T19:41:32.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.917+0000 7fac08ff9640 1 -- 172.21.15.57:0/3576969602 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac0c15cb80 con 0x7fac0c0c89c0 2023-10-16T19:41:32.919 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-16T19:41:32.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.920+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fabec06aec0 msgr2=0x7fabec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.920+0000 7fac11eec640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fabec06aec0 0x7fabec06d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0096b0 tx=0x7fabfc006ca0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.920+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 msgr2=0x7fac0c1470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.920+0000 7fac11eec640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 0x7fac0c1470b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a880 tx=0x7fac0c0b1d20 comp rx=0 tx=0).stop 2023-10-16T19:41:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 shutdown_connections 2023-10-16T19:41:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fabec06aec0 0x7fabec06d380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0c89c0 0x7fac0c1470b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac0c158c00 0x7fac0c0b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 --2- 172.21.15.57:0/3576969602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabf8004e20 0x7fac0c1ef070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:32.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 >> 172.21.15.57:0/3576969602 conn(0x7fac0c069f70 msgr2=0x7fac0c147d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:32.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 shutdown_connections 2023-10-16T19:41:32.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:32.921+0000 7fac11eec640 1 -- 172.21.15.57:0/3576969602 wait complete. 2023-10-16T19:41:32.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:41:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.156+0000 7f891abb6640 1 Processor -- start 2023-10-16T19:41:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.156+0000 7f891abb6640 1 -- start start 2023-10-16T19:41:33.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.158+0000 7f891abb6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f891414fd00 0x7f8914155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:33.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.158+0000 7f891abb6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8914156000 con 0x7f89140c40b0 2023-10-16T19:41:33.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.158+0000 7f891abb6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89140c5af0 con 0x7f89140c5620 2023-10-16T19:41:33.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.158+0000 7f891abb6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140c5dd0 con 0x7f891414fd00 2023-10-16T19:41:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.159+0000 7f8918952640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f891414fd00 0x7f8914155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.160+0000 7f8913fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f89140c5620 0x7f89140c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:38142/0 (socket says 172.21.15.57:38142) 2023-10-16T19:41:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.160+0000 7f8913fff640 1 -- 172.21.15.57:0/2990133244 learned_addr learned my addr 172.21.15.57:0/2990133244 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:33.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.164+0000 7f8918952640 1 -- 172.21.15.57:0/2990133244 >> v1:172.21.15.110:6789/0 conn(0x7f89140c5620 legacy=0x7f89140c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.164+0000 7f8918952640 1 -- 172.21.15.57:0/2990133244 >> v1:172.21.15.57:6789/0 conn(0x7f89140c40b0 legacy=0x7f8914069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.164+0000 7f8918952640 1 -- 172.21.15.57:0/2990133244 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140c60b0 con 0x7f891414fd00 2023-10-16T19:41:33.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.168+0000 7f8918952640 1 --2- 172.21.15.57:0/2990133244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891414fd00 0x7f8914155ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f89080097a0 tx=0x7f890802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b54c57647a3234 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.175+0000 7f89137fe640 1 -- 172.21.15.57:0/2990133244 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890802f810 con 0x7f891414fd00 2023-10-16T19:41:33.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.175+0000 7f89137fe640 1 -- 172.21.15.57:0/2990133244 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890802f970 con 0x7f891414fd00 2023-10-16T19:41:33.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.175+0000 7f89137fe640 1 -- 172.21.15.57:0/2990133244 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890802fd00 con 0x7f891414fd00 2023-10-16T19:41:33.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 -- 172.21.15.57:0/2990133244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891414fd00 msgr2=0x7f8914155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 --2- 172.21.15.57:0/2990133244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891414fd00 0x7f8914155ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f89080097a0 tx=0x7f890802b9f0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 -- 172.21.15.57:0/2990133244 shutdown_connections 2023-10-16T19:41:33.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 --2- 172.21.15.57:0/2990133244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891414fd00 0x7f8914155ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 -- 172.21.15.57:0/2990133244 >> 172.21.15.57:0/2990133244 conn(0x7f89140c6ea0 msgr2=0x7f89140c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:33.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 -- 172.21.15.57:0/2990133244 shutdown_connections 2023-10-16T19:41:33.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.176+0000 7f891abb6640 1 -- 172.21.15.57:0/2990133244 wait complete. 2023-10-16T19:41:33.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.178+0000 7f891abb6640 1 Processor -- start 2023-10-16T19:41:33.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.178+0000 7f891abb6640 1 -- start start 2023-10-16T19:41:33.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.179+0000 7f891abb6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89140c40b0 0x7f89141ec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:33.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.179+0000 7f891abb6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 0x7f8914145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:33.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.179+0000 7f891abb6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f891414fd00 0x7f89140c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:33.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.179+0000 7f891abb6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8914147b10 con 0x7f89140c5620 2023-10-16T19:41:33.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.179+0000 7f891abb6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89141eca40 con 0x7f891414fd00 2023-10-16T19:41:33.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.179+0000 7f891abb6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89141ef010 con 0x7f89140c40b0 2023-10-16T19:41:33.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.180+0000 7f8913fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 0x7f8914145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:33.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.181+0000 7f8913fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 0x7f8914145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34958/0 (socket says 172.21.15.57:34958) 2023-10-16T19:41:33.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.181+0000 7f8913fff640 1 -- 172.21.15.57:0/4138289812 learned_addr learned my addr 172.21.15.57:0/4138289812 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:33.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.181+0000 7f8919153640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f891414fd00 0x7f89140c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:33.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.181+0000 7f8918952640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89140c40b0 0x7f89141ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:33.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.185+0000 7f8913fff640 1 -- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89140c40b0 msgr2=0x7f89141ec500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.185+0000 7f8913fff640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89140c40b0 0x7f89141ec500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.185+0000 7f8913fff640 1 -- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f891414fd00 msgr2=0x7f89140c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.185+0000 7f8913fff640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f891414fd00 0x7f89140c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.185+0000 7f8913fff640 1 -- 172.21.15.57:0/4138289812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8908009400 con 0x7f89140c5620 2023-10-16T19:41:33.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.188+0000 7f8913fff640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 0x7f8914145cf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f890000c4d0 tx=0x7f890000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.193+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900005ce0 con 0x7f89140c5620 2023-10-16T19:41:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.193+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8900005e40 con 0x7f89140c5620 2023-10-16T19:41:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.193+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900007270 con 0x7f89140c5620 2023-10-16T19:41:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.193+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89141ef260 con 0x7f89140c5620 2023-10-16T19:41:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.193+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89141ef820 con 0x7f89140c5620 2023-10-16T19:41:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.194+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914147cc0 con 0x7f89140c5620 2023-10-16T19:41:33.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.496+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f89000073d0 con 0x7f89140c5620 2023-10-16T19:41:33.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.498+0000 7f89117fa640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88f806aef0 0x7f88f806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:33.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.499+0000 7f8918952640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88f806aef0 0x7f88f806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.500+0000 7f8918952640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88f806aef0 0x7f88f806d3b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8908036000 tx=0x7f8908008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:33.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.535+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8900057ea0 con 0x7f89140c5620 2023-10-16T19:41:33.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.537+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89000541e0 con 0x7f89140c5620 2023-10-16T19:41:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.744+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8914147cc0 con 0x7f89140c5620 2023-10-16T19:41:33.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.779+0000 7f89117fa640 1 -- 172.21.15.57:0/4138289812 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8914147cc0 con 0x7f89140c5620 2023-10-16T19:41:33.781 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-16T19:41:33.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88f806aef0 msgr2=0x7f88f806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88f806aef0 0x7f88f806d3b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8908036000 tx=0x7f8908008030 comp rx=0 tx=0).stop 2023-10-16T19:41:33.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 msgr2=0x7f8914145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:33.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 0x7f8914145cf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f890000c4d0 tx=0x7f890000c990 comp rx=0 tx=0).stop 2023-10-16T19:41:33.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 shutdown_connections 2023-10-16T19:41:33.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f88f806aef0 0x7f88f806d3b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f891414fd00 0x7f89140c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89140c5620 0x7f8914145cf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 --2- 172.21.15.57:0/4138289812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89140c40b0 0x7f89141ec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:33.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.782+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 >> 172.21.15.57:0/4138289812 conn(0x7f89140c6ea0 msgr2=0x7f89140c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:33.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.783+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 shutdown_connections 2023-10-16T19:41:33.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:33.783+0000 7f891abb6640 1 -- 172.21.15.57:0/4138289812 wait complete. 2023-10-16T19:41:33.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:41:34.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.027+0000 7fefd759e640 1 Processor -- start 2023-10-16T19:41:34.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.027+0000 7fefd759e640 1 -- start start 2023-10-16T19:41:34.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.030+0000 7fefd759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefd80c5710 0x7fefd80c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:34.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.030+0000 7fefd759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd806fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:34.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.031+0000 7fefd759e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd806ba90 con 0x7fefd8153240 2023-10-16T19:41:34.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.031+0000 7fefd759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80708e0 con 0x7fefd80c5710 2023-10-16T19:41:34.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.031+0000 7fefd759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8158ef0 con 0x7fefd806f9f0 2023-10-16T19:41:34.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.032+0000 7fefd6d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd806fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:34.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.033+0000 7fefd6d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd806fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:42170/0 (socket says 172.21.15.57:42170) 2023-10-16T19:41:34.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.033+0000 7fefd6d9d640 1 -- 172.21.15.57:0/1760838040 learned_addr learned my addr 172.21.15.57:0/1760838040 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:34.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.033+0000 7fefd5d9b640 1 --2- 172.21.15.57:0/1760838040 >> v2:172.21.15.110:3300/0 conn(0x7fefd80c5710 0x7fefd80c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:34.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.039+0000 7fefd6d9d640 1 -- 172.21.15.57:0/1760838040 >> v2:172.21.15.110:3300/0 conn(0x7fefd80c5710 msgr2=0x7fefd80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:34.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.039+0000 7fefd6d9d640 1 --2- 172.21.15.57:0/1760838040 >> v2:172.21.15.110:3300/0 conn(0x7fefd80c5710 0x7fefd80c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.039+0000 7fefd6d9d640 1 -- 172.21.15.57:0/1760838040 >> v1:172.21.15.110:6789/0 conn(0x7fefd8153240 legacy=0x7fefd8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:34.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.039+0000 7fefd6d9d640 1 -- 172.21.15.57:0/1760838040 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8153620 con 0x7fefd806f9f0 2023-10-16T19:41:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.045+0000 7fefd6d9d640 1 --2- 172.21.15.57:0/1760838040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd806fe40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009870 tx=0x7fefd002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e5d460521f8a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.055+0000 7fefd559a640 1 -- 172.21.15.57:0/1760838040 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0030840 con 0x7fefd806f9f0 2023-10-16T19:41:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.055+0000 7fefd559a640 1 -- 172.21.15.57:0/1760838040 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00309a0 con 0x7fefd806f9f0 2023-10-16T19:41:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.055+0000 7fefd559a640 1 -- 172.21.15.57:0/1760838040 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0030d30 con 0x7fefd806f9f0 2023-10-16T19:41:34.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 -- 172.21.15.57:0/1760838040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 msgr2=0x7fefd806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:34.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 --2- 172.21.15.57:0/1760838040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd806fe40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009870 tx=0x7fefd002b980 comp rx=0 tx=0).stop 2023-10-16T19:41:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 -- 172.21.15.57:0/1760838040 shutdown_connections 2023-10-16T19:41:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 --2- 172.21.15.57:0/1760838040 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd806fe40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 --2- 172.21.15.57:0/1760838040 >> v2:172.21.15.110:3300/0 conn(0x7fefd80c5710 0x7fefd80c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 -- 172.21.15.57:0/1760838040 >> 172.21.15.57:0/1760838040 conn(0x7fefd80ca380 msgr2=0x7fefd80ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:34.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 -- 172.21.15.57:0/1760838040 shutdown_connections 2023-10-16T19:41:34.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.057+0000 7fefd759e640 1 -- 172.21.15.57:0/1760838040 wait complete. 2023-10-16T19:41:34.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.061+0000 7fefd759e640 1 Processor -- start 2023-10-16T19:41:34.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.061+0000 7fefd759e640 1 -- start start 2023-10-16T19:41:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.063+0000 7fefd759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.063+0000 7fefd759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd80c5710 0x7fefd814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.064+0000 7fefd759e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefd8153240 0x7fefd815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.064+0000 7fefd759e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd81ee760 con 0x7fefd8153240 2023-10-16T19:41:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.064+0000 7fefd759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80c1170 con 0x7fefd80c5710 2023-10-16T19:41:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.064+0000 7fefd759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80c0e90 con 0x7fefd806f9f0 2023-10-16T19:41:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.065+0000 7fefd659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.065+0000 7fefd5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd80c5710 0x7fefd814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.066+0000 7fefd659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd80c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:42186/0 (socket says 172.21.15.57:42186) 2023-10-16T19:41:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.066+0000 7fefd659c640 1 -- 172.21.15.57:0/458253637 learned_addr learned my addr 172.21.15.57:0/458253637 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:34.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.076+0000 7fefd659c640 1 -- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd80c5710 msgr2=0x7fefd814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:34.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.076+0000 7fefd659c640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd80c5710 0x7fefd814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.076+0000 7fefd659c640 1 -- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefd8153240 msgr2=0x7fefd815c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.076+0000 7fefd659c640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefd8153240 0x7fefd815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.076+0000 7fefd659c640 1 -- 172.21.15.57:0/458253637 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00094d0 con 0x7fefd806f9f0 2023-10-16T19:41:34.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.085+0000 7fefd659c640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd80c97e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c730 tx=0x7fefc800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.195+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8003b70 con 0x7fefd806f9f0 2023-10-16T19:41:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.195+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8003cf0 con 0x7fefd806f9f0 2023-10-16T19:41:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.195+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8003ea0 con 0x7fefd806f9f0 2023-10-16T19:41:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.195+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8152290 con 0x7fefd806f9f0 2023-10-16T19:41:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.196+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8152850 con 0x7fefd806f9f0 2023-10-16T19:41:34.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.197+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd804e160 con 0x7fefd806f9f0 2023-10-16T19:41:34.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.252+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefc800aa90 con 0x7fefd806f9f0 2023-10-16T19:41:34.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.254+0000 7fefceffd640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fefb806aec0 0x7fefb806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:34.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.255+0000 7fefd5d9b640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fefb806aec0 0x7fefb806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:34.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.257+0000 7fefd5d9b640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fefb806aec0 0x7fefb806d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c7b50 tx=0x7fefc0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:34.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.551+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fefc800ce40 con 0x7fefd806f9f0 2023-10-16T19:41:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.584+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefc8054ef0 con 0x7fefd806f9f0 2023-10-16T19:41:34.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.794+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefd814c640 con 0x7fefd806f9f0 2023-10-16T19:41:34.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.805+0000 7fefceffd640 1 -- 172.21.15.57:0/458253637 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefc8058510 con 0x7fefd806f9f0 2023-10-16T19:41:34.807 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-16T19:41:34.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fefb806aec0 msgr2=0x7fefb806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fefb806aec0 0x7fefb806d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c7b50 tx=0x7fefc0009190 comp rx=0 tx=0).stop 2023-10-16T19:41:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 msgr2=0x7fefd80c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd80c97e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c730 tx=0x7fefc800cbf0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 shutdown_connections 2023-10-16T19:41:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fefb806aec0 0x7fefb806d380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefd8153240 0x7fefd815c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd80c5710 0x7fefd814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 --2- 172.21.15.57:0/458253637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefd806f9f0 0x7fefd80c97e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.808+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 >> 172.21.15.57:0/458253637 conn(0x7fefd80ca380 msgr2=0x7fefd8156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.809+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 shutdown_connections 2023-10-16T19:41:34.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:34.809+0000 7fefd759e640 1 -- 172.21.15.57:0/458253637 wait complete. 2023-10-16T19:41:34.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:41:35.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.047+0000 7f0f794fc640 1 Processor -- start 2023-10-16T19:41:35.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.048+0000 7f0f794fc640 1 -- start start 2023-10-16T19:41:35.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.050+0000 7f0f794fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f74152f40 0x7f0f7415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.050+0000 7f0f794fc640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f74159d60 con 0x7f0f740c9260 2023-10-16T19:41:35.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.050+0000 7f0f794fc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f740c3eb0 con 0x7f0f7415a7e0 2023-10-16T19:41:35.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.050+0000 7f0f794fc640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f74153320 con 0x7f0f74152f40 2023-10-16T19:41:35.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.051+0000 7f0f727fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0f7415a7e0 0x7f0f7406b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:38160/0 (socket says 172.21.15.57:38160) 2023-10-16T19:41:35.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.051+0000 7f0f727fc640 1 -- 172.21.15.57:0/1012386940 learned_addr learned my addr 172.21.15.57:0/1012386940 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.057+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315750901 0 0) 0x7f0f740c3eb0 con 0x7f0f7415a7e0 2023-10-16T19:41:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.058+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c003520 con 0x7f0f7415a7e0 2023-10-16T19:41:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.066+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/1012386940 >> v2:172.21.15.57:3300/0 conn(0x7f0f74152f40 0x7f0f7415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.068+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544350391 0 0) 0x7f0f5c003520 con 0x7f0f7415a7e0 2023-10-16T19:41:35.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.068+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 >> v2:172.21.15.57:3300/0 conn(0x7f0f74152f40 msgr2=0x7f0f7415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.068+0000 7f0f71ffb640 1 --2- 172.21.15.57:0/1012386940 >> v2:172.21.15.57:3300/0 conn(0x7f0f74152f40 0x7f0f7415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.068+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 >> v1:172.21.15.57:6789/0 conn(0x7f0f740c9260 legacy=0x7f0f74163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.068+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74158fa0 con 0x7f0f7415a7e0 2023-10-16T19:41:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.068+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f0f680016c0 con 0x7f0f7415a7e0 2023-10-16T19:41:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 >> v1:172.21.15.110:6789/0 conn(0x7f0f7415a7e0 legacy=0x7f0f7406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f5c0039c0 0x7f0f5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f5c0047c0 0x7f0f5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0051d0 0x7f0f5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00c0e0 con 0x7f0f5c0047c0 2023-10-16T19:41:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00c220 con 0x7f0f5c0051d0 2023-10-16T19:41:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.069+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00c3e0 con 0x7f0f5c0039c0 2023-10-16T19:41:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.070+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f5c0039c0 0x7f0f5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.078+0000 7f0f72ffd640 1 -- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0051d0 msgr2=0x7f0f5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.078+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0051d0 0x7f0f5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.078+0000 7f0f72ffd640 1 -- 172.21.15.57:0/1012386940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f5c0047c0 msgr2=0x7f0f5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.078+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f5c0047c0 0x7f0f5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.078+0000 7f0f72ffd640 1 -- 172.21.15.57:0/1012386940 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c003520 con 0x7f0f5c0039c0 2023-10-16T19:41:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.078+0000 7f0f737fe640 1 -- 172.21.15.57:0/1012386940 reap_dead start 2023-10-16T19:41:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.083+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f5c0039c0 0x7f0f5c003dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400ba30 tx=0x7f0f5c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d230cc1bbddd73 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:35.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.093+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64032660 con 0x7f0f5c0039c0 2023-10-16T19:41:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.093+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640327c0 con 0x7f0f5c0039c0 2023-10-16T19:41:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.093+0000 7f0f71ffb640 1 -- 172.21.15.57:0/1012386940 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64032b90 con 0x7f0f5c0039c0 2023-10-16T19:41:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.094+0000 7f0f794fc640 1 -- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f5c0039c0 msgr2=0x7f0f5c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.094+0000 7f0f794fc640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f5c0039c0 0x7f0f5c003dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400ba30 tx=0x7f0f5c0057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.095+0000 7f0f794fc640 1 -- 172.21.15.57:0/1012386940 shutdown_connections 2023-10-16T19:41:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.095+0000 7f0f794fc640 1 --2- 172.21.15.57:0/1012386940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f5c0039c0 0x7f0f5c003dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.095+0000 7f0f794fc640 1 -- 172.21.15.57:0/1012386940 >> 172.21.15.57:0/1012386940 conn(0x7f0f74071900 msgr2=0x7f0f7406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.095+0000 7f0f794fc640 1 -- 172.21.15.57:0/1012386940 shutdown_connections 2023-10-16T19:41:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.095+0000 7f0f794fc640 1 -- 172.21.15.57:0/1012386940 wait complete. 2023-10-16T19:41:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.098+0000 7f0f794fc640 1 Processor -- start 2023-10-16T19:41:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.098+0000 7f0f794fc640 1 -- start start 2023-10-16T19:41:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.099+0000 7f0f794fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0039c0 0x7f0f741471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.099+0000 7f0f794fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 0x7f0f741edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.099+0000 7f0f794fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f740ce2d0 0x7f0f740c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.099+0000 7f0f794fc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f74156c10 con 0x7f0f7415b010 2023-10-16T19:41:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.099+0000 7f0f794fc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415bba0 con 0x7f0f5c0039c0 2023-10-16T19:41:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.099+0000 7f0f794fc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740ca9f0 con 0x7f0f740ce2d0 2023-10-16T19:41:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.100+0000 7f0f727fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 0x7f0f741edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.101+0000 7f0f72ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0039c0 0x7f0f741471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.101+0000 7f0f727fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 0x7f0f741edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35000/0 (socket says 172.21.15.57:35000) 2023-10-16T19:41:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.101+0000 7f0f727fc640 1 -- 172.21.15.57:0/3051691044 learned_addr learned my addr 172.21.15.57:0/3051691044 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.101+0000 7f0f737fe640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f740ce2d0 0x7f0f740c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.105+0000 7f0f727fc640 1 -- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f740ce2d0 msgr2=0x7f0f740c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.105+0000 7f0f727fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f740ce2d0 0x7f0f740c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.105+0000 7f0f727fc640 1 -- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0039c0 msgr2=0x7f0f741471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.105+0000 7f0f727fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0039c0 0x7f0f741471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.105+0000 7f0f727fc640 1 -- 172.21.15.57:0/3051691044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f741587c0 con 0x7f0f7415b010 2023-10-16T19:41:35.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.108+0000 7f0f727fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 0x7f0f741edc30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c730 tx=0x7f0f6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:35.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.112+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680072d0 con 0x7f0f7415b010 2023-10-16T19:41:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.112+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f68007450 con 0x7f0f7415b010 2023-10-16T19:41:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.112+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68004830 con 0x7f0f7415b010 2023-10-16T19:41:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.112+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f74158d10 con 0x7f0f7415b010 2023-10-16T19:41:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.112+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f74158a30 con 0x7f0f7415b010 2023-10-16T19:41:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.114+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f740676d0 con 0x7f0f7415b010 2023-10-16T19:41:35.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.138+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f6800a640 con 0x7f0f7415b010 2023-10-16T19:41:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.139+0000 7f0f5b7fe640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0f6006aec0 0x7f0f6006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.140+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0f6006aec0 0x7f0f6006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.141+0000 7f0f72ffd640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0f6006aec0 0x7f0f6006d380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400ba00 tx=0x7f0f6403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:35.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.419+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0f68058060 con 0x7f0f7415b010 2023-10-16T19:41:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.420+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f680543a0 con 0x7f0f7415b010 2023-10-16T19:41:35.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.680+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f7404e1d0 con 0x7f0f7415b010 2023-10-16T19:41:35.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.719+0000 7f0f5b7fe640 1 -- 172.21.15.57:0/3051691044 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6550 (secure 0 0 0) 0x7f0f68018070 con 0x7f0f7415b010 2023-10-16T19:41:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:35.722 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:40:59.056046+0000","modified":"2023-10-16T19:41:22.177275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4250,"mds_1":4247,"mds_2":4244,"mds_3":4231,"mds_4":4224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4224":{"gid":4224,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4231":{"gid":4231,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"d","rank":1,"incarnation":8,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:41:35.722 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2023-10-16T19:41:35.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0f6006aec0 msgr2=0x7f0f6006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0f6006aec0 0x7f0f6006d380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400ba00 tx=0x7f0f6403d040 comp rx=0 tx=0).stop 2023-10-16T19:41:35.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 msgr2=0x7f0f741edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 0x7f0f741edc30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c730 tx=0x7f0f6800cbf0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 shutdown_connections 2023-10-16T19:41:35.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f0f6006aec0 0x7f0f6006d380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f740ce2d0 0x7f0f740c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7415b010 0x7f0f741edc30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 --2- 172.21.15.57:0/3051691044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f5c0039c0 0x7f0f741471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.723+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 >> 172.21.15.57:0/3051691044 conn(0x7f0f74071900 msgr2=0x7f0f7406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:35.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.724+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 shutdown_connections 2023-10-16T19:41:35.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.724+0000 7f0f794fc640 1 -- 172.21.15.57:0/3051691044 wait complete. 2023-10-16T19:41:35.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:35.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.975+0000 7f73d8fa9640 1 Processor -- start 2023-10-16T19:41:35.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.975+0000 7f73d8fa9640 1 -- start start 2023-10-16T19:41:35.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.976+0000 7f73d8fa9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73d4153170 0x7f73d40c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.976+0000 7f73d8fa9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73d4158dc0 0x7f73d40c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.976+0000 7f73d8fa9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d40c9a30 con 0x7f73d40ca900 2023-10-16T19:41:35.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.976+0000 7f73d8fa9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d40c9260 con 0x7f73d4158dc0 2023-10-16T19:41:35.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.976+0000 7f73d8fa9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d40c4710 con 0x7f73d4153170 2023-10-16T19:41:35.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.977+0000 7f73cbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73d4158dc0 0x7f73d40c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:35.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.977+0000 7f73cbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73d4158dc0 0x7f73d40c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34076/0 (socket says 172.21.15.57:34076) 2023-10-16T19:41:35.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.977+0000 7f73cbfff640 1 -- 172.21.15.57:0/2134283588 learned_addr learned my addr 172.21.15.57:0/2134283588 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:35.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.980+0000 7f73cbfff640 1 -- 172.21.15.57:0/2134283588 >> v2:172.21.15.110:3300/0 conn(0x7f73d4153170 msgr2=0x7f73d40c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:35.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.980+0000 7f73cbfff640 1 --2- 172.21.15.57:0/2134283588 >> v2:172.21.15.110:3300/0 conn(0x7f73d4153170 0x7f73d40c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.980+0000 7f73cbfff640 1 -- 172.21.15.57:0/2134283588 >> v1:172.21.15.110:6789/0 conn(0x7f73d40ca900 legacy=0x7f73d406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:35.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.980+0000 7f73cbfff640 1 -- 172.21.15.57:0/2134283588 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4153550 con 0x7f73d4158dc0 2023-10-16T19:41:35.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.983+0000 7f73cbfff640 1 --2- 172.21.15.57:0/2134283588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4158dc0 0x7f73d40c3a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f73d40c93a0 tx=0x7f73bc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675536a27998a4b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.993+0000 7f73d1d9b640 1 -- 172.21.15.57:0/2134283588 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc031860 con 0x7f73d4158dc0 2023-10-16T19:41:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.993+0000 7f73d1d9b640 1 -- 172.21.15.57:0/2134283588 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0319c0 con 0x7f73d4158dc0 2023-10-16T19:41:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.993+0000 7f73d1d9b640 1 -- 172.21.15.57:0/2134283588 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc031d50 con 0x7f73d4158dc0 2023-10-16T19:41:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 -- 172.21.15.57:0/2134283588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4158dc0 msgr2=0x7f73d40c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/2134283588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4158dc0 0x7f73d40c3a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f73d40c93a0 tx=0x7f73bc02b900 comp rx=0 tx=0).stop 2023-10-16T19:41:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 -- 172.21.15.57:0/2134283588 shutdown_connections 2023-10-16T19:41:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/2134283588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4158dc0 0x7f73d40c3a90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/2134283588 >> v2:172.21.15.110:3300/0 conn(0x7f73d4153170 0x7f73d40c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 -- 172.21.15.57:0/2134283588 >> 172.21.15.57:0/2134283588 conn(0x7f73d4071720 msgr2=0x7f73d406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 -- 172.21.15.57:0/2134283588 shutdown_connections 2023-10-16T19:41:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.994+0000 7f73d8fa9640 1 -- 172.21.15.57:0/2134283588 wait complete. 2023-10-16T19:41:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.996+0000 7f73d8fa9640 1 Processor -- start 2023-10-16T19:41:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.996+0000 7f73d8fa9640 1 -- start start 2023-10-16T19:41:35.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.997+0000 7f73d8fa9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73d40ca900 0x7f73d41f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:35.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.997+0000 7f73d8fa9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4153170 0x7f73d40cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:36.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.998+0000 7f73d8fa9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73d4158dc0 0x7f73d414d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:36.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.998+0000 7f73d8fa9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cda70 con 0x7f73d4153170 2023-10-16T19:41:36.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.998+0000 7f73d8fa9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40ce4e0 con 0x7f73d4158dc0 2023-10-16T19:41:36.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.998+0000 7f73d8fa9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cdcc0 con 0x7f73d40ca900 2023-10-16T19:41:36.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:35.999+0000 7f73d259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73d40ca900 0x7f73d41f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:36.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.000+0000 7f73d259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73d40ca900 0x7f73d41f07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36368/0 (socket says 172.21.15.57:36368) 2023-10-16T19:41:36.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.000+0000 7f73d259c640 1 -- 172.21.15.57:0/1787204017 learned_addr learned my addr 172.21.15.57:0/1787204017 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.000+0000 7f73cbfff640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4153170 0x7f73d40cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.005+0000 7f73cbfff640 1 -- 172.21.15.57:0/1787204017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73d40ca900 msgr2=0x7f73d41f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.005+0000 7f73cbfff640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73d40ca900 0x7f73d41f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.005+0000 7f73cbfff640 1 -- 172.21.15.57:0/1787204017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73d4158dc0 msgr2=0x7f73d414d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.005+0000 7f73cbfff640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73d4158dc0 0x7f73d414d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.005+0000 7f73cbfff640 1 -- 172.21.15.57:0/1787204017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc0094d0 con 0x7f73d4153170 2023-10-16T19:41:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.008+0000 7f73cbfff640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4153170 0x7f73d40cdfa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73bc033000 tx=0x7f73bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.017+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc03adf0 con 0x7f73d4153170 2023-10-16T19:41:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.017+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0443f0 con 0x7f73d4153170 2023-10-16T19:41:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.017+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0447a0 con 0x7f73d4153170 2023-10-16T19:41:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.018+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d40cc790 con 0x7f73d4153170 2023-10-16T19:41:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.018+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d40ccd50 con 0x7f73d4153170 2023-10-16T19:41:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.019+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d404e1d0 con 0x7f73d4153170 2023-10-16T19:41:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.461+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f73bc04d450 con 0x7f73d4153170 2023-10-16T19:41:36.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.463+0000 7f73caffd640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f73b406ae70 0x7f73b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:36.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.464+0000 7f73d259c640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f73b406ae70 0x7f73b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.466+0000 7f73d259c640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f73b406ae70 0x7f73b406d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009a40 tx=0x7f73c40091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:36.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.498+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f73bc07b580 con 0x7f73d4153170 2023-10-16T19:41:36.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.499+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73bc0771c0 con 0x7f73d4153170 2023-10-16T19:41:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.710+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73d414d1f0 con 0x7f73d4153170 2023-10-16T19:41:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.803+0000 7f73caffd640 1 -- 172.21.15.57:0/1787204017 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f73bc07a7e0 con 0x7f73d4153170 2023-10-16T19:41:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:36.806 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:36.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.806+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f73b406ae70 msgr2=0x7f73b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:36.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.806+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f73b406ae70 0x7f73b406d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009a40 tx=0x7f73c40091c0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.806+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4153170 msgr2=0x7f73d40cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:36.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.806+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4153170 0x7f73d40cdfa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73bc033000 tx=0x7f73bc0046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 shutdown_connections 2023-10-16T19:41:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f73b406ae70 0x7f73b406d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73d4158dc0 0x7f73d414d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73d4153170 0x7f73d40cdfa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 --2- 172.21.15.57:0/1787204017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73d40ca900 0x7f73d41f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:36.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 >> 172.21.15.57:0/1787204017 conn(0x7f73d4071720 msgr2=0x7f73d4157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:36.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 shutdown_connections 2023-10-16T19:41:36.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:36.807+0000 7f73d8fa9640 1 -- 172.21.15.57:0/1787204017 wait complete. 2023-10-16T19:41:36.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:41:37.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.052+0000 7f2ac38fc640 1 Processor -- start 2023-10-16T19:41:37.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.052+0000 7f2ac38fc640 1 -- start start 2023-10-16T19:41:37.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.054+0000 7f2ac38fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2abc0c4ba0 0x7f2abc0c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:37.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.054+0000 7f2ac38fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc06b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.054+0000 7f2ac38fc640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc0c9a30 con 0x7f2abc153170 2023-10-16T19:41:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.054+0000 7f2ac38fc640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc0c9260 con 0x7f2abc0c4ba0 2023-10-16T19:41:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.054+0000 7f2ac38fc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0c4fe0 con 0x7f2abc0ca900 2023-10-16T19:41:37.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.057+0000 7f2ac0e97640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2abc0c4ba0 0x7f2abc0c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:37.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.058+0000 7f2ac0e97640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2abc0c4ba0 0x7f2abc0c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34106/0 (socket says 172.21.15.57:34106) 2023-10-16T19:41:37.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.058+0000 7f2ac0e97640 1 -- 172.21.15.57:0/3755654606 learned_addr learned my addr 172.21.15.57:0/3755654606 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.065+0000 7f2ac1e99640 1 --2- 172.21.15.57:0/3755654606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc06b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.074+0000 7f2ac1e99640 1 -- 172.21.15.57:0/3755654606 >> v2:172.21.15.57:3300/0 conn(0x7f2abc0c4ba0 msgr2=0x7f2abc0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.074+0000 7f2ac1e99640 1 --2- 172.21.15.57:0/3755654606 >> v2:172.21.15.57:3300/0 conn(0x7f2abc0c4ba0 0x7f2abc0c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.074+0000 7f2ac1e99640 1 -- 172.21.15.57:0/3755654606 >> v1:172.21.15.57:6789/0 conn(0x7f2abc153170 legacy=0x7f2abc158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.074+0000 7f2ac1e99640 1 -- 172.21.15.57:0/3755654606 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0c4710 con 0x7f2abc0ca900 2023-10-16T19:41:37.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.171+0000 7f2ac1e99640 1 --2- 172.21.15.57:0/3755654606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc06b910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40097a0 tx=0x7f2ab402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621c4d1457a130a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:37.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.183+0000 7f2ab3fff640 1 -- 172.21.15.57:0/3755654606 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab402e070 con 0x7f2abc0ca900 2023-10-16T19:41:37.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.183+0000 7f2ab3fff640 1 -- 172.21.15.57:0/3755654606 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab40315a0 con 0x7f2abc0ca900 2023-10-16T19:41:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.183+0000 7f2ab3fff640 1 -- 172.21.15.57:0/3755654606 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4031930 con 0x7f2abc0ca900 2023-10-16T19:41:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 -- 172.21.15.57:0/3755654606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 msgr2=0x7f2abc06b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/3755654606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc06b910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40097a0 tx=0x7f2ab402b840 comp rx=0 tx=0).stop 2023-10-16T19:41:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 -- 172.21.15.57:0/3755654606 shutdown_connections 2023-10-16T19:41:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/3755654606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc06b910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/3755654606 >> v2:172.21.15.57:3300/0 conn(0x7f2abc0c4ba0 0x7f2abc0c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 -- 172.21.15.57:0/3755654606 >> 172.21.15.57:0/3755654606 conn(0x7f2abc071720 msgr2=0x7f2abc06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 -- 172.21.15.57:0/3755654606 shutdown_connections 2023-10-16T19:41:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.185+0000 7f2ac38fc640 1 -- 172.21.15.57:0/3755654606 wait complete. 2023-10-16T19:41:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.189+0000 7f2ac38fc640 1 Processor -- start 2023-10-16T19:41:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.190+0000 7f2ac38fc640 1 -- start start 2023-10-16T19:41:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.192+0000 7f2ac38fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0c4ba0 0x7f2abc0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.192+0000 7f2ac38fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.192+0000 7f2ac38fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 0x7f2abc1e5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.192+0000 7f2ac38fc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0cd810 con 0x7f2abc153170 2023-10-16T19:41:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.192+0000 7f2ac38fc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0b3140 con 0x7f2abc0c4ba0 2023-10-16T19:41:37.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.192+0000 7f2ac38fc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0b21b0 con 0x7f2abc0ca900 2023-10-16T19:41:37.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.193+0000 7f2ac1e99640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 0x7f2abc1e5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:37.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.193+0000 7f2ac1e99640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 0x7f2abc1e5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34110/0 (socket says 172.21.15.57:34110) 2023-10-16T19:41:37.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.193+0000 7f2ac1e99640 1 -- 172.21.15.57:0/2761257545 learned_addr learned my addr 172.21.15.57:0/2761257545 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:37.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.194+0000 7f2ac1698640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0c4ba0 0x7f2abc0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:37.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.194+0000 7f2ac0e97640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:37.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.199+0000 7f2ac1e99640 1 -- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 msgr2=0x7f2abc0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:37.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.199+0000 7f2ac1e99640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.199+0000 7f2ac1e99640 1 -- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0c4ba0 msgr2=0x7f2abc0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:37.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.199+0000 7f2ac1e99640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0c4ba0 0x7f2abc0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.199+0000 7f2ac1e99640 1 -- 172.21.15.57:0/2761257545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4009400 con 0x7f2abc153170 2023-10-16T19:41:37.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.204+0000 7f2ac1e99640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 0x7f2abc1e5d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40098c0 tx=0x7f2ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:37.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.213+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4032840 con 0x7f2abc153170 2023-10-16T19:41:37.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.214+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab40329a0 con 0x7f2abc153170 2023-10-16T19:41:37.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.214+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4032d50 con 0x7f2abc153170 2023-10-16T19:41:37.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.214+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc0b3aa0 con 0x7f2abc153170 2023-10-16T19:41:37.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.214+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc0b4040 con 0x7f2abc153170 2023-10-16T19:41:37.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.216+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc04e1d0 con 0x7f2abc153170 2023-10-16T19:41:37.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.527+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ab40453f0 con 0x7f2abc153170 2023-10-16T19:41:37.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.529+0000 7f2ab1ffb640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2aa006aef0 0x7f2aa006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:37.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.529+0000 7f2ac1698640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2aa006aef0 0x7f2aa006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:37.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.531+0000 7f2ac1698640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2aa006aef0 0x7f2aa006d3b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800b450 tx=0x7f2ab800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:37.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.555+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2ab407ab90 con 0x7f2abc153170 2023-10-16T19:41:37.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.556+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ab4076ed0 con 0x7f2abc153170 2023-10-16T19:41:37.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.804+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2abc0cf770 con 0x7f2abc153170 2023-10-16T19:41:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.842+0000 7f2ab1ffb640 1 -- 172.21.15.57:0/2761257545 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6550 (secure 0 0 0) 0x7f2ab407a4f0 con 0x7f2abc153170 2023-10-16T19:41:37.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T19:41:37.844 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:40:59.056046+0000","modified":"2023-10-16T19:41:22.177275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4250,"mds_1":4247,"mds_2":4244,"mds_3":4231,"mds_4":4224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4224":{"gid":4224,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4231":{"gid":4231,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"d","rank":1,"incarnation":8,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:41:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2023-10-16T19:41:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.845+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2aa006aef0 msgr2=0x7f2aa006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.845+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2aa006aef0 0x7f2aa006d3b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800b450 tx=0x7f2ab800d040 comp rx=0 tx=0).stop 2023-10-16T19:41:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.845+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 msgr2=0x7f2abc1e5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.845+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 0x7f2abc1e5d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40098c0 tx=0x7f2ab40046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 shutdown_connections 2023-10-16T19:41:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2aa006aef0 0x7f2aa006d3b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2abc153170 0x7f2abc1e5d50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0ca900 0x7f2abc0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 --2- 172.21.15.57:0/2761257545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0c4ba0 0x7f2abc0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 >> 172.21.15.57:0/2761257545 conn(0x7f2abc071720 msgr2=0x7f2abc1e21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 shutdown_connections 2023-10-16T19:41:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:37.846+0000 7f2ac38fc640 1 -- 172.21.15.57:0/2761257545 wait complete. 2023-10-16T19:41:38.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T19:40:59.056046+0000', 'modified': '2023-10-16T19:41:22.177275+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4250, 'mds_1': 4247, 'mds_2': 4244, 'mds_3': 4231, 'mds_4': 4224}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4224': {'gid': 4224, 'name': 'a', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.57:6837/3832163679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 3832163679}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 3832163679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4231': {'gid': 4231, 'name': 'c', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6839/465604076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 465604076}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 465604076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4244': {'gid': 4244, 'name': 'f', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.110:6835/3004262175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 3004262175}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 3004262175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4247': {'gid': 4247, 'name': 'd', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.110:6837/919279935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6836', 'nonce': 919279935}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 919279935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4250': {'gid': 4250, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.57:6835/1742562725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 1742562725}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1742562725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T19:41:38.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-16T19:41:38.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T19:41:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.702+0000 7f9d9197c640 1 Processor -- start 2023-10-16T19:41:38.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.702+0000 7f9d9197c640 1 -- start start 2023-10-16T19:41:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.703+0000 7f9d9197c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 0x7f9d8c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.703+0000 7f9d9197c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d8c0c2c70 0x7f9d8c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.703+0000 7f9d9197c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c151570 con 0x7f9d8c151190 2023-10-16T19:41:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.703+0000 7f9d9197c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c4010 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.703+0000 7f9d9197c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c1ce0 con 0x7f9d8c0c12f0 2023-10-16T19:41:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.705+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 0x7f9d8c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.706+0000 7f9d8b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d8c0c2c70 0x7f9d8c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.706+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 0x7f9d8c06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36390/0 (socket says 172.21.15.57:36390) 2023-10-16T19:41:38.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.706+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/2657290882 learned_addr learned my addr 172.21.15.57:0/2657290882 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:38.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.712+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/2657290882 >> v2:172.21.15.110:3300/0 conn(0x7f9d8c0c2c70 msgr2=0x7f9d8c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:38.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.712+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/2657290882 >> v2:172.21.15.110:3300/0 conn(0x7f9d8c0c2c70 0x7f9d8c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.712+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/2657290882 >> v1:172.21.15.110:6789/0 conn(0x7f9d8c151190 legacy=0x7f9d8c0c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.712+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/2657290882 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0c5530 con 0x7f9d8c0c12f0 2023-10-16T19:41:38.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.719+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/2657290882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 0x7f9d8c06d5d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0c4150 tx=0x7f9d7402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b40660bf4d5cbbb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:38.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.730+0000 7f9d89ffb640 1 -- 172.21.15.57:0/2657290882 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74030840 con 0x7f9d8c0c12f0 2023-10-16T19:41:38.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.730+0000 7f9d89ffb640 1 -- 172.21.15.57:0/2657290882 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740309a0 con 0x7f9d8c0c12f0 2023-10-16T19:41:38.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.730+0000 7f9d89ffb640 1 -- 172.21.15.57:0/2657290882 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74030d30 con 0x7f9d8c0c12f0 2023-10-16T19:41:38.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 -- 172.21.15.57:0/2657290882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 msgr2=0x7f9d8c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:38.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 --2- 172.21.15.57:0/2657290882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 0x7f9d8c06d5d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0c4150 tx=0x7f9d7402b980 comp rx=0 tx=0).stop 2023-10-16T19:41:38.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 -- 172.21.15.57:0/2657290882 shutdown_connections 2023-10-16T19:41:38.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 --2- 172.21.15.57:0/2657290882 >> v2:172.21.15.110:3300/0 conn(0x7f9d8c0c2c70 0x7f9d8c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 --2- 172.21.15.57:0/2657290882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c0c12f0 0x7f9d8c06d5d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 -- 172.21.15.57:0/2657290882 >> 172.21.15.57:0/2657290882 conn(0x7f9d8c06c430 msgr2=0x7f9d8c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:38.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 -- 172.21.15.57:0/2657290882 shutdown_connections 2023-10-16T19:41:38.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.731+0000 7f9d9197c640 1 -- 172.21.15.57:0/2657290882 wait complete. 2023-10-16T19:41:38.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.734+0000 7f9d9197c640 1 Processor -- start 2023-10-16T19:41:38.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.734+0000 7f9d9197c640 1 -- start start 2023-10-16T19:41:38.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.736+0000 7f9d9197c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d8c0c12f0 0x7f9d8c1482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.736+0000 7f9d9197c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 0x7f9d8c146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.736+0000 7f9d9197c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c151190 0x7f9d8c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.736+0000 7f9d9197c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c149990 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.736+0000 7f9d9197c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0ca0d0 con 0x7f9d8c0c12f0 2023-10-16T19:41:38.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.736+0000 7f9d9197c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c9da0 con 0x7f9d8c151190 2023-10-16T19:41:38.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.737+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 0x7f9d8c146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.737+0000 7f9d8b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c151190 0x7f9d8c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.737+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 0x7f9d8c146ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34120/0 (socket says 172.21.15.57:34120) 2023-10-16T19:41:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.737+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/79698986 learned_addr learned my addr 172.21.15.57:0/79698986 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.737+0000 7f9d8affd640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d8c0c12f0 0x7f9d8c1482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.743+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c151190 msgr2=0x7f9d8c147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.743+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c151190 0x7f9d8c147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.743+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d8c0c12f0 msgr2=0x7f9d8c1482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.743+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d8c0c12f0 0x7f9d8c1482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.743+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/79698986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740094d0 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.746+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 0x7f9d8c146ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d74000c00 tx=0x7f9d74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.751+0000 7f9d83fff640 1 -- 172.21.15.57:0/79698986 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74039a90 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.751+0000 7f9d83fff640 1 -- 172.21.15.57:0/79698986 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74039c10 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.752+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1490f0 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.752+0000 7f9d83fff640 1 -- 172.21.15.57:0/79698986 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74043410 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.752+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c1496b0 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.756+0000 7f9d945e8740 1 Processor -- start 2023-10-16T19:41:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.756+0000 7f9d945e8740 1 -- start start 2023-10-16T19:41:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.757+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afb870 0x5580d5afe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.757+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b00790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.757+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5b00cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.757+0000 7f9d945e8740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a1b7a0 con 0x5580d5afbc50 2023-10-16T19:41:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.757+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a6d740 con 0x5580d5afb870 2023-10-16T19:41:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.757+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a6ae30 con 0x5580d5afc0b0 2023-10-16T19:41:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.759+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5b00cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.760+0000 7f9d8b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afb870 0x5580d5afe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.760+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5b00cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36404/0 (socket says 172.21.15.57:36404) 2023-10-16T19:41:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.760+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/920706553 learned_addr learned my addr 172.21.15.57:0/920706553 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.769+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afb870 msgr2=0x5580d5afe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.769+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afb870 0x5580d5afe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.769+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/920706553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 msgr2=0x5580d5b00790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.769+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b00790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.769+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/920706553 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d5a2a910 con 0x5580d5afc0b0 2023-10-16T19:41:38.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.775+0000 7f9d83fff640 1 -- 172.21.15.57:0/79698986 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d7404d500 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.776+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5b00cd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009930 tx=0x7f9d7403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4c074061b16cf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.776+0000 7f9d83fff640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9d6c06aef0 0x7f9d6c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.777+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9d6c06aef0 0x7f9d6c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.778+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9d6c06aef0 0x7f9d6c06d3b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009d10 tx=0x7f9d84009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.778+0000 7f9d83fff640 1 -- 172.21.15.57:0/79698986 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d7407c690 con 0x7f9d8c0c2c70 2023-10-16T19:41:38.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.786+0000 7f9d817fa640 1 -- 172.21.15.57:0/920706553 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740af070 con 0x5580d5afc0b0 2023-10-16T19:41:38.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.786+0000 7f9d817fa640 1 -- 172.21.15.57:0/920706553 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740789d0 con 0x5580d5afc0b0 2023-10-16T19:41:38.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.786+0000 7f9d817fa640 1 -- 172.21.15.57:0/920706553 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7407c460 con 0x5580d5afc0b0 2023-10-16T19:41:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.787+0000 7f9d945e8740 1 -- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 msgr2=0x5580d5b00cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.787+0000 7f9d945e8740 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5b00cd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009930 tx=0x7f9d7403d000 comp rx=0 tx=0).stop 2023-10-16T19:41:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 -- 172.21.15.57:0/920706553 shutdown_connections 2023-10-16T19:41:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5b00cd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b00790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 --2- 172.21.15.57:0/920706553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afb870 0x5580d5afe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 -- 172.21.15.57:0/920706553 >> 172.21.15.57:0/920706553 conn(0x5580d5afd0f0 msgr2=0x5580d5affa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:38.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 -- 172.21.15.57:0/920706553 shutdown_connections 2023-10-16T19:41:38.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.788+0000 7f9d945e8740 1 -- 172.21.15.57:0/920706553 wait complete. 2023-10-16T19:41:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.789+0000 7f9d945e8740 1 -- start start 2023-10-16T19:41:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.789+0000 7f9d945e8740 1 Processor -- start 2023-10-16T19:41:38.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.790+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b4af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.790+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5afa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.790+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5b4b840 0x5580d5b48860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.791+0000 7f9d945e8740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a66720 con 0x5580d5afbc50 2023-10-16T19:41:38.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.791+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a04970 con 0x5580d5b4b840 2023-10-16T19:41:38.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.791+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a04610 con 0x5580d5afc0b0 2023-10-16T19:41:38.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.791+0000 7f9d945e8740 10 client.0 _ll_register_callbacks cb 0x5580d5a269d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:38.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.791+0000 7f9d8affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b4af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.792+0000 7f9d8affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b4af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34140/0 (socket says 172.21.15.57:34140) 2023-10-16T19:41:38.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.792+0000 7f9d8affd640 1 -- 172.21.15.57:0/3248042266 learned_addr learned my addr 172.21.15.57:0/3248042266 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:38.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.792+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5b4b840 0x5580d5b48860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.793+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5afa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.795+0000 7f9d8affd640 1 -- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 msgr2=0x5580d5afa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:38.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.795+0000 7f9d8affd640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5afa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.795+0000 7f9d8affd640 1 -- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5b4b840 msgr2=0x5580d5b48860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:38.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.795+0000 7f9d8affd640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5b4b840 0x5580d5b48860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:38.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.795+0000 7f9d8affd640 1 -- 172.21.15.57:0/3248042266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c1496b0 con 0x5580d5afbc50 2023-10-16T19:41:38.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.798+0000 7f9d8affd640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b4af90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00f570 tx=0x7f9d7c00fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f51a920d762652 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:38.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.798+0000 7f9d6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:38.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.803+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/3248042266 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c003b80 con 0x5580d5afbc50 2023-10-16T19:41:38.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.803+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/3248042266 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d7c003ce0 con 0x5580d5afbc50 2023-10-16T19:41:38.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.803+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580d5a8d160 con 0x5580d5afbc50 2023-10-16T19:41:38.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.805+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/3248042266 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d7c003ea0 con 0x5580d5afbc50 2023-10-16T19:41:38.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.805+0000 7f9d945e8740 10 client.4491 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:38.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.805+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5580d5a64da0 con 0x5580d5afbc50 2023-10-16T19:41:38.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/3248042266 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5580d5a8d160 con 0x5580d5afbc50 2023-10-16T19:41:38.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/3248042266 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f9d7c012070 con 0x5580d5afbc50 2023-10-16T19:41:38.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d945e8740 10 client.4491 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:38.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d945e8740 10 client.4491 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T19:41:38.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d945e8740 20 client.4491 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:38.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d945e8740 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5b27280 0x5580d5b4f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:38.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d945e8740 4 client.4491 mds_command: new command op to 4224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:41:38.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.814+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 --> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580d5a38cc0 con 0x5580d5b27280 2023-10-16T19:41:38.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.815+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5b27280 0x5580d5b4f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:38.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.869+0000 7f9d6a7fc640 10 client.4491 ms_handle_connect on v2:172.21.15.57:6836/3832163679 2023-10-16T19:41:38.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:38.869+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5b27280 0x5580d5b4f2f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e7fff7d00bd0d23c server_cookie=eeb3ea7d9103c7c3 in_seq=0 out_seq=0 2023-10-16T19:41:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.096+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/3248042266 <== mds.4 v2:172.21.15.57:6836/3832163679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5580d5a38cc0 con 0x5580d5b27280 2023-10-16T19:41:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.096+0000 7f9d6a7fc640 10 client.4491 handle_command_reply: tid=0 2023-10-16T19:41:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.096+0000 7f9d945e8740 1 client.4491 shutdown 2023-10-16T19:41:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 msgr2=0x5580d5b4af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b4af90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00f570 tx=0x7f9d7c00fa30 comp rx=0 tx=0).stop 2023-10-16T19:41:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 shutdown_connections 2023-10-16T19:41:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5b4b840 0x5580d5b48860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5b27280 0x5580d5b4f2f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afc0b0 0x5580d5afa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 --2- 172.21.15.57:0/3248042266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afbc50 0x5580d5b4af90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 >> 172.21.15.57:0/3248042266 conn(0x5580d5afb870 msgr2=0x5580d5b01200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d6a7fc640 0 client.4491 ms_handle_reset on v2:172.21.15.57:6836/3832163679 2023-10-16T19:41:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 shutdown_connections 2023-10-16T19:41:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.097+0000 7f9d945e8740 1 -- 172.21.15.57:0/3248042266 wait complete. 2023-10-16T19:41:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.098+0000 7f9d945e8740 20 client.4491 trim_cache size 0 max 16384 2023-10-16T19:41:39.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.134+0000 7f9d945e8740 1 Processor -- start 2023-10-16T19:41:39.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.134+0000 7f9d945e8740 1 -- start start 2023-10-16T19:41:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.136+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afbc50 0x5580d5b20e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.136+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afc0b0 0x5580d5b48180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.136+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 0x5580d5b4f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.136+0000 7f9d945e8740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d57caf20 con 0x5580d5b4b840 2023-10-16T19:41:39.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.136+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5b24680 con 0x5580d5afc0b0 2023-10-16T19:41:39.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.136+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d5b56240 con 0x5580d5afbc50 2023-10-16T19:41:39.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.137+0000 7f9d8b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 0x5580d5b4f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.138+0000 7f9d8b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 0x5580d5b4f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34144/0 (socket says 172.21.15.57:34144) 2023-10-16T19:41:39.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.138+0000 7f9d8b7fe640 1 -- 172.21.15.57:0/747243989 learned_addr learned my addr 172.21.15.57:0/747243989 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:39.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.138+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afc0b0 0x5580d5b48180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.138+0000 7f9d8affd640 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afbc50 0x5580d5b20e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.144+0000 7f9d8b7fe640 1 -- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afbc50 msgr2=0x5580d5b20e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.144+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afbc50 0x5580d5b20e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.144+0000 7f9d8b7fe640 1 -- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afc0b0 msgr2=0x5580d5b48180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.144+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afc0b0 0x5580d5b48180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.144+0000 7f9d8b7fe640 1 -- 172.21.15.57:0/747243989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d5a03b80 con 0x5580d5b4b840 2023-10-16T19:41:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.150+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 0x5580d5b4f2c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d84004170 tx=0x7f9d84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43f035978f11e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.159+0000 7f9d81ffb640 1 -- 172.21.15.57:0/747243989 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84003e60 con 0x5580d5b4b840 2023-10-16T19:41:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.159+0000 7f9d81ffb640 1 -- 172.21.15.57:0/747243989 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d84019070 con 0x5580d5b4b840 2023-10-16T19:41:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.159+0000 7f9d81ffb640 1 -- 172.21.15.57:0/747243989 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8402c670 con 0x5580d5b4b840 2023-10-16T19:41:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 -- 172.21.15.57:0/747243989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 msgr2=0x5580d5b4f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 0x5580d5b4f2c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d84004170 tx=0x7f9d84017000 comp rx=0 tx=0).stop 2023-10-16T19:41:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 -- 172.21.15.57:0/747243989 shutdown_connections 2023-10-16T19:41:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5b4b840 0x5580d5b4f2c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afc0b0 0x5580d5b48180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 --2- 172.21.15.57:0/747243989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5afbc50 0x5580d5b20e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.160+0000 7f9d945e8740 1 -- 172.21.15.57:0/747243989 >> 172.21.15.57:0/747243989 conn(0x5580d5afb870 msgr2=0x5580d5b400c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.161+0000 7f9d945e8740 1 -- 172.21.15.57:0/747243989 shutdown_connections 2023-10-16T19:41:39.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.161+0000 7f9d945e8740 1 -- 172.21.15.57:0/747243989 wait complete. 2023-10-16T19:41:39.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.163+0000 7f9d945e8740 1 -- start start 2023-10-16T19:41:39.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.163+0000 7f9d945e8740 1 Processor -- start 2023-10-16T19:41:39.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.164+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afbc50 0x5580d5b40ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.164+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 0x5580d5bb19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.165+0000 7f9d945e8740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5b4b840 0x5580d5b206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.165+0000 7f9d945e8740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5b4b490 con 0x5580d5afc0b0 2023-10-16T19:41:39.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.165+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5b41430 con 0x5580d5afbc50 2023-10-16T19:41:39.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.165+0000 7f9d945e8740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d5bb23e0 con 0x5580d5b4b840 2023-10-16T19:41:39.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.165+0000 7f9d945e8740 10 client.0 _ll_register_callbacks cb 0x7f9d74046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:39.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.165+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 0x5580d5bb19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.166+0000 7f9d8a7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 0x5580d5bb19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34156/0 (socket says 172.21.15.57:34156) 2023-10-16T19:41:39.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.166+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/1144640852 learned_addr learned my addr 172.21.15.57:0/1144640852 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:39.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.167+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5b4b840 0x5580d5b206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.167+0000 7f9d8affd640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afbc50 0x5580d5b40ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5b4b840 msgr2=0x5580d5b206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5b4b840 0x5580d5b206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afbc50 msgr2=0x5580d5b40ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afbc50 0x5580d5b40ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8a7fc640 1 -- 172.21.15.57:0/1144640852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d84009d40 con 0x5580d5afc0b0 2023-10-16T19:41:39.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8affd640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afbc50 0x5580d5b40ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:39.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.170+0000 7f9d8b7fe640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5b4b840 0x5580d5b206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:39.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.173+0000 7f9d8a7fc640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 0x5580d5bb19d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d7407c390 tx=0x7f9d740af000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf3dc30b22d8933 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.173+0000 7f9d6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:39.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.178+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/1144640852 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74080730 con 0x5580d5afc0b0 2023-10-16T19:41:39.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.178+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/1144640852 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d740848e0 con 0x5580d5afc0b0 2023-10-16T19:41:39.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.178+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d740789d0 con 0x5580d5afc0b0 2023-10-16T19:41:39.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.181+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/1144640852 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d74078da0 con 0x5580d5afc0b0 2023-10-16T19:41:39.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.181+0000 7f9d945e8740 10 client.4497 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:39.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.181+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5580d5a29170 con 0x5580d5afc0b0 2023-10-16T19:41:39.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.187+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/1144640852 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740aa020 con 0x5580d5afc0b0 2023-10-16T19:41:39.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.187+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/1144640852 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f9d74046c40 con 0x5580d5afc0b0 2023-10-16T19:41:39.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.188+0000 7f9d945e8740 10 client.4497 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:39.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.188+0000 7f9d945e8740 10 client.4497 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T19:41:39.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.188+0000 7f9d945e8740 20 client.4497 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:39.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.188+0000 7f9d945e8740 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5baeee0 0x5580d5afe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.188+0000 7f9d945e8740 4 client.4497 mds_command: new command op to 4224 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:41:39.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.188+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 --> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5580d5a5f700 con 0x5580d5baeee0 2023-10-16T19:41:39.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.189+0000 7f9d8affd640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5baeee0 0x5580d5afe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.194+0000 7f9d8affd640 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5baeee0 0x5580d5afe100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=64e8ee8add678349 server_cookie=7014447ac4e877c4 in_seq=0 out_seq=0 2023-10-16T19:41:39.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.194+0000 7f9d6a7fc640 10 client.4497 ms_handle_connect on v2:172.21.15.57:6836/3832163679 2023-10-16T19:41:39.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d6a7fc640 1 -- 172.21.15.57:0/1144640852 <== mds.4 v2:172.21.15.57:6836/3832163679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5580d5a5f700 con 0x5580d5baeee0 2023-10-16T19:41:39.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d6a7fc640 10 client.4497 handle_command_reply: tid=0 2023-10-16T19:41:39.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d945e8740 1 client.4497 shutdown 2023-10-16T19:41:39.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 msgr2=0x5580d5bb19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d945e8740 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 0x5580d5bb19d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d7407c390 tx=0x7f9d740af000 comp rx=0 tx=0).stop 2023-10-16T19:41:39.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 shutdown_connections 2023-10-16T19:41:39.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.225+0000 7f9d945e8740 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:6836/3832163679,v1:172.21.15.57:6837/3832163679] conn(0x5580d5baeee0 0x5580d5afe100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d945e8740 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5580d5b4b840 0x5580d5b206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d945e8740 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580d5afc0b0 0x5580d5bb19d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d945e8740 1 --2- 172.21.15.57:0/1144640852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d5afbc50 0x5580d5b40ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d6a7fc640 0 client.4497 ms_handle_reset on v2:172.21.15.57:6836/3832163679 2023-10-16T19:41:39.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 >> 172.21.15.57:0/1144640852 conn(0x5580d5afb870 msgr2=0x5580d5b442a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 shutdown_connections 2023-10-16T19:41:39.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.226+0000 7f9d945e8740 1 -- 172.21.15.57:0/1144640852 wait complete. 2023-10-16T19:41:39.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.227+0000 7f9d945e8740 20 client.4497 trim_cache size 0 max 16384 2023-10-16T19:41:39.231 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T19:41:39.231 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "ee1d7270-3118-4d78-b8fc-a1736155df58", 2023-10-16T19:41:39.231 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 4, 2023-10-16T19:41:39.232 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4224, 2023-10-16T19:41:39.232 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-16T19:41:39.232 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-16T19:41:39.232 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-16T19:41:39.232 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 18.300353564000002, 2023-10-16T19:41:39.233 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2023-10-16T19:41:39.233 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 25, 2023-10-16T19:41:39.233 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-10-16T19:41:39.233 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 51.574422777999999 2023-10-16T19:41:39.233 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T19:41:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.228+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9d6c06aef0 msgr2=0x7f9d6c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.228+0000 7f9d9197c640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9d6c06aef0 0x7f9d6c06d3b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009d10 tx=0x7f9d84009190 comp rx=0 tx=0).stop 2023-10-16T19:41:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.228+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 msgr2=0x7f9d8c146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.228+0000 7f9d9197c640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 0x7f9d8c146ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d74000c00 tx=0x7f9d74004730 comp rx=0 tx=0).stop 2023-10-16T19:41:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 shutdown_connections 2023-10-16T19:41:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9d6c06aef0 0x7f9d6c06d3b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d8c151190 0x7f9d8c147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c0c2c70 0x7f9d8c146ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 --2- 172.21.15.57:0/79698986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d8c0c12f0 0x7f9d8c1482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 >> 172.21.15.57:0/79698986 conn(0x7f9d8c06c430 msgr2=0x7f9d8c0be320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 shutdown_connections 2023-10-16T19:41:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.229+0000 7f9d9197c640 1 -- 172.21.15.57:0/79698986 wait complete. 2023-10-16T19:41:39.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-16T19:41:39.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.467+0000 7f2f20a2e640 1 Processor -- start 2023-10-16T19:41:39.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.467+0000 7f2f20a2e640 1 -- start start 2023-10-16T19:41:39.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.469+0000 7f2f20a2e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 0x7f2f1c0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.469+0000 7f2f20a2e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0c5860 con 0x7f2f1c070f30 2023-10-16T19:41:39.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.469+0000 7f2f20a2e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0c62b0 con 0x7f2f1c0c7250 2023-10-16T19:41:39.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.469+0000 7f2f20a2e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c15cb00 con 0x7f2f1c1530f0 2023-10-16T19:41:39.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.479+0000 7f2f1b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 0x7f2f1c0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.480+0000 7f2f1b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 0x7f2f1c0c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36442/0 (socket says 172.21.15.57:36442) 2023-10-16T19:41:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.480+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/3999430150 learned_addr learned my addr 172.21.15.57:0/3999430150 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:39.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.487+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/3999430150 >> v1:172.21.15.110:6789/0 conn(0x7f2f1c0c7250 legacy=0x7f2f1c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.487+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/3999430150 >> v1:172.21.15.57:6789/0 conn(0x7f2f1c070f30 legacy=0x7f2f1c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.487+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/3999430150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c1534d0 con 0x7f2f1c1530f0 2023-10-16T19:41:39.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.587+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/3999430150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 0x7f2f1c0c5d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098a0 tx=0x7f2f0c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf81f434dbc689b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.607+0000 7f2f1a7fc640 1 -- 172.21.15.57:0/3999430150 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c02f830 con 0x7f2f1c1530f0 2023-10-16T19:41:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.607+0000 7f2f1a7fc640 1 -- 172.21.15.57:0/3999430150 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c02f990 con 0x7f2f1c1530f0 2023-10-16T19:41:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.607+0000 7f2f1a7fc640 1 -- 172.21.15.57:0/3999430150 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c02fd20 con 0x7f2f1c1530f0 2023-10-16T19:41:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.608+0000 7f2f20a2e640 1 -- 172.21.15.57:0/3999430150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 msgr2=0x7f2f1c0c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.608+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/3999430150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 0x7f2f1c0c5d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098a0 tx=0x7f2f0c02ba10 comp rx=0 tx=0).stop 2023-10-16T19:41:39.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.608+0000 7f2f20a2e640 1 -- 172.21.15.57:0/3999430150 shutdown_connections 2023-10-16T19:41:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.608+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/3999430150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c1530f0 0x7f2f1c0c5d70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.608+0000 7f2f20a2e640 1 -- 172.21.15.57:0/3999430150 >> 172.21.15.57:0/3999430150 conn(0x7f2f1c06d3d0 msgr2=0x7f2f1c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.609+0000 7f2f20a2e640 1 -- 172.21.15.57:0/3999430150 shutdown_connections 2023-10-16T19:41:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.609+0000 7f2f20a2e640 1 -- 172.21.15.57:0/3999430150 wait complete. 2023-10-16T19:41:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.614+0000 7f2f20a2e640 1 Processor -- start 2023-10-16T19:41:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.615+0000 7f2f20a2e640 1 -- start start 2023-10-16T19:41:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.618+0000 7f2f20a2e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c070f30 0x7f2f1c14bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.618+0000 7f2f20a2e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f1c0c7250 0x7f2f1c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.618+0000 7f2f20a2e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c1530f0 0x7f2f1c148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.618+0000 7f2f20a2e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c15c820 con 0x7f2f1c1530f0 2023-10-16T19:41:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.618+0000 7f2f20a2e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1536f0 con 0x7f2f1c0c7250 2023-10-16T19:41:39.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.618+0000 7f2f20a2e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1539d0 con 0x7f2f1c070f30 2023-10-16T19:41:39.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.620+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f1c0c7250 0x7f2f1c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.620+0000 7f2f1b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c070f30 0x7f2f1c14bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.621+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f1c0c7250 0x7f2f1c14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54668/0 (socket says 172.21.15.57:54668) 2023-10-16T19:41:39.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.621+0000 7f2f1affd640 1 -- 172.21.15.57:0/1674384915 learned_addr learned my addr 172.21.15.57:0/1674384915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:39.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.630+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f1c0c7250 msgr2=0x7f2f1c14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.630+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f1c0c7250 0x7f2f1c14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.630+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c1530f0 msgr2=0x7f2f1c148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.630+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c1530f0 0x7f2f1c148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.630+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1674384915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0094d0 con 0x7f2f1c070f30 2023-10-16T19:41:39.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.638+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c070f30 0x7f2f1c14bc80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c033000 tx=0x7f2f0c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.649+0000 7f2f03fff640 1 -- 172.21.15.57:0/1674384915 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c03c040 con 0x7f2f1c070f30 2023-10-16T19:41:39.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.649+0000 7f2f03fff640 1 -- 172.21.15.57:0/1674384915 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c037dd0 con 0x7f2f1c070f30 2023-10-16T19:41:39.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.649+0000 7f2f03fff640 1 -- 172.21.15.57:0/1674384915 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c042630 con 0x7f2f1c070f30 2023-10-16T19:41:39.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.649+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c14b480 con 0x7f2f1c070f30 2023-10-16T19:41:39.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.649+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c153cb0 con 0x7f2f1c070f30 2023-10-16T19:41:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.654+0000 7f2f24828740 1 Processor -- start 2023-10-16T19:41:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.655+0000 7f2f24828740 1 -- start start 2023-10-16T19:41:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.656+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d42b70 0x55f9e3d42f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.656+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d43490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.656+0000 7f2f24828740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 0x55f9e3d823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.656+0000 7f2f24828740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3c5d7a0 con 0x55f9e3d415d0 2023-10-16T19:41:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.656+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3caf740 con 0x55f9e3d8c9f0 2023-10-16T19:41:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.656+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3cace30 con 0x55f9e3d42b70 2023-10-16T19:41:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.657+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 0x55f9e3d823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.657+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 0x55f9e3d823d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34172/0 (socket says 172.21.15.57:34172) 2023-10-16T19:41:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.657+0000 7f2f1affd640 1 -- 172.21.15.57:0/3463729732 learned_addr learned my addr 172.21.15.57:0/3463729732 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.658+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d43490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.660+0000 7f2f1affd640 1 -- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d42b70 msgr2=0x55f9e3d42f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.660+0000 7f2f1affd640 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d42b70 0x55f9e3d42f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.660+0000 7f2f1affd640 1 -- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 msgr2=0x55f9e3d43490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.660+0000 7f2f1affd640 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d43490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.660+0000 7f2f1affd640 1 -- 172.21.15.57:0/3463729732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e3c6c910 con 0x55f9e3d415d0 2023-10-16T19:41:39.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.663+0000 7f2f1affd640 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 0x55f9e3d823d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001870 tx=0x7f2f10007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ca77593199a567 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.668+0000 7f2f017fa640 1 -- 172.21.15.57:0/3463729732 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100052e0 con 0x55f9e3d415d0 2023-10-16T19:41:39.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.669+0000 7f2f017fa640 1 -- 172.21.15.57:0/3463729732 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10005440 con 0x55f9e3d415d0 2023-10-16T19:41:39.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.669+0000 7f2f017fa640 1 -- 172.21.15.57:0/3463729732 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000fa70 con 0x55f9e3d415d0 2023-10-16T19:41:39.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.669+0000 7f2f24828740 1 -- 172.21.15.57:0/3463729732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 msgr2=0x55f9e3d823d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.669+0000 7f2f24828740 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 0x55f9e3d823d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001870 tx=0x7f2f10007e90 comp rx=0 tx=0).stop 2023-10-16T19:41:39.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 -- 172.21.15.57:0/3463729732 shutdown_connections 2023-10-16T19:41:39.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d415d0 0x55f9e3d823d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d43490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 --2- 172.21.15.57:0/3463729732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d42b70 0x55f9e3d42f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 -- 172.21.15.57:0/3463729732 >> 172.21.15.57:0/3463729732 conn(0x55f9e3d3f2e0 msgr2=0x55f9e3d41c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 -- 172.21.15.57:0/3463729732 shutdown_connections 2023-10-16T19:41:39.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.670+0000 7f2f24828740 1 -- 172.21.15.57:0/3463729732 wait complete. 2023-10-16T19:41:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.671+0000 7f2f24828740 1 -- start start 2023-10-16T19:41:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.671+0000 7f2f24828740 1 Processor -- start 2023-10-16T19:41:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d69130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 0x55f9e3d87430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d93ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3ca8720 con 0x55f9e3d69990 2023-10-16T19:41:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3c46970 con 0x55f9e3d8c9f0 2023-10-16T19:41:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3c46610 con 0x55f9e3d684d0 2023-10-16T19:41:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.672+0000 7f2f24828740 10 client.0 _ll_register_callbacks cb 0x55f9e3c689d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.673+0000 7f2f1b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 0x55f9e3d87430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.674+0000 7f2f1bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d69130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.674+0000 7f2f1b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 0x55f9e3d87430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34184/0 (socket says 172.21.15.57:34184) 2023-10-16T19:41:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.674+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1569086005 learned_addr learned my addr 172.21.15.57:0/1569086005 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.678+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1569086005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 msgr2=0x55f9e3d93ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.678+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d93ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.678+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1569086005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 msgr2=0x55f9e3d69130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.678+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d69130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.678+0000 7f2f1b7fe640 1 -- 172.21.15.57:0/1569086005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f100014f0 con 0x55f9e3d69990 2023-10-16T19:41:39.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.681+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 0x55f9e3d87430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0099c0 tx=0x7f2f0c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cd62563ab273a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.681+0000 7f2efa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:39.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.685+0000 7f2efa7fc640 1 -- 172.21.15.57:0/1569086005 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c04cea0 con 0x55f9e3d69990 2023-10-16T19:41:39.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.685+0000 7f2efa7fc640 1 -- 172.21.15.57:0/1569086005 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2f0c055410 con 0x55f9e3d69990 2023-10-16T19:41:39.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.685+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9e3ccf160 con 0x55f9e3d69990 2023-10-16T19:41:39.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.688+0000 7f2efa7fc640 1 -- 172.21.15.57:0/1569086005 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f0c0555d0 con 0x55f9e3d69990 2023-10-16T19:41:39.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.688+0000 7f2f24828740 10 client.4503 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:39.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.688+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f9e3ca6da0 con 0x55f9e3d69990 2023-10-16T19:41:39.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2efa7fc640 1 -- 172.21.15.57:0/1569086005 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9e3ccf160 con 0x55f9e3d69990 2023-10-16T19:41:39.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2efa7fc640 1 -- 172.21.15.57:0/1569086005 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f2f0c035020 con 0x55f9e3d69990 2023-10-16T19:41:39.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2f24828740 10 client.4503 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:39.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2f24828740 10 client.4503 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T19:41:39.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2f24828740 20 client.4503 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:39.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2f24828740 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d67a60 0x55f9e3d862a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2f24828740 4 client.4503 mds_command: new command op to 4231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:41:39.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.693+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 --> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9e3c7acc0 con 0x55f9e3d67a60 2023-10-16T19:41:39.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.694+0000 7f2f1bfff640 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d67a60 0x55f9e3d862a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.724+0000 7f2f03fff640 1 -- 172.21.15.57:0/1674384915 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f0c055d40 con 0x7f2f1c070f30 2023-10-16T19:41:39.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.725+0000 7f2f03fff640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2f0806ae30 0x7f2f0806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.725+0000 7f2f1affd640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2f0806ae30 0x7f2f0806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.726+0000 7f2f1affd640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2f0806ae30 0x7f2f0806d2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55f9e3d42720 tx=0x7f2f1000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:39.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.735+0000 7f2f03fff640 1 -- 172.21.15.57:0/1674384915 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2f0c084510 con 0x7f2f1c070f30 2023-10-16T19:41:39.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.748+0000 7f2f1bfff640 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d67a60 0x55f9e3d862a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=74e8264496b260d server_cookie=b3a6a336b3b3185e in_seq=0 out_seq=0 2023-10-16T19:41:39.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.748+0000 7f2efa7fc640 10 client.4503 ms_handle_connect on v2:172.21.15.57:6838/465604076 2023-10-16T19:41:39.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.944+0000 7f2efa7fc640 1 -- 172.21.15.57:0/1569086005 <== mds.3 v2:172.21.15.57:6838/465604076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f9e3c7acc0 con 0x55f9e3d67a60 2023-10-16T19:41:39.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.944+0000 7f2efa7fc640 10 client.4503 handle_command_reply: tid=0 2023-10-16T19:41:39.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 client.4503 shutdown 2023-10-16T19:41:39.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 msgr2=0x55f9e3d87430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:39.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 0x55f9e3d87430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0099c0 tx=0x7f2f0c009240 comp rx=0 tx=0).stop 2023-10-16T19:41:39.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 shutdown_connections 2023-10-16T19:41:39.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d67a60 0x55f9e3d862a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d93ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d69990 0x55f9e3d87430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 --2- 172.21.15.57:0/1569086005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d69130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:39.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2efa7fc640 0 client.4503 ms_handle_reset on v2:172.21.15.57:6838/465604076 2023-10-16T19:41:39.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.945+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 >> 172.21.15.57:0/1569086005 conn(0x55f9e3d42b70 msgr2=0x55f9e3d82b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:39.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.946+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 shutdown_connections 2023-10-16T19:41:39.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.946+0000 7f2f24828740 1 -- 172.21.15.57:0/1569086005 wait complete. 2023-10-16T19:41:39.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.946+0000 7f2f24828740 20 client.4503 trim_cache size 0 max 16384 2023-10-16T19:41:39.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.992+0000 7f2f24828740 1 Processor -- start 2023-10-16T19:41:39.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.992+0000 7f2f24828740 1 -- start start 2023-10-16T19:41:39.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.994+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d86270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.994+0000 7f2f24828740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d867b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.994+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d6c150 0x55f9e3d403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:39.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.994+0000 7f2f24828740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3a0cf20 con 0x55f9e3d8c9f0 2023-10-16T19:41:39.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.994+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d8b9f0 con 0x55f9e3d6c150 2023-10-16T19:41:39.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.994+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3c4e5c0 con 0x55f9e3d684d0 2023-10-16T19:41:39.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.996+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.996+0000 7f2f1bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d6c150 0x55f9e3d403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.997+0000 7f2f1b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d86270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:39.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.997+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d867b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34186/0 (socket says 172.21.15.57:34186) 2023-10-16T19:41:39.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:39.997+0000 7f2f1affd640 1 -- 172.21.15.57:0/2298892550 learned_addr learned my addr 172.21.15.57:0/2298892550 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.000+0000 7f2f1affd640 1 -- 172.21.15.57:0/2298892550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 msgr2=0x55f9e3d86270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.000+0000 7f2f1affd640 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d86270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.000+0000 7f2f1affd640 1 -- 172.21.15.57:0/2298892550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d6c150 msgr2=0x55f9e3d403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.000+0000 7f2f1affd640 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d6c150 0x55f9e3d403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.000+0000 7f2f1affd640 1 -- 172.21.15.57:0/2298892550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e3c45b80 con 0x55f9e3d8c9f0 2023-10-16T19:41:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.003+0000 7f2f1affd640 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d867b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f10000c00 tx=0x7f2f10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a13d4d78fab7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.010+0000 7f2f01ffb640 1 -- 172.21.15.57:0/2298892550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10003a40 con 0x55f9e3d8c9f0 2023-10-16T19:41:40.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.010+0000 7f2f01ffb640 1 -- 172.21.15.57:0/2298892550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10021070 con 0x55f9e3d8c9f0 2023-10-16T19:41:40.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.010+0000 7f2f01ffb640 1 -- 172.21.15.57:0/2298892550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10003e00 con 0x55f9e3d8c9f0 2023-10-16T19:41:40.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 -- 172.21.15.57:0/2298892550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 msgr2=0x55f9e3d867b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d867b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f10000c00 tx=0x7f2f10013000 comp rx=0 tx=0).stop 2023-10-16T19:41:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 -- 172.21.15.57:0/2298892550 shutdown_connections 2023-10-16T19:41:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d6c150 0x55f9e3d403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d8c9f0 0x55f9e3d867b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 --2- 172.21.15.57:0/2298892550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d684d0 0x55f9e3d86270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 -- 172.21.15.57:0/2298892550 >> 172.21.15.57:0/2298892550 conn(0x55f9e3d42b70 msgr2=0x55f9e3d82b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 -- 172.21.15.57:0/2298892550 shutdown_connections 2023-10-16T19:41:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.013+0000 7f2f24828740 1 -- 172.21.15.57:0/2298892550 wait complete. 2023-10-16T19:41:40.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.015+0000 7f2f24828740 1 -- start start 2023-10-16T19:41:40.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.015+0000 7f2f24828740 1 Processor -- start 2023-10-16T19:41:40.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d684d0 0x55f9e3d6a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 0x55f9e3d85180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d8c9f0 0x55f9e3de6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d424d0 con 0x55f9e3d6c150 2023-10-16T19:41:40.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d6a6b0 con 0x55f9e3d684d0 2023-10-16T19:41:40.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d3d560 con 0x55f9e3d8c9f0 2023-10-16T19:41:40.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.018+0000 7f2f24828740 10 client.0 _ll_register_callbacks cb 0x7f2f0c045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.019+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 0x55f9e3d85180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.020+0000 7f2f1affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 0x55f9e3d85180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34188/0 (socket says 172.21.15.57:34188) 2023-10-16T19:41:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.020+0000 7f2f1affd640 1 -- 172.21.15.57:0/860882390 learned_addr learned my addr 172.21.15.57:0/860882390 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.020+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d684d0 0x55f9e3d6a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.020+0000 7f2f1bfff640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d8c9f0 0x55f9e3de6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.024+0000 7f2f1affd640 1 -- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d8c9f0 msgr2=0x55f9e3de6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.024+0000 7f2f1affd640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d8c9f0 0x55f9e3de6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.024+0000 7f2f1affd640 1 -- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d684d0 msgr2=0x55f9e3d6a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.024+0000 7f2f1affd640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d684d0 0x55f9e3d6a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.024+0000 7f2f1affd640 1 -- 172.21.15.57:0/860882390 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9e3c6c910 con 0x55f9e3d6c150 2023-10-16T19:41:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.027+0000 7f2f1affd640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 0x55f9e3d85180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f9e3d41360 tx=0x7f2f10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe9d0a2f75c860f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.027+0000 7f2efa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.031+0000 7f2efa7fc640 1 -- 172.21.15.57:0/860882390 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10006be0 con 0x55f9e3d6c150 2023-10-16T19:41:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.031+0000 7f2efa7fc640 1 -- 172.21.15.57:0/860882390 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2f10023070 con 0x55f9e3d6c150 2023-10-16T19:41:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.031+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f10005440 con 0x55f9e3d6c150 2023-10-16T19:41:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.034+0000 7f2efa7fc640 1 -- 172.21.15.57:0/860882390 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f10004e70 con 0x55f9e3d6c150 2023-10-16T19:41:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.034+0000 7f2f24828740 10 client.4509 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.034+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f9e3c6b170 con 0x55f9e3d6c150 2023-10-16T19:41:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.040+0000 7f2efa7fc640 1 -- 172.21.15.57:0/860882390 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10005440 con 0x55f9e3d6c150 2023-10-16T19:41:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2efa7fc640 1 -- 172.21.15.57:0/860882390 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f2f1003b030 con 0x55f9e3d6c150 2023-10-16T19:41:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2f24828740 10 client.4509 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2f24828740 10 client.4509 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T19:41:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2f24828740 20 client.4509 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2f24828740 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d9ceb0 0x55f9e3d9d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2f24828740 4 client.4509 mds_command: new command op to 4231 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:41:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.041+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 --> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f9e3ca1700 con 0x55f9e3d9ceb0 2023-10-16T19:41:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.042+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d9ceb0 0x55f9e3d9d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.048+0000 7f2f1b7fe640 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d9ceb0 0x55f9e3d9d290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=21abae8315ee20b4 server_cookie=94d7c64170d537a7 in_seq=0 out_seq=0 2023-10-16T19:41:40.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.048+0000 7f2efa7fc640 10 client.4509 ms_handle_connect on v2:172.21.15.57:6838/465604076 2023-10-16T19:41:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2efa7fc640 1 -- 172.21.15.57:0/860882390 <== mds.3 v2:172.21.15.57:6838/465604076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f9e3ca1700 con 0x55f9e3d9ceb0 2023-10-16T19:41:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2efa7fc640 10 client.4509 handle_command_reply: tid=0 2023-10-16T19:41:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2f24828740 1 client.4509 shutdown 2023-10-16T19:41:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 msgr2=0x55f9e3d85180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2f24828740 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 0x55f9e3d85180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f9e3d41360 tx=0x7f2f10000ed0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 shutdown_connections 2023-10-16T19:41:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.075+0000 7f2f24828740 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:6838/465604076,v1:172.21.15.57:6839/465604076] conn(0x55f9e3d9ceb0 0x55f9e3d9d290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2f24828740 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f9e3d8c9f0 0x55f9e3de6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2f24828740 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e3d6c150 0x55f9e3d85180 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2f24828740 1 --2- 172.21.15.57:0/860882390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f9e3d684d0 0x55f9e3d6a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 >> 172.21.15.57:0/860882390 conn(0x55f9e3d42b70 msgr2=0x55f9e3d86200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2efa7fc640 0 client.4509 ms_handle_reset on v2:172.21.15.57:6838/465604076 2023-10-16T19:41:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 shutdown_connections 2023-10-16T19:41:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.076+0000 7f2f24828740 1 -- 172.21.15.57:0/860882390 wait complete. 2023-10-16T19:41:40.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.077+0000 7f2f24828740 20 client.4509 trim_cache size 0 max 16384 2023-10-16T19:41:40.081 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T19:41:40.082 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "ee1d7270-3118-4d78-b8fc-a1736155df58", 2023-10-16T19:41:40.082 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 3, 2023-10-16T19:41:40.082 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4231, 2023-10-16T19:41:40.082 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-16T19:41:40.085 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-16T19:41:40.085 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-16T19:41:40.086 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 22.352645584000001, 2023-10-16T19:41:40.086 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2023-10-16T19:41:40.086 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 25, 2023-10-16T19:41:40.086 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-10-16T19:41:40.087 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 52.250834857999997 2023-10-16T19:41:40.087 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T19:41:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2f0806ae30 msgr2=0x7f2f0806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2f0806ae30 0x7f2f0806d2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55f9e3d42720 tx=0x7f2f1000a000 comp rx=0 tx=0).stop 2023-10-16T19:41:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c070f30 msgr2=0x7f2f1c14bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c070f30 0x7f2f1c14bc80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c033000 tx=0x7f2f0c004730 comp rx=0 tx=0).stop 2023-10-16T19:41:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 shutdown_connections 2023-10-16T19:41:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2f0806ae30 0x7f2f0806d2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c1530f0 0x7f2f1c148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f1c0c7250 0x7f2f1c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 --2- 172.21.15.57:0/1674384915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f1c070f30 0x7f2f1c14bc80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.078+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 >> 172.21.15.57:0/1674384915 conn(0x7f2f1c06d3d0 msgr2=0x7f2f1c151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.079+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 shutdown_connections 2023-10-16T19:41:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.079+0000 7f2f20a2e640 1 -- 172.21.15.57:0/1674384915 wait complete. 2023-10-16T19:41:40.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-16T19:41:40.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.376+0000 7f790fbc5640 1 Processor -- start 2023-10-16T19:41:40.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.376+0000 7f790fbc5640 1 -- start start 2023-10-16T19:41:40.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.378+0000 7f790fbc5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f790814ff50 0x7f79080711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.378+0000 7f790fbc5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7908071d80 0x7f7908155f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.378+0000 7f790fbc5640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7908150330 con 0x7f7908071930 2023-10-16T19:41:40.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.378+0000 7f790fbc5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080c2b80 con 0x7f790814ff50 2023-10-16T19:41:40.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.378+0000 7f790fbc5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c66d0 con 0x7f7908071d80 2023-10-16T19:41:40.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.379+0000 7f790d160640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7908071930 0x7f79080c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57214/0 (socket says 172.21.15.57:57214) 2023-10-16T19:41:40.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.379+0000 7f790d160640 1 -- 172.21.15.57:0/4239431732 learned_addr learned my addr 172.21.15.57:0/4239431732 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:40.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.379+0000 7f790d961640 1 --2- 172.21.15.57:0/4239431732 >> v2:172.21.15.110:3300/0 conn(0x7f790814ff50 0x7f79080711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.379+0000 7f790e162640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7908071d80 0x7f7908155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.382+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872577851 0 0) 0x7f7908150330 con 0x7f7908071930 2023-10-16T19:41:40.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.382+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f0003520 con 0x7f7908071930 2023-10-16T19:41:40.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593810605 0 0) 0x7f78f0003520 con 0x7f7908071930 2023-10-16T19:41:40.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7908071d80 msgr2=0x7f7908155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7908071d80 0x7f7908155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 >> v2:172.21.15.110:3300/0 conn(0x7f790814ff50 msgr2=0x7f79080711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 --2- 172.21.15.57:0/4239431732 >> v2:172.21.15.110:3300/0 conn(0x7f790814ff50 0x7f79080711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790815a110 con 0x7f7908071930 2023-10-16T19:41:40.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f78fc001670 con 0x7f7908071930 2023-10-16T19:41:40.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 >> v1:172.21.15.57:6789/0 conn(0x7f7908071930 legacy=0x7f79080c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78f0003970 0x7f78f0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78f00047c0 0x7f78f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0005180 0x7f78f000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c66d0 con 0x7f78f0003970 2023-10-16T19:41:40.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f0004610 con 0x7f78f00047c0 2023-10-16T19:41:40.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.386+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f000e120 con 0x7f78f0005180 2023-10-16T19:41:40.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.389+0000 7f790d961640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78f0003970 0x7f78f0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.393+0000 7f790d160640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78f00047c0 0x7f78f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.393+0000 7f790e162640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0005180 0x7f78f000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.394+0000 7f790d961640 1 -- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0005180 msgr2=0x7f78f000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.394+0000 7f790d961640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0005180 0x7f78f000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.394+0000 7f790d961640 1 -- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78f00047c0 msgr2=0x7f78f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.394+0000 7f790d961640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78f00047c0 0x7f78f0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.394+0000 7f790d961640 1 -- 172.21.15.57:0/4239431732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0003520 con 0x7f78f0003970 2023-10-16T19:41:40.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.397+0000 7f790d961640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78f0003970 0x7f78f0003db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78f800e170 tx=0x7f78f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54958eb2fb42361a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.403+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f802cc20 con 0x7f78f0003970 2023-10-16T19:41:40.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.403+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f800f040 con 0x7f78f0003970 2023-10-16T19:41:40.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.403+0000 7f790c95f640 1 -- 172.21.15.57:0/4239431732 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8034440 con 0x7f78f0003970 2023-10-16T19:41:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.404+0000 7f790fbc5640 1 -- 172.21.15.57:0/4239431732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78f0003970 msgr2=0x7f78f0003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.404+0000 7f790fbc5640 1 --2- 172.21.15.57:0/4239431732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78f0003970 0x7f78f0003db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78f800e170 tx=0x7f78f00057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.404+0000 7f790e162640 1 -- 172.21.15.57:0/4239431732 reap_dead start 2023-10-16T19:41:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.404+0000 7f790fbc5640 1 -- 172.21.15.57:0/4239431732 shutdown_connections 2023-10-16T19:41:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.405+0000 7f790fbc5640 1 -- 172.21.15.57:0/4239431732 >> 172.21.15.57:0/4239431732 conn(0x7f790806c430 msgr2=0x7f7908069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.405+0000 7f790fbc5640 1 -- 172.21.15.57:0/4239431732 shutdown_connections 2023-10-16T19:41:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.405+0000 7f790fbc5640 1 -- 172.21.15.57:0/4239431732 wait complete. 2023-10-16T19:41:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.407+0000 7f790fbc5640 1 Processor -- start 2023-10-16T19:41:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.407+0000 7f790fbc5640 1 -- start start 2023-10-16T19:41:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.408+0000 7f790fbc5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0003970 0x7f7908142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.408+0000 7f790fbc5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f790813d3b0 0x7f7908143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.408+0000 7f790fbc5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081e9d80 0x7f79081ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.408+0000 7f790fbc5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790814e730 con 0x7f790813d3b0 2023-10-16T19:41:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.408+0000 7f790fbc5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790806a100 con 0x7f79081e9d80 2023-10-16T19:41:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.408+0000 7f790fbc5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79081ea750 con 0x7f78f0003970 2023-10-16T19:41:40.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.410+0000 7f790e162640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081e9d80 0x7f79081ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.410+0000 7f790d961640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0003970 0x7f7908142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.410+0000 7f790e162640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081e9d80 0x7f79081ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54710/0 (socket says 172.21.15.57:54710) 2023-10-16T19:41:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.410+0000 7f790e162640 1 -- 172.21.15.57:0/2847041683 learned_addr learned my addr 172.21.15.57:0/2847041683 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.410+0000 7f790d160640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f790813d3b0 0x7f7908143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.415+0000 7f790d160640 1 -- 172.21.15.57:0/2847041683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0003970 msgr2=0x7f7908142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.415+0000 7f790d160640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0003970 0x7f7908142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.416+0000 7f790d160640 1 -- 172.21.15.57:0/2847041683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081e9d80 msgr2=0x7f79081ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.416+0000 7f790d160640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081e9d80 0x7f79081ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.416+0000 7f790d160640 1 -- 172.21.15.57:0/2847041683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79081ede50 con 0x7f790813d3b0 2023-10-16T19:41:40.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.418+0000 7f790d160640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f790813d3b0 0x7f7908143000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00d800 tx=0x7f78fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.423+0000 7f79067fc640 1 -- 172.21.15.57:0/2847041683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0072d0 con 0x7f790813d3b0 2023-10-16T19:41:40.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.423+0000 7f79067fc640 1 -- 172.21.15.57:0/2847041683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc007430 con 0x7f790813d3b0 2023-10-16T19:41:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.423+0000 7f79067fc640 1 -- 172.21.15.57:0/2847041683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0047e0 con 0x7f790813d3b0 2023-10-16T19:41:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.423+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7908144530 con 0x7f790813d3b0 2023-10-16T19:41:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.423+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081ed2d0 con 0x7f790813d3b0 2023-10-16T19:41:40.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.427+0000 7f791282f740 1 Processor -- start 2023-10-16T19:41:40.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.427+0000 7f791282f740 1 -- start start 2023-10-16T19:41:40.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.428+0000 7f791282f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469568d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.428+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.428+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 0x5564695a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.428+0000 7f791282f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564694837a0 con 0x556469568980 2023-10-16T19:41:40.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.428+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564694d5740 con 0x5564695b2800 2023-10-16T19:41:40.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.428+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564694d2e30 con 0x5564695673e0 2023-10-16T19:41:40.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.429+0000 7f790d160640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 0x5564695a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.430+0000 7f790d160640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 0x5564695a81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36514/0 (socket says 172.21.15.57:36514) 2023-10-16T19:41:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.430+0000 7f790d160640 1 -- 172.21.15.57:0/2962522124 learned_addr learned my addr 172.21.15.57:0/2962522124 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.436+0000 7f790d160640 1 -- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 msgr2=0x5564695692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.436+0000 7f790d160640 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.436+0000 7f790d160640 1 -- 172.21.15.57:0/2962522124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 msgr2=0x556469568d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.437+0000 7f790d160640 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469568d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.437+0000 7f790d160640 1 -- 172.21.15.57:0/2962522124 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556469492910 con 0x5564695673e0 2023-10-16T19:41:40.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.442+0000 7f790d160640 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 0x5564695a81e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78fc012000 tx=0x7f78fc006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=845964268018f9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.446+0000 7f79067fc640 1 -- 172.21.15.57:0/2847041683 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78fc013470 con 0x7f790813d3b0 2023-10-16T19:41:40.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.448+0000 7f79067fc640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78f406aef0 0x7f78f406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.448+0000 7f790e162640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78f406aef0 0x7f78f406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.448+0000 7f79067fc640 1 -- 172.21.15.57:0/2847041683 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78fc05ac70 con 0x7f790813d3b0 2023-10-16T19:41:40.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.449+0000 7f790e162640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78f406aef0 0x7f78f406d3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79080c6090 tx=0x7f7900009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.459+0000 7f78ef7fe640 1 -- 172.21.15.57:0/2962522124 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc056fb0 con 0x5564695673e0 2023-10-16T19:41:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.459+0000 7f78ef7fe640 1 -- 172.21.15.57:0/2962522124 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc05aa40 con 0x5564695673e0 2023-10-16T19:41:40.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.459+0000 7f78ef7fe640 1 -- 172.21.15.57:0/2962522124 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc05a7b0 con 0x5564695673e0 2023-10-16T19:41:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.459+0000 7f791282f740 1 -- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 msgr2=0x5564695a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.459+0000 7f791282f740 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 0x5564695a81e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78fc012000 tx=0x7f78fc006000 comp rx=0 tx=0).stop 2023-10-16T19:41:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 -- 172.21.15.57:0/2962522124 shutdown_connections 2023-10-16T19:41:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695673e0 0x5564695a81e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 --2- 172.21.15.57:0/2962522124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469568d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 -- 172.21.15.57:0/2962522124 >> 172.21.15.57:0/2962522124 conn(0x5564695650f0 msgr2=0x556469567a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 -- 172.21.15.57:0/2962522124 shutdown_connections 2023-10-16T19:41:40.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.460+0000 7f791282f740 1 -- 172.21.15.57:0/2962522124 wait complete. 2023-10-16T19:41:40.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.461+0000 7f791282f740 1 -- start start 2023-10-16T19:41:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.461+0000 7f791282f740 1 Processor -- start 2023-10-16T19:41:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469591160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x5564695b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564694ce720 con 0x556469568980 2023-10-16T19:41:40.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646946c970 con 0x5564695b2800 2023-10-16T19:41:40.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55646946c610 con 0x5564695a64d0 2023-10-16T19:41:40.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.463+0000 7f791282f740 10 client.0 _ll_register_callbacks cb 0x55646948e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.465+0000 7f790d160640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.465+0000 7f790e162640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x5564695b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.465+0000 7f790d160640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54734/0 (socket says 172.21.15.57:54734) 2023-10-16T19:41:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.465+0000 7f790e162640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x5564695b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36530/0 (socket says 172.21.15.57:36530) 2023-10-16T19:41:40.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.465+0000 7f790d160640 1 -- 172.21.15.57:0/1606571641 learned_addr learned my addr 172.21.15.57:0/1606571641 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.466+0000 7f790d961640 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469591160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.470+0000 7f790d961640 1 -- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 msgr2=0x5564695b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.470+0000 7f790d961640 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x5564695b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.470+0000 7f790d961640 1 -- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 msgr2=0x5564695a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.470+0000 7f790d961640 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.470+0000 7f790d961640 1 -- 172.21.15.57:0/1606571641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081ed2d0 con 0x556469568980 2023-10-16T19:41:40.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.473+0000 7f790d961640 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469591160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78f00045e0 tx=0x7f78f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959bc36474054d8e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.473+0000 7f78ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:40.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.478+0000 7f78ecff9640 1 -- 172.21.15.57:0/1606571641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8034b00 con 0x556469568980 2023-10-16T19:41:40.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.478+0000 7f78ecff9640 1 -- 172.21.15.57:0/1606571641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78f8034c60 con 0x556469568980 2023-10-16T19:41:40.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.478+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564694f5160 con 0x556469568980 2023-10-16T19:41:40.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.480+0000 7f78ecff9640 1 -- 172.21.15.57:0/1606571641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78f802ce80 con 0x556469568980 2023-10-16T19:41:40.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.480+0000 7f791282f740 10 client.4518 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:40.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.480+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5564694ccda0 con 0x556469568980 2023-10-16T19:41:40.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.485+0000 7f78ecff9640 1 -- 172.21.15.57:0/1606571641 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564694f5160 con 0x556469568980 2023-10-16T19:41:40.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f78ecff9640 1 -- 172.21.15.57:0/1606571641 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f78f8048460 con 0x556469568980 2023-10-16T19:41:40.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f791282f740 10 client.4518 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:40.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f791282f740 10 client.4518 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-16T19:41:40.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f791282f740 20 client.4518 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:40.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f791282f740 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695b16d0 0x5564695bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f791282f740 4 client.4518 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:41:40.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.486+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 --> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564694a0cc0 con 0x5564695b16d0 2023-10-16T19:41:40.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.488+0000 7f790d160640 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695b16d0 0x5564695bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.581+0000 7f790d160640 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695b16d0 0x5564695bc930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61107ab97d9211ee server_cookie=71984f11c67ecdf8 in_seq=0 out_seq=0 2023-10-16T19:41:40.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.581+0000 7f78ecff9640 10 client.4518 ms_handle_connect on v2:172.21.15.110:6834/3004262175 2023-10-16T19:41:40.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.780+0000 7f78ecff9640 1 -- 172.21.15.57:0/1606571641 <== mds.2 v2:172.21.15.110:6834/3004262175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5564694a0cc0 con 0x5564695b16d0 2023-10-16T19:41:40.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.780+0000 7f78ecff9640 10 client.4518 handle_command_reply: tid=0 2023-10-16T19:41:40.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.780+0000 7f791282f740 1 client.4518 shutdown 2023-10-16T19:41:40.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.781+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 msgr2=0x556469591160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.781+0000 7f791282f740 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469591160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78f00045e0 tx=0x7f78f8009750 comp rx=0 tx=0).stop 2023-10-16T19:41:40.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 shutdown_connections 2023-10-16T19:41:40.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695b16d0 0x5564695bc930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x5564695b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 --2- 172.21.15.57:0/1606571641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x556469591160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f78ecff9640 0 client.4518 ms_handle_reset on v2:172.21.15.110:6834/3004262175 2023-10-16T19:41:40.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 >> 172.21.15.57:0/1606571641 conn(0x5564695673e0 msgr2=0x5564695a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 shutdown_connections 2023-10-16T19:41:40.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.782+0000 7f791282f740 1 -- 172.21.15.57:0/1606571641 wait complete. 2023-10-16T19:41:40.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.783+0000 7f791282f740 20 client.4518 trim_cache size 0 max 16384 2023-10-16T19:41:40.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.820+0000 7f791282f740 1 Processor -- start 2023-10-16T19:41:40.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.820+0000 7f791282f740 1 -- start start 2023-10-16T19:41:40.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.822+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556469568980 0x55646958d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.822+0000 7f791282f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5564695a64d0 0x556469561e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.823+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x556469562380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.823+0000 7f791282f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564695b7060 con 0x5564695a64d0 2023-10-16T19:41:40.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.823+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556469232f20 con 0x5564695b2800 2023-10-16T19:41:40.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.823+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564695b87a0 con 0x556469568980 2023-10-16T19:41:40.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.824+0000 7f790e162640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x556469562380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.825+0000 7f790d160640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5564695a64d0 0x556469561e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.826+0000 7f790e162640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x556469562380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54746/0 (socket says 172.21.15.57:54746) 2023-10-16T19:41:40.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.826+0000 7f790e162640 1 -- 172.21.15.57:0/1908676460 learned_addr learned my addr 172.21.15.57:0/1908676460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.826+0000 7f790d961640 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556469568980 0x55646958d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.831+0000 7f790d160640 1 -- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556469568980 msgr2=0x55646958d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.831+0000 7f790d160640 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556469568980 0x55646958d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.831+0000 7f790d160640 1 -- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 msgr2=0x556469562380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.831+0000 7f790d160640 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x556469562380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.831+0000 7f790d160640 1 -- 172.21.15.57:0/1908676460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646946bb80 con 0x5564695a64d0 2023-10-16T19:41:40.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.835+0000 7f790d160640 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5564695a64d0 0x556469561e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78fc05ae30 tx=0x7f78fc0570d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bb2409558bad67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.842+0000 7f78effff640 1 -- 172.21.15.57:0/1908676460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc059010 con 0x5564695a64d0 2023-10-16T19:41:40.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.842+0000 7f78effff640 1 -- 172.21.15.57:0/1908676460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc057380 con 0x5564695a64d0 2023-10-16T19:41:40.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.842+0000 7f78effff640 1 -- 172.21.15.57:0/1908676460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc05b0d0 con 0x5564695a64d0 2023-10-16T19:41:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 -- 172.21.15.57:0/1908676460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5564695a64d0 msgr2=0x556469561e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5564695a64d0 0x556469561e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78fc05ae30 tx=0x7f78fc0570d0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 -- 172.21.15.57:0/1908676460 shutdown_connections 2023-10-16T19:41:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x556469562380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5564695a64d0 0x556469561e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 --2- 172.21.15.57:0/1908676460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556469568980 0x55646958d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 -- 172.21.15.57:0/1908676460 >> 172.21.15.57:0/1908676460 conn(0x5564695673e0 msgr2=0x556469591b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.843+0000 7f791282f740 1 -- 172.21.15.57:0/1908676460 shutdown_connections 2023-10-16T19:41:40.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.844+0000 7f791282f740 1 -- 172.21.15.57:0/1908676460 wait complete. 2023-10-16T19:41:40.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.845+0000 7f791282f740 1 -- start start 2023-10-16T19:41:40.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.845+0000 7f791282f740 1 Processor -- start 2023-10-16T19:41:40.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x55646960b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x55646960be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556469591840 con 0x556469568980 2023-10-16T19:41:40.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564695cb720 con 0x5564695b2800 2023-10-16T19:41:40.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564695cb970 con 0x5564695a64d0 2023-10-16T19:41:40.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.847+0000 7f791282f740 10 client.0 _ll_register_callbacks cb 0x7f78f00036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:40.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.848+0000 7f790d961640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x55646960b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.849+0000 7f790d961640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x55646960b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34236/0 (socket says 172.21.15.57:34236) 2023-10-16T19:41:40.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.849+0000 7f790d961640 1 -- 172.21.15.57:0/2175754854 learned_addr learned my addr 172.21.15.57:0/2175754854 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:40.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.849+0000 7f790d160640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x55646960be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.849+0000 7f790e162640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.853+0000 7f790d961640 1 -- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 msgr2=0x55646960be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.853+0000 7f790d961640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x55646960be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.853+0000 7f790d961640 1 -- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 msgr2=0x5564695a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.853+0000 7f790d961640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.853+0000 7f790d961640 1 -- 172.21.15.57:0/2175754854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556469492910 con 0x556469568980 2023-10-16T19:41:40.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.856+0000 7f790d961640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x55646960b910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f78f802c5c0 tx=0x7f78f802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fd20743ac75348 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:40.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.856+0000 7f78ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:40.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.861+0000 7f78ecff9640 1 -- 172.21.15.57:0/2175754854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8009750 con 0x556469568980 2023-10-16T19:41:40.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.861+0000 7f78ecff9640 1 -- 172.21.15.57:0/2175754854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78f80090a0 con 0x556469568980 2023-10-16T19:41:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.861+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78fc05aa40 con 0x556469568980 2023-10-16T19:41:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.864+0000 7f78ecff9640 1 -- 172.21.15.57:0/2175754854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78f8048460 con 0x556469568980 2023-10-16T19:41:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.864+0000 7f791282f740 10 client.4524 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.864+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556469491170 con 0x556469568980 2023-10-16T19:41:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f78ecff9640 1 -- 172.21.15.57:0/2175754854 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc05aa40 con 0x556469568980 2023-10-16T19:41:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f78ecff9640 1 -- 172.21.15.57:0/2175754854 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f78f805d450 con 0x556469568980 2023-10-16T19:41:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f791282f740 10 client.4524 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f791282f740 10 client.4524 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-16T19:41:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f791282f740 20 client.4524 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f791282f740 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695bb4a0 0x5564695bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f791282f740 4 client.4524 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:41:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.869+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 --> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5564694c7700 con 0x5564695bb4a0 2023-10-16T19:41:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.872+0000 7f790d160640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695bb4a0 0x5564695bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.884+0000 7f790d160640 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695bb4a0 0x5564695bb880 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25e6acb0ff0d2857 server_cookie=acb98ad15fae136c in_seq=0 out_seq=0 2023-10-16T19:41:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.884+0000 7f78ecff9640 10 client.4524 ms_handle_connect on v2:172.21.15.110:6834/3004262175 2023-10-16T19:41:40.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.919+0000 7f78ecff9640 1 -- 172.21.15.57:0/2175754854 <== mds.2 v2:172.21.15.110:6834/3004262175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5564694c7700 con 0x5564695bb4a0 2023-10-16T19:41:40.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.919+0000 7f78ecff9640 10 client.4524 handle_command_reply: tid=0 2023-10-16T19:41:40.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.919+0000 7f791282f740 1 client.4524 shutdown 2023-10-16T19:41:40.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.919+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 msgr2=0x55646960b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.919+0000 7f791282f740 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x55646960b910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f78f802c5c0 tx=0x7f78f802e000 comp rx=0 tx=0).stop 2023-10-16T19:41:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 shutdown_connections 2023-10-16T19:41:40.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:6834/3004262175,v1:172.21.15.110:6835/3004262175] conn(0x5564695bb4a0 0x5564695bb880 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5564695b2800 0x5564695a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5564695a64d0 0x55646960be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f78ecff9640 0 client.4524 ms_handle_reset on v2:172.21.15.110:6834/3004262175 2023-10-16T19:41:40.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 --2- 172.21.15.57:0/2175754854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556469568980 0x55646960b910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 >> 172.21.15.57:0/2175754854 conn(0x5564695673e0 msgr2=0x55646958fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 shutdown_connections 2023-10-16T19:41:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.920+0000 7f791282f740 1 -- 172.21.15.57:0/2175754854 wait complete. 2023-10-16T19:41:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.921+0000 7f791282f740 20 client.4524 trim_cache size 0 max 16384 2023-10-16T19:41:40.928 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T19:41:40.929 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "ee1d7270-3118-4d78-b8fc-a1736155df58", 2023-10-16T19:41:40.929 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 2, 2023-10-16T19:41:40.929 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4244, 2023-10-16T19:41:40.930 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-16T19:41:40.930 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-16T19:41:40.930 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-16T19:41:40.931 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 26.438507671, 2023-10-16T19:41:40.931 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2023-10-16T19:41:40.932 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 25, 2023-10-16T19:41:40.932 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-10-16T19:41:40.932 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 53.407349226999997 2023-10-16T19:41:40.933 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T19:41:40.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78f406aef0 msgr2=0x7f78f406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78f406aef0 0x7f78f406d3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79080c6090 tx=0x7f7900009190 comp rx=0 tx=0).stop 2023-10-16T19:41:40.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f790813d3b0 msgr2=0x7f7908143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:40.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f790813d3b0 0x7f7908143000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00d800 tx=0x7f78fc00dcc0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 shutdown_connections 2023-10-16T19:41:40.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78f406aef0 0x7f78f406d3b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081e9d80 0x7f79081ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f790813d3b0 0x7f7908143000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 --2- 172.21.15.57:0/2847041683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78f0003970 0x7f7908142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:40.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 >> 172.21.15.57:0/2847041683 conn(0x7f790806c430 msgr2=0x7f79080c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:40.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 shutdown_connections 2023-10-16T19:41:40.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:40.922+0000 7f790fbc5640 1 -- 172.21.15.57:0/2847041683 wait complete. 2023-10-16T19:41:40.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T19:41:41.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.171+0000 7f81f781a640 1 Processor -- start 2023-10-16T19:41:41.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.172+0000 7f81f781a640 1 -- start start 2023-10-16T19:41:41.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.173+0000 7f81f781a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 0x7f81f00c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.173+0000 7f81f781a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f0151570 con 0x7f81f00c12f0 2023-10-16T19:41:41.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.173+0000 7f81f781a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f00c5530 con 0x7f81f00c2aa0 2023-10-16T19:41:41.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.173+0000 7f81f781a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c4010 con 0x7f81f0151190 2023-10-16T19:41:41.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.174+0000 7f81f4db5640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f81f00c12f0 0x7f81f006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57226/0 (socket says 172.21.15.57:57226) 2023-10-16T19:41:41.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.174+0000 7f81f4db5640 1 -- 172.21.15.57:0/1906529567 learned_addr learned my addr 172.21.15.57:0/1906529567 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:41.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.175+0000 7f81f55b6640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 0x7f81f00c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.178+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773944620 0 0) 0x7f81f0151570 con 0x7f81f00c12f0 2023-10-16T19:41:41.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.178+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81dc003520 con 0x7f81f00c12f0 2023-10-16T19:41:41.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031717412 0 0) 0x7f81dc003520 con 0x7f81f00c12f0 2023-10-16T19:41:41.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 msgr2=0x7f81f00c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 0x7f81f00c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 >> v1:172.21.15.110:6789/0 conn(0x7f81f00c2aa0 legacy=0x7f81f006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00c2f30 con 0x7f81f00c12f0 2023-10-16T19:41:41.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f81e0001670 con 0x7f81f00c12f0 2023-10-16T19:41:41.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 >> v1:172.21.15.57:6789/0 conn(0x7f81f00c12f0 legacy=0x7f81f006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81dc0039a0 0x7f81dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81dc0047c0 0x7f81dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 0x7f81dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c4010 con 0x7f81dc0047c0 2023-10-16T19:41:41.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc00ba60 con 0x7f81dc0039a0 2023-10-16T19:41:41.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.182+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc00bc20 con 0x7f81f0151190 2023-10-16T19:41:41.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.187+0000 7f81f4db5640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81dc0047c0 0x7f81dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f5db7640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 0x7f81dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f4db5640 1 -- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 msgr2=0x7f81dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f4db5640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f0151190 0x7f81dc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f55b6640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81dc0039a0 0x7f81dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f4db5640 1 -- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81dc0039a0 msgr2=0x7f81dc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f4db5640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81dc0039a0 0x7f81dc003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.191+0000 7f81f4db5640 1 -- 172.21.15.57:0/1906529567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc003520 con 0x7f81dc0047c0 2023-10-16T19:41:41.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.195+0000 7f81f4db5640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81dc0047c0 0x7f81dc004c40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81e0007fb0 tx=0x7f81dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a37906122f20da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.200+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0005ad0 con 0x7f81dc0047c0 2023-10-16T19:41:41.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.200+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e0005c30 con 0x7f81dc0047c0 2023-10-16T19:41:41.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.200+0000 7f81e7fff640 1 -- 172.21.15.57:0/1906529567 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e002c790 con 0x7f81dc0047c0 2023-10-16T19:41:41.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f781a640 1 -- 172.21.15.57:0/1906529567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81dc0047c0 msgr2=0x7f81dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f781a640 1 --2- 172.21.15.57:0/1906529567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81dc0047c0 0x7f81dc004c40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81e0007fb0 tx=0x7f81dc0057f0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f5db7640 1 -- 172.21.15.57:0/1906529567 reap_dead start 2023-10-16T19:41:41.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f781a640 1 -- 172.21.15.57:0/1906529567 shutdown_connections 2023-10-16T19:41:41.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f781a640 1 -- 172.21.15.57:0/1906529567 >> 172.21.15.57:0/1906529567 conn(0x7f81f006c430 msgr2=0x7f81f0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:41.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f781a640 1 -- 172.21.15.57:0/1906529567 shutdown_connections 2023-10-16T19:41:41.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.202+0000 7f81f781a640 1 -- 172.21.15.57:0/1906529567 wait complete. 2023-10-16T19:41:41.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.205+0000 7f81f781a640 1 Processor -- start 2023-10-16T19:41:41.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.205+0000 7f81f781a640 1 -- start start 2023-10-16T19:41:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.207+0000 7f81f781a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f014e0e0 0x7f81f00c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.207+0000 7f81f781a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f014e4c0 0x7f81f01ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.207+0000 7f81f781a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 0x7f81f00bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.207+0000 7f81f781a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01e9ea0 con 0x7f81f01ea870 2023-10-16T19:41:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.207+0000 7f81f781a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01ee0c0 con 0x7f81f014e0e0 2023-10-16T19:41:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.207+0000 7f81f781a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c0c60 con 0x7f81f014e4c0 2023-10-16T19:41:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.208+0000 7f81f5db7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 0x7f81f00bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.209+0000 7f81f5db7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 0x7f81f00bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34258/0 (socket says 172.21.15.57:34258) 2023-10-16T19:41:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.209+0000 7f81f5db7640 1 -- 172.21.15.57:0/410897310 learned_addr learned my addr 172.21.15.57:0/410897310 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.209+0000 7f81f4db5640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f014e4c0 0x7f81f01ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.209+0000 7f81f55b6640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f014e0e0 0x7f81f00c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.213+0000 7f81f5db7640 1 -- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f014e4c0 msgr2=0x7f81f01ea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.213+0000 7f81f5db7640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f014e4c0 0x7f81f01ea330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.213+0000 7f81f5db7640 1 -- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f014e0e0 msgr2=0x7f81f00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.213+0000 7f81f5db7640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f014e0e0 0x7f81f00c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.213+0000 7f81f5db7640 1 -- 172.21.15.57:0/410897310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f01ed540 con 0x7f81f01ea870 2023-10-16T19:41:41.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.216+0000 7f81f5db7640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 0x7f81f00bf380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81f006e790 tx=0x7f81e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.221+0000 7f81e5ffb640 1 -- 172.21.15.57:0/410897310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8003b70 con 0x7f81f01ea870 2023-10-16T19:41:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.221+0000 7f81e5ffb640 1 -- 172.21.15.57:0/410897310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8003cd0 con 0x7f81f01ea870 2023-10-16T19:41:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.221+0000 7f81e5ffb640 1 -- 172.21.15.57:0/410897310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e80052b0 con 0x7f81f01ea870 2023-10-16T19:41:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.221+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f01ed820 con 0x7f81f01ea870 2023-10-16T19:41:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.221+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f01edde0 con 0x7f81f01ea870 2023-10-16T19:41:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.225+0000 7f81fa3ad740 1 Processor -- start 2023-10-16T19:41:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 -- start start 2023-10-16T19:41:41.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d61929d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d6192a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d619283e0 0x563d619691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d618447a0 con 0x563d61973800 2023-10-16T19:41:41.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d61896740 con 0x563d619283e0 2023-10-16T19:41:41.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.226+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d61893e30 con 0x563d61929980 2023-10-16T19:41:41.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.228+0000 7f81f4db5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d61929d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.229+0000 7f81f4db5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d619283e0 0x563d619691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.229+0000 7f81f4db5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d61929d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36572/0 (socket says 172.21.15.57:36572) 2023-10-16T19:41:41.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.229+0000 7f81f4db5640 1 -- 172.21.15.57:0/4023705575 learned_addr learned my addr 172.21.15.57:0/4023705575 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:41.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.235+0000 7f81f4db5640 1 -- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d619283e0 msgr2=0x563d619691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.235+0000 7f81f4db5640 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d619283e0 0x563d619691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.235+0000 7f81f4db5640 1 -- 172.21.15.57:0/4023705575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 msgr2=0x563d6192a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.235+0000 7f81f4db5640 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d6192a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.235+0000 7f81f4db5640 1 -- 172.21.15.57:0/4023705575 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d61853910 con 0x563d61929980 2023-10-16T19:41:41.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.240+0000 7f81f4db5640 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d61929d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f81e0007fb0 tx=0x7f81e0007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13af88b603b2fc74 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.251+0000 7f81e5ffb640 1 -- 172.21.15.57:0/410897310 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81e8005410 con 0x7f81f01ea870 2023-10-16T19:41:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.251+0000 7f81d2ffd640 1 -- 172.21.15.57:0/4023705575 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00059e0 con 0x563d61929980 2023-10-16T19:41:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.251+0000 7f81d2ffd640 1 -- 172.21.15.57:0/4023705575 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e003d020 con 0x563d61929980 2023-10-16T19:41:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.251+0000 7f81d2ffd640 1 -- 172.21.15.57:0/4023705575 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00015b0 con 0x563d61929980 2023-10-16T19:41:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 -- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 msgr2=0x563d61929d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d61929d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f81e0007fb0 tx=0x7f81e0007000 comp rx=0 tx=0).stop 2023-10-16T19:41:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 -- 172.21.15.57:0/4023705575 shutdown_connections 2023-10-16T19:41:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d619283e0 0x563d619691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d6192a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/4023705575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d61929d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.252+0000 7f81fa3ad740 1 -- 172.21.15.57:0/4023705575 >> 172.21.15.57:0/4023705575 conn(0x563d619260f0 msgr2=0x563d61928a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.253+0000 7f81fa3ad740 1 -- 172.21.15.57:0/4023705575 shutdown_connections 2023-10-16T19:41:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.253+0000 7f81fa3ad740 1 -- 172.21.15.57:0/4023705575 wait complete. 2023-10-16T19:41:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.253+0000 7f81e5ffb640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f81d406ad90 0x7f81d406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.253+0000 7f81f55b6640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f81d406ad90 0x7f81d406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.254+0000 7f81e5ffb640 1 -- 172.21.15.57:0/410897310 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f81e8003e40 con 0x7f81f01ea870 2023-10-16T19:41:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.254+0000 7f81fa3ad740 1 -- start start 2023-10-16T19:41:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.254+0000 7f81fa3ad740 1 Processor -- start 2023-10-16T19:41:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81f55b6640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f81d406ad90 0x7f81d406d250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x563d61973c00 tx=0x7f81ec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 0x563d6197a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d6196ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61970080 0x563d61953de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6188f720 con 0x563d61929980 2023-10-16T19:41:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6182d970 con 0x563d61973800 2023-10-16T19:41:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d6182d610 con 0x563d61970080 2023-10-16T19:41:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.255+0000 7f81fa3ad740 10 client.0 _ll_register_callbacks cb 0x563d6184f9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.257+0000 7f81f55b6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 0x563d6197a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.257+0000 7f81f55b6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 0x563d6197a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34280/0 (socket says 172.21.15.57:34280) 2023-10-16T19:41:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.257+0000 7f81f55b6640 1 -- 172.21.15.57:0/2896016067 learned_addr learned my addr 172.21.15.57:0/2896016067 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:41.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.257+0000 7f81f4db5640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d6196ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.258+0000 7f81f5db7640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61970080 0x563d61953de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.263+0000 7f81f55b6640 1 -- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61970080 msgr2=0x563d61953de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.263+0000 7f81f55b6640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61970080 0x563d61953de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.263+0000 7f81f55b6640 1 -- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 msgr2=0x563d6196ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.263+0000 7f81f55b6640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d6196ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.263+0000 7f81f55b6640 1 -- 172.21.15.57:0/2896016067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e003f040 con 0x563d61929980 2023-10-16T19:41:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.266+0000 7f81f55b6640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 0x563d6197a480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f81ec013e10 tx=0x7f81ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcf9d068f5f7250 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.266+0000 7f81cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:41.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.270+0000 7f81cbfff640 1 -- 172.21.15.57:0/2896016067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec023440 con 0x563d61929980 2023-10-16T19:41:41.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.270+0000 7f81cbfff640 1 -- 172.21.15.57:0/2896016067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f81ec0235a0 con 0x563d61929980 2023-10-16T19:41:41.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.270+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d618b6160 con 0x563d61929980 2023-10-16T19:41:41.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.272+0000 7f81cbfff640 1 -- 172.21.15.57:0/2896016067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81ec023760 con 0x563d61929980 2023-10-16T19:41:41.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.272+0000 7f81fa3ad740 10 client.4533 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:41.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.272+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563d6188dda0 con 0x563d61929980 2023-10-16T19:41:41.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81cbfff640 1 -- 172.21.15.57:0/2896016067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d618b6160 con 0x563d61929980 2023-10-16T19:41:41.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81cbfff640 1 -- 172.21.15.57:0/2896016067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f81ec0238c0 con 0x563d61929980 2023-10-16T19:41:41.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81fa3ad740 10 client.4533 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:41.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81fa3ad740 10 client.4533 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T19:41:41.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81fa3ad740 20 client.4533 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:41.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d61950990 0x563d6197e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81fa3ad740 4 client.4533 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:41:41.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.277+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 --> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d61861cc0 con 0x563d61950990 2023-10-16T19:41:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.280+0000 7f81f4db5640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d61950990 0x563d6197e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.382+0000 7f81f4db5640 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d61950990 0x563d6197e090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca24ab55b249a70d server_cookie=6653d42c79cfcb92 in_seq=0 out_seq=0 2023-10-16T19:41:41.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.382+0000 7f81cbfff640 10 client.4533 ms_handle_connect on v2:172.21.15.110:6836/919279935 2023-10-16T19:41:41.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.603+0000 7f81cbfff640 1 -- 172.21.15.57:0/2896016067 <== mds.1 v2:172.21.15.110:6836/919279935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563d61861cc0 con 0x563d61950990 2023-10-16T19:41:41.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.603+0000 7f81cbfff640 10 client.4533 handle_command_reply: tid=0 2023-10-16T19:41:41.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.604+0000 7f81fa3ad740 1 client.4533 shutdown 2023-10-16T19:41:41.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 msgr2=0x563d6197a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 0x563d6197a480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f81ec013e10 tx=0x7f81ec0046c0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 shutdown_connections 2023-10-16T19:41:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d61950990 0x563d6197e090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61970080 0x563d61953de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d6196ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2896016067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61929980 0x563d6197a480 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81cbfff640 0 client.4533 ms_handle_reset on v2:172.21.15.110:6836/919279935 2023-10-16T19:41:41.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 >> 172.21.15.57:0/2896016067 conn(0x563d619283e0 msgr2=0x563d61922e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:41.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 shutdown_connections 2023-10-16T19:41:41.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.605+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2896016067 wait complete. 2023-10-16T19:41:41.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.606+0000 7f81fa3ad740 20 client.4533 trim_cache size 0 max 16384 2023-10-16T19:41:41.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.654+0000 7f81fa3ad740 1 Processor -- start 2023-10-16T19:41:41.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.654+0000 7f81fa3ad740 1 -- start start 2023-10-16T19:41:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.656+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6196da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.656+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61970080 0x563d6196df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.656+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d61927200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.656+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d615f3f20 con 0x563d61973800 2023-10-16T19:41:41.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.656+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d61972d40 con 0x563d61970080 2023-10-16T19:41:41.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.656+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d61967840 con 0x563d61929980 2023-10-16T19:41:41.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.658+0000 7f81f4db5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61970080 0x563d6196df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.659+0000 7f81f55b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6196da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.659+0000 7f81f4db5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61970080 0x563d6196df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54798/0 (socket says 172.21.15.57:54798) 2023-10-16T19:41:41.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.659+0000 7f81f4db5640 1 -- 172.21.15.57:0/2358561281 learned_addr learned my addr 172.21.15.57:0/2358561281 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:41.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.660+0000 7f81f5db7640 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d61927200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.665+0000 7f81f5db7640 1 -- 172.21.15.57:0/2358561281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 msgr2=0x563d6196da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.665+0000 7f81f5db7640 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6196da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.665+0000 7f81f5db7640 1 -- 172.21.15.57:0/2358561281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61970080 msgr2=0x563d6196df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.665+0000 7f81f5db7640 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61970080 0x563d6196df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.665+0000 7f81f5db7640 1 -- 172.21.15.57:0/2358561281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d6182cb80 con 0x563d61973800 2023-10-16T19:41:41.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.668+0000 7f81f5db7640 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d61927200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e8087540 tx=0x7f81e8087410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39e3a9623bb1aea server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.680+0000 7f81d37fe640 1 -- 172.21.15.57:0/2358561281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e80056c0 con 0x563d61973800 2023-10-16T19:41:41.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.680+0000 7f81d37fe640 1 -- 172.21.15.57:0/2358561281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8005820 con 0x563d61973800 2023-10-16T19:41:41.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.680+0000 7f81d37fe640 1 -- 172.21.15.57:0/2358561281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e805fbf0 con 0x563d61973800 2023-10-16T19:41:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2358561281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 msgr2=0x563d61927200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d61927200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e8087540 tx=0x7f81e8087410 comp rx=0 tx=0).stop 2023-10-16T19:41:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2358561281 shutdown_connections 2023-10-16T19:41:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61973800 0x563d61927200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61970080 0x563d6196df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2358561281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6196da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.682+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2358561281 >> 172.21.15.57:0/2358561281 conn(0x563d619283e0 msgr2=0x563d61963a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.683+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2358561281 shutdown_connections 2023-10-16T19:41:41.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.683+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2358561281 wait complete. 2023-10-16T19:41:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.684+0000 7f81fa3ad740 1 -- start start 2023-10-16T19:41:41.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.685+0000 7f81fa3ad740 1 Processor -- start 2023-10-16T19:41:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6198b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61970080 0x563d619cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d619cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d6198c290 con 0x563d61970080 2023-10-16T19:41:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d61964190 con 0x563d61973800 2023-10-16T19:41:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d6198c8b0 con 0x563d61929980 2023-10-16T19:41:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.688+0000 7f81fa3ad740 10 client.0 _ll_register_callbacks cb 0x7f81ec0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.689+0000 7f81f55b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6198b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.690+0000 7f81f55b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6198b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36608/0 (socket says 172.21.15.57:36608) 2023-10-16T19:41:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.690+0000 7f81f55b6640 1 -- 172.21.15.57:0/2342221933 learned_addr learned my addr 172.21.15.57:0/2342221933 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.691+0000 7f81f5db7640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d619cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.691+0000 7f81f4db5640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61970080 0x563d619cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.699+0000 7f81f55b6640 1 -- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 msgr2=0x563d619cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.699+0000 7f81f55b6640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d619cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.699+0000 7f81f55b6640 1 -- 172.21.15.57:0/2342221933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61970080 msgr2=0x563d619cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.699+0000 7f81f55b6640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61970080 0x563d619cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.699+0000 7f81f55b6640 1 -- 172.21.15.57:0/2342221933 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f01edde0 con 0x563d61929980 2023-10-16T19:41:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.707+0000 7f81f55b6640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6198b960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006df0 tx=0x7f81ec023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a89dc03476f726d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.707+0000 7f81cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2023-10-16T19:41:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.720+0000 7f81cbfff640 1 -- 172.21.15.57:0/2342221933 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec013e40 con 0x563d61929980 2023-10-16T19:41:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.720+0000 7f81cbfff640 1 -- 172.21.15.57:0/2342221933 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f81ec023650 con 0x563d61929980 2023-10-16T19:41:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.720+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81e003d020 con 0x563d61929980 2023-10-16T19:41:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.877+0000 7f81cbfff640 1 -- 172.21.15.57:0/2342221933 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81ec023810 con 0x563d61929980 2023-10-16T19:41:41.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.877+0000 7f81fa3ad740 10 client.4517 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:41.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.877+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563d61852170 con 0x563d61929980 2023-10-16T19:41:41.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81cbfff640 1 -- 172.21.15.57:0/2342221933 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e003d020 con 0x563d61929980 2023-10-16T19:41:41.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81cbfff640 1 -- 172.21.15.57:0/2342221933 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f81ec046440 con 0x563d61929980 2023-10-16T19:41:41.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81fa3ad740 10 client.4517 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:41.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81fa3ad740 10 client.4517 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T19:41:41.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81fa3ad740 20 client.4517 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:41.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d6198a400 0x563d6198a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:41.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81fa3ad740 4 client.4517 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:41:41.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.913+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 --> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563d61888700 con 0x563d6198a400 2023-10-16T19:41:41.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.916+0000 7f81f4db5640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d6198a400 0x563d6198a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:41.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.924+0000 7f81f4db5640 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d6198a400 0x563d6198a7e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcf2c864dabc6b33 server_cookie=ea8924faf994e444 in_seq=0 out_seq=0 2023-10-16T19:41:41.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.924+0000 7f81cbfff640 10 client.4517 ms_handle_connect on v2:172.21.15.110:6836/919279935 2023-10-16T19:41:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.974+0000 7f81cbfff640 1 -- 172.21.15.57:0/2342221933 <== mds.1 v2:172.21.15.110:6836/919279935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563d61888700 con 0x563d6198a400 2023-10-16T19:41:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.974+0000 7f81cbfff640 10 client.4517 handle_command_reply: tid=0 2023-10-16T19:41:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.974+0000 7f81fa3ad740 1 client.4517 shutdown 2023-10-16T19:41:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 msgr2=0x563d6198b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6198b960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006df0 tx=0x7f81ec023000 comp rx=0 tx=0).stop 2023-10-16T19:41:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 shutdown_connections 2023-10-16T19:41:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563d61973800 0x563d619cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d61970080 0x563d619cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:6836/919279935,v1:172.21.15.110:6837/919279935] conn(0x563d6198a400 0x563d6198a7e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 --2- 172.21.15.57:0/2342221933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x563d61929980 0x563d6198b960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 >> 172.21.15.57:0/2342221933 conn(0x563d619283e0 msgr2=0x563d6196d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81cbfff640 0 client.4517 ms_handle_reset on v2:172.21.15.110:6836/919279935 2023-10-16T19:41:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.975+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 shutdown_connections 2023-10-16T19:41:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.976+0000 7f81fa3ad740 1 -- 172.21.15.57:0/2342221933 wait complete. 2023-10-16T19:41:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.976+0000 7f81fa3ad740 20 client.4517 trim_cache size 0 max 16384 2023-10-16T19:41:41.980 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T19:41:41.981 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "ee1d7270-3118-4d78-b8fc-a1736155df58", 2023-10-16T19:41:41.981 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 1, 2023-10-16T19:41:41.981 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4247, 2023-10-16T19:41:41.981 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-16T19:41:41.981 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-16T19:41:41.982 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-16T19:41:41.982 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 34.513454422999999, 2023-10-16T19:41:41.982 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2023-10-16T19:41:41.982 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 25, 2023-10-16T19:41:41.982 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-10-16T19:41:41.983 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 54.420535776999998 2023-10-16T19:41:41.983 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T19:41:41.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.977+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f81d406ad90 msgr2=0x7f81d406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.977+0000 7f81f781a640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f81d406ad90 0x7f81d406d250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x563d61973c00 tx=0x7f81ec009190 comp rx=0 tx=0).stop 2023-10-16T19:41:41.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.977+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 msgr2=0x7f81f00bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:41.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.977+0000 7f81f781a640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 0x7f81f00bf380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81f006e790 tx=0x7f81e800dc00 comp rx=0 tx=0).stop 2023-10-16T19:41:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 shutdown_connections 2023-10-16T19:41:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f81d406ad90 0x7f81d406d250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81f01ea870 0x7f81f00bf380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81f014e4c0 0x7f81f01ea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 --2- 172.21.15.57:0/410897310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f014e0e0 0x7f81f00c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 >> 172.21.15.57:0/410897310 conn(0x7f81f006c430 msgr2=0x7f81f0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 shutdown_connections 2023-10-16T19:41:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:41.978+0000 7f81f781a640 1 -- 172.21.15.57:0/410897310 wait complete. 2023-10-16T19:41:42.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-16T19:41:42.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.236+0000 7f998b6d0640 1 Processor -- start 2023-10-16T19:41:42.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.236+0000 7f998b6d0640 1 -- start start 2023-10-16T19:41:42.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.238+0000 7f998b6d0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f998414ff50 0x7f99840711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.238+0000 7f998b6d0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9984071930 0x7f99840c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.238+0000 7f998b6d0640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9984150330 con 0x7f9984071d80 2023-10-16T19:41:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.238+0000 7f998b6d0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840c2b80 con 0x7f9984071930 2023-10-16T19:41:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.238+0000 7f998b6d0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840c66d0 con 0x7f998414ff50 2023-10-16T19:41:42.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.239+0000 7f9988c6b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9984071930 0x7f99840c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.240+0000 7f998946c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f998414ff50 0x7f99840711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.240+0000 7f9989c6d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9984071d80 0x7f9984155f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57234/0 (socket says 172.21.15.57:57234) 2023-10-16T19:41:42.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.240+0000 7f9989c6d640 1 -- 172.21.15.57:0/588497149 learned_addr learned my addr 172.21.15.57:0/588497149 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:42.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.245+0000 7f9988c6b640 1 -- 172.21.15.57:0/588497149 >> v2:172.21.15.110:3300/0 conn(0x7f998414ff50 msgr2=0x7f99840711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.245+0000 7f9988c6b640 1 --2- 172.21.15.57:0/588497149 >> v2:172.21.15.110:3300/0 conn(0x7f998414ff50 0x7f99840711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.245+0000 7f9988c6b640 1 -- 172.21.15.57:0/588497149 >> v1:172.21.15.57:6789/0 conn(0x7f9984071d80 legacy=0x7f9984155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.245+0000 7f9988c6b640 1 -- 172.21.15.57:0/588497149 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998415a110 con 0x7f9984071930 2023-10-16T19:41:42.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.248+0000 7f9988c6b640 1 --2- 172.21.15.57:0/588497149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f99840c1880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f998406ab50 tx=0x7f997402db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8717df71443fbfc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.257+0000 7f997bfff640 1 -- 172.21.15.57:0/588497149 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997402e920 con 0x7f9984071930 2023-10-16T19:41:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.257+0000 7f997bfff640 1 -- 172.21.15.57:0/588497149 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997402ea80 con 0x7f9984071930 2023-10-16T19:41:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.257+0000 7f997bfff640 1 -- 172.21.15.57:0/588497149 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997402ee10 con 0x7f9984071930 2023-10-16T19:41:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 -- 172.21.15.57:0/588497149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 msgr2=0x7f99840c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 --2- 172.21.15.57:0/588497149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f99840c1880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f998406ab50 tx=0x7f997402db70 comp rx=0 tx=0).stop 2023-10-16T19:41:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 -- 172.21.15.57:0/588497149 shutdown_connections 2023-10-16T19:41:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 --2- 172.21.15.57:0/588497149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f99840c1880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 --2- 172.21.15.57:0/588497149 >> v2:172.21.15.110:3300/0 conn(0x7f998414ff50 0x7f99840711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 -- 172.21.15.57:0/588497149 >> 172.21.15.57:0/588497149 conn(0x7f998406c430 msgr2=0x7f9984069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 -- 172.21.15.57:0/588497149 shutdown_connections 2023-10-16T19:41:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.258+0000 7f998b6d0640 1 -- 172.21.15.57:0/588497149 wait complete. 2023-10-16T19:41:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.261+0000 7f998b6d0640 1 Processor -- start 2023-10-16T19:41:42.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.261+0000 7f998b6d0640 1 -- start start 2023-10-16T19:41:42.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998b6d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f9984157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998b6d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f998414ff50 0x7f99841577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998b6d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99841439a0 0x7f9984140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998b6d0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984157000 con 0x7f9984071930 2023-10-16T19:41:42.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998b6d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840bb350 con 0x7f998414ff50 2023-10-16T19:41:42.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998b6d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9984158bc0 con 0x7f99841439a0 2023-10-16T19:41:42.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.263+0000 7f998946c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f9984157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.264+0000 7f998946c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f9984157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34320/0 (socket says 172.21.15.57:34320) 2023-10-16T19:41:42.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.264+0000 7f998946c640 1 -- 172.21.15.57:0/221141136 learned_addr learned my addr 172.21.15.57:0/221141136 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:42.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.265+0000 7f9989c6d640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99841439a0 0x7f9984140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.265+0000 7f9988c6b640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f998414ff50 0x7f99841577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.268+0000 7f998946c640 1 -- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99841439a0 msgr2=0x7f9984140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.268+0000 7f998946c640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99841439a0 0x7f9984140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.268+0000 7f998946c640 1 -- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f998414ff50 msgr2=0x7f99841577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.268+0000 7f998946c640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f998414ff50 0x7f99841577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.268+0000 7f998946c640 1 -- 172.21.15.57:0/221141136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009400 con 0x7f9984071930 2023-10-16T19:41:42.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.271+0000 7f998946c640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f9984157280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f998000e9b0 tx=0x7f998000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.276+0000 7f9979ffb640 1 -- 172.21.15.57:0/221141136 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980009670 con 0x7f9984071930 2023-10-16T19:41:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.276+0000 7f9979ffb640 1 -- 172.21.15.57:0/221141136 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998000c9a0 con 0x7f9984071930 2023-10-16T19:41:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.276+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9984158ea0 con 0x7f9984071930 2023-10-16T19:41:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.276+0000 7f9979ffb640 1 -- 172.21.15.57:0/221141136 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000cd50 con 0x7f9984071930 2023-10-16T19:41:42.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.276+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99840bb880 con 0x7f9984071930 2023-10-16T19:41:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.281+0000 7f998e25a740 1 Processor -- start 2023-10-16T19:41:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.281+0000 7f998e25a740 1 -- start start 2023-10-16T19:41:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.282+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.282+0000 7f998e25a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.282+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e13e0 0x5645547221e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.282+0000 7f998e25a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645545fd7a0 con 0x56455472c800 2023-10-16T19:41:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.282+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56455464f740 con 0x5645546e2980 2023-10-16T19:41:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.282+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x56455464ce30 con 0x5645546e13e0 2023-10-16T19:41:42.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.289+0000 7f9989c6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.289+0000 7f9988c6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e13e0 0x5645547221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.290+0000 7f9989c6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546e2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54836/0 (socket says 172.21.15.57:54836) 2023-10-16T19:41:42.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.290+0000 7f9989c6d640 1 -- 172.21.15.57:0/4141689677 learned_addr learned my addr 172.21.15.57:0/4141689677 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:42.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.297+0000 7f9988c6b640 1 -- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 msgr2=0x5645546e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.297+0000 7f9988c6b640 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.297+0000 7f9988c6b640 1 -- 172.21.15.57:0/4141689677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 msgr2=0x5645546e32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.297+0000 7f9988c6b640 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.297+0000 7f9988c6b640 1 -- 172.21.15.57:0/4141689677 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56455460c910 con 0x5645546e13e0 2023-10-16T19:41:42.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.302+0000 7f9979ffb640 1 -- 172.21.15.57:0/221141136 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9980013470 con 0x7f9984071930 2023-10-16T19:41:42.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.302+0000 7f9988c6b640 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e13e0 0x5645547221e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9974035000 tx=0x7f9974030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572bd5dba11c83f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.303+0000 7f9979ffb640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f996806aec0 0x7f996806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.304+0000 7f9989c6d640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f996806aec0 0x7f996806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.304+0000 7f9989c6d640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f996806aec0 0x7f996806d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f997c0016a0 tx=0x7f997c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.306+0000 7f9979ffb640 1 -- 172.21.15.57:0/221141136 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9980058970 con 0x7f9984071930 2023-10-16T19:41:42.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.311+0000 7f996effd640 1 -- 172.21.15.57:0/4141689677 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974036440 con 0x5645546e13e0 2023-10-16T19:41:42.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.311+0000 7f996effd640 1 -- 172.21.15.57:0/4141689677 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99740365a0 con 0x5645546e13e0 2023-10-16T19:41:42.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.311+0000 7f996effd640 1 -- 172.21.15.57:0/4141689677 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974036910 con 0x5645546e13e0 2023-10-16T19:41:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 -- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e13e0 msgr2=0x5645547221e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e13e0 0x5645547221e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9974035000 tx=0x7f9974030000 comp rx=0 tx=0).stop 2023-10-16T19:41:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 -- 172.21.15.57:0/4141689677 shutdown_connections 2023-10-16T19:41:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e13e0 0x5645547221e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 --2- 172.21.15.57:0/4141689677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.312+0000 7f998e25a740 1 -- 172.21.15.57:0/4141689677 >> 172.21.15.57:0/4141689677 conn(0x5645546df0f0 msgr2=0x5645546e1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.313+0000 7f998e25a740 1 -- 172.21.15.57:0/4141689677 shutdown_connections 2023-10-16T19:41:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.313+0000 7f998e25a740 1 -- 172.21.15.57:0/4141689677 wait complete. 2023-10-16T19:41:42.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.313+0000 7f998e25a740 1 -- start start 2023-10-16T19:41:42.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.314+0000 7f998e25a740 1 Processor -- start 2023-10-16T19:41:42.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x56455472d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x5645546fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564554648720 con 0x56455472c800 2023-10-16T19:41:42.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645545e6970 con 0x5645546e2980 2023-10-16T19:41:42.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645545e6610 con 0x5645547018c0 2023-10-16T19:41:42.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f998e25a740 10 client.0 _ll_register_callbacks cb 0x5645546089d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:42.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.315+0000 7f9988c6b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.316+0000 7f9988c6b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546fe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34332/0 (socket says 172.21.15.57:34332) 2023-10-16T19:41:42.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.316+0000 7f9988c6b640 1 -- 172.21.15.57:0/1667704715 learned_addr learned my addr 172.21.15.57:0/1667704715 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:42.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.316+0000 7f998946c640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x56455472d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.318+0000 7f9989c6d640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x5645546fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.319+0000 7f9988c6b640 1 -- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 msgr2=0x5645546fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.319+0000 7f9988c6b640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x5645546fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.319+0000 7f9988c6b640 1 -- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 msgr2=0x56455472d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.319+0000 7f9988c6b640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x56455472d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.319+0000 7f9988c6b640 1 -- 172.21.15.57:0/1667704715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997400e040 con 0x56455472c800 2023-10-16T19:41:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.322+0000 7f9988c6b640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546fe2e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9974009860 tx=0x7f9974004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea4f5dd85817653 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.322+0000 7f9963fff640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.326+0000 7f9963fff640 1 -- 172.21.15.57:0/1667704715 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974036910 con 0x56455472c800 2023-10-16T19:41:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.326+0000 7f9963fff640 1 -- 172.21.15.57:0/1667704715 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9974036a70 con 0x56455472c800 2023-10-16T19:41:42.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.326+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56455466f160 con 0x56455472c800 2023-10-16T19:41:42.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.329+0000 7f9963fff640 1 -- 172.21.15.57:0/1667704715 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9974036c30 con 0x56455472c800 2023-10-16T19:41:42.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.329+0000 7f998e25a740 10 client.4551 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:42.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.329+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564554646da0 con 0x56455472c800 2023-10-16T19:41:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.336+0000 7f9963fff640 1 -- 172.21.15.57:0/1667704715 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56455466f160 con 0x56455472c800 2023-10-16T19:41:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.336+0000 7f9963fff640 1 -- 172.21.15.57:0/1667704715 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f9974003610 con 0x56455472c800 2023-10-16T19:41:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.337+0000 7f998e25a740 10 client.4551 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.337+0000 7f998e25a740 10 client.4551 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-16T19:41:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.337+0000 7f998e25a740 20 client.4551 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.337+0000 7f998e25a740 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x56455472d610 0x564554736d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.337+0000 7f998e25a740 4 client.4551 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:41:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.337+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 --> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56455461acc0 con 0x56455472d610 2023-10-16T19:41:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.338+0000 7f998946c640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x56455472d610 0x564554736d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.389+0000 7f9963fff640 10 client.4551 ms_handle_connect on v2:172.21.15.57:6834/1742562725 2023-10-16T19:41:42.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.388+0000 7f998946c640 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x56455472d610 0x564554736d50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c6a10f7bd624fa server_cookie=992376f0ea201d4a in_seq=0 out_seq=0 2023-10-16T19:41:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.621+0000 7f9963fff640 1 -- 172.21.15.57:0/1667704715 <== mds.0 v2:172.21.15.57:6834/1742562725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56455461acc0 con 0x56455472d610 2023-10-16T19:41:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.621+0000 7f9963fff640 10 client.4551 handle_command_reply: tid=0 2023-10-16T19:41:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.621+0000 7f998e25a740 1 client.4551 shutdown 2023-10-16T19:41:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 msgr2=0x5645546fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546fe2e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9974009860 tx=0x7f9974004730 comp rx=0 tx=0).stop 2023-10-16T19:41:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 shutdown_connections 2023-10-16T19:41:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x56455472d610 0x564554736d50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x5645546fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546fe2e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f9963fff640 0 client.4551 ms_handle_reset on v2:172.21.15.57:6834/1742562725 2023-10-16T19:41:42.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 --2- 172.21.15.57:0/1667704715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x56455472d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.622+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 >> 172.21.15.57:0/1667704715 conn(0x5645546e13e0 msgr2=0x564554723990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:42.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.623+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 shutdown_connections 2023-10-16T19:41:42.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.623+0000 7f998e25a740 1 -- 172.21.15.57:0/1667704715 wait complete. 2023-10-16T19:41:42.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.624+0000 7f998e25a740 20 client.4551 trim_cache size 0 max 16384 2023-10-16T19:41:42.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.671+0000 7f998e25a740 1 Processor -- start 2023-10-16T19:41:42.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.671+0000 7f998e25a740 1 -- start start 2023-10-16T19:41:42.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.673+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e2980 0x5645546e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.673+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645547018c0 0x5645546e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.674+0000 7f998e25a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.674+0000 7f998e25a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645543acf20 con 0x56455472c800 2023-10-16T19:41:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.674+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56455473d320 con 0x5645547018c0 2023-10-16T19:41:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.674+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564554725990 con 0x5645546e2980 2023-10-16T19:41:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.675+0000 7f9989c6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.675+0000 7f9989c6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546ddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34336/0 (socket says 172.21.15.57:34336) 2023-10-16T19:41:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.675+0000 7f9989c6d640 1 -- 172.21.15.57:0/2035165622 learned_addr learned my addr 172.21.15.57:0/2035165622 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.676+0000 7f998946c640 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e2980 0x5645546e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.676+0000 7f9988c6b640 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645547018c0 0x5645546e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.679+0000 7f9989c6d640 1 -- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e2980 msgr2=0x5645546e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.679+0000 7f9989c6d640 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e2980 0x5645546e18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.679+0000 7f9989c6d640 1 -- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645547018c0 msgr2=0x5645546e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.679+0000 7f9989c6d640 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645547018c0 0x5645546e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.679+0000 7f9989c6d640 1 -- 172.21.15.57:0/2035165622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645545e5b80 con 0x56455472c800 2023-10-16T19:41:42.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.682+0000 7f9989c6d640 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546ddde0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f997c002230 tx=0x7f997c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aba2c06be5a1528 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.689+0000 7f996f7fe640 1 -- 172.21.15.57:0/2035165622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c014d90 con 0x56455472c800 2023-10-16T19:41:42.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.689+0000 7f996f7fe640 1 -- 172.21.15.57:0/2035165622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c015440 con 0x56455472c800 2023-10-16T19:41:42.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.689+0000 7f996f7fe640 1 -- 172.21.15.57:0/2035165622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0157d0 con 0x56455472c800 2023-10-16T19:41:42.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 -- 172.21.15.57:0/2035165622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 msgr2=0x5645546ddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546ddde0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f997c002230 tx=0x7f997c015000 comp rx=0 tx=0).stop 2023-10-16T19:41:42.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 -- 172.21.15.57:0/2035165622 shutdown_connections 2023-10-16T19:41:42.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645546ddde0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645547018c0 0x5645546e1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 --2- 172.21.15.57:0/2035165622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645546e2980 0x5645546e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 -- 172.21.15.57:0/2035165622 >> 172.21.15.57:0/2035165622 conn(0x5645546e13e0 msgr2=0x564554736350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:42.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.691+0000 7f998e25a740 1 -- 172.21.15.57:0/2035165622 shutdown_connections 2023-10-16T19:41:42.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.692+0000 7f998e25a740 1 -- 172.21.15.57:0/2035165622 wait complete. 2023-10-16T19:41:42.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.693+0000 7f998e25a740 1 -- start start 2023-10-16T19:41:42.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.694+0000 7f998e25a740 1 Processor -- start 2023-10-16T19:41:42.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x564554704500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645547823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645546ff150 con 0x56455472c800 2023-10-16T19:41:42.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564554700270 con 0x5645546e2980 2023-10-16T19:41:42.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645547003e0 con 0x5645547018c0 2023-10-16T19:41:42.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.697+0000 7f998e25a740 10 client.0 _ll_register_callbacks cb 0x7f997c001d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:42.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.699+0000 7f998946c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.699+0000 7f9988c6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x564554704500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.700+0000 7f998946c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:54864/0 (socket says 172.21.15.57:54864) 2023-10-16T19:41:42.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.700+0000 7f998946c640 1 -- 172.21.15.57:0/520395310 learned_addr learned my addr 172.21.15.57:0/520395310 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:42.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.700+0000 7f9988c6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x564554704500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:36646/0 (socket says 172.21.15.57:36646) 2023-10-16T19:41:42.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.702+0000 7f9989c6d640 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645547823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.706+0000 7f9989c6d640 1 -- 172.21.15.57:0/520395310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 msgr2=0x564554704500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.706+0000 7f9989c6d640 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x564554704500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.706+0000 7f9989c6d640 1 -- 172.21.15.57:0/520395310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 msgr2=0x5645546ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:42.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.706+0000 7f9989c6d640 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.706+0000 7f9989c6d640 1 -- 172.21.15.57:0/520395310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9984150330 con 0x56455472c800 2023-10-16T19:41:42.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.709+0000 7f9989c6d640 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645547823b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f997c025000 tx=0x7f997c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980aca8878c4cc75 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:42.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.709+0000 7f9963fff640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-16T19:41:42.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.713+0000 7f9963fff640 1 -- 172.21.15.57:0/520395310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c032070 con 0x56455472c800 2023-10-16T19:41:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.713+0000 7f9963fff640 1 -- 172.21.15.57:0/520395310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f997c015e10 con 0x56455472c800 2023-10-16T19:41:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.713+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99740365a0 con 0x56455472c800 2023-10-16T19:41:42.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.716+0000 7f9963fff640 1 -- 172.21.15.57:0/520395310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f997c02b450 con 0x56455472c800 2023-10-16T19:41:42.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.716+0000 7f998e25a740 10 client.4557 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:42.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.716+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56455460b170 con 0x56455472c800 2023-10-16T19:41:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f9963fff640 1 -- 172.21.15.57:0/520395310 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99740365a0 con 0x56455472c800 2023-10-16T19:41:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f9963fff640 1 -- 172.21.15.57:0/520395310 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 4492+0+0 (secure 0 0 0) 0x7f997c02b5b0 con 0x56455472c800 2023-10-16T19:41:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f998e25a740 10 client.4557 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f998e25a740 10 client.4557 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-16T19:41:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f998e25a740 20 client.4557 populate_metadata read hostname 'smithi057' 2023-10-16T19:41:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f998e25a740 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x564554721f10 0x5645547222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f998e25a740 4 client.4557 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:41:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.722+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 --> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564554641700 con 0x564554721f10 2023-10-16T19:41:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.724+0000 7f998946c640 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x564554721f10 0x5645547222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:42.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.728+0000 7f998946c640 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x564554721f10 0x5645547222f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48e3f8dfba7d609 server_cookie=666e01f7e6d02b00 in_seq=0 out_seq=0 2023-10-16T19:41:42.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.728+0000 7f9963fff640 10 client.4557 ms_handle_connect on v2:172.21.15.57:6834/1742562725 2023-10-16T19:41:42.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.753+0000 7f9963fff640 1 -- 172.21.15.57:0/520395310 <== mds.0 v2:172.21.15.57:6834/1742562725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564554641700 con 0x564554721f10 2023-10-16T19:41:42.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.753+0000 7f9963fff640 10 client.4557 handle_command_reply: tid=0 2023-10-16T19:41:42.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.753+0000 7f998e25a740 1 client.4557 shutdown 2023-10-16T19:41:42.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.753+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 msgr2=0x5645547823b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.753+0000 7f998e25a740 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645547823b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f997c025000 tx=0x7f997c001250 comp rx=0 tx=0).stop 2023-10-16T19:41:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 shutdown_connections 2023-10-16T19:41:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:6834/1742562725,v1:172.21.15.57:6835/1742562725] conn(0x564554721f10 0x5645547222f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56455472c800 0x5645547823b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5645547018c0 0x564554704500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f9963fff640 0 client.4557 ms_handle_reset on v2:172.21.15.57:6834/1742562725 2023-10-16T19:41:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 --2- 172.21.15.57:0/520395310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5645546e2980 0x5645546ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 >> 172.21.15.57:0/520395310 conn(0x5645546e13e0 msgr2=0x5645546e18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 shutdown_connections 2023-10-16T19:41:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.754+0000 7f998e25a740 1 -- 172.21.15.57:0/520395310 wait complete. 2023-10-16T19:41:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.755+0000 7f998e25a740 20 client.4557 trim_cache size 0 max 16384 2023-10-16T19:41:42.759 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T19:41:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "ee1d7270-3118-4d78-b8fc-a1736155df58", 2023-10-16T19:41:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-16T19:41:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4250, 2023-10-16T19:41:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-16T19:41:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-16T19:41:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-16T19:41:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 41.992237637999999, 2023-10-16T19:41:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2023-10-16T19:41:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 25, 2023-10-16T19:41:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-10-16T19:41:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 55.130080644000003 2023-10-16T19:41:42.761 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T19:41:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.756+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f996806aec0 msgr2=0x7f996806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.756+0000 7f998b6d0640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f996806aec0 0x7f996806d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f997c0016a0 tx=0x7f997c009040 comp rx=0 tx=0).stop 2023-10-16T19:41:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.756+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 msgr2=0x7f9984157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.756+0000 7f998b6d0640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f9984157280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f998000e9b0 tx=0x7f998000ee70 comp rx=0 tx=0).stop 2023-10-16T19:41:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 shutdown_connections 2023-10-16T19:41:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f996806aec0 0x7f996806d380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99841439a0 0x7f9984140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f998414ff50 0x7f99841577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 --2- 172.21.15.57:0/221141136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9984071930 0x7f9984157280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 >> 172.21.15.57:0/221141136 conn(0x7f998406c430 msgr2=0x7f9984154c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 shutdown_connections 2023-10-16T19:41:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:42.757+0000 7f998b6d0640 1 -- 172.21.15.57:0/221141136 wait complete. 2023-10-16T19:41:42.803 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-16T19:41:42.828 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-16T19:41:42.829 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-16T19:41:42.829 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-10-16T19:41:42.829 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:41:42.830 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:42.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:42.830 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-16T19:41:42.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:42.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-10-16T19:41:42.993 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-10-16T19:41:42.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:41:42.998 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-16T19:41:42.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:41:43.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.209+0000 7f6b9759e640 1 Processor -- start 2023-10-16T19:41:43.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.209+0000 7f6b9759e640 1 -- start start 2023-10-16T19:41:43.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.212+0000 7f6b9759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b98150c60 0x7f6b980cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:43.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.212+0000 7f6b9759e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b98072100 0x7f6b98069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:43.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.212+0000 7f6b9759e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b980c5d90 con 0x7f6b9806a320 2023-10-16T19:41:43.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.212+0000 7f6b9759e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b980c6070 con 0x7f6b98072100 2023-10-16T19:41:43.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.212+0000 7f6b9759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b980c6350 con 0x7f6b98150c60 2023-10-16T19:41:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.214+0000 7f6b96d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6b9806a320 0x7f6b98156f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:53716/0 (socket says 172.21.15.57:53716) 2023-10-16T19:41:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.214+0000 7f6b96d9d640 1 -- 172.21.15.57:0/131369658 learned_addr learned my addr 172.21.15.57:0/131369658 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T19:41:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.215+0000 7f6b8ffff640 1 --2- 172.21.15.57:0/131369658 >> v2:172.21.15.57:3300/0 conn(0x7f6b98072100 0x7f6b98069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.215+0000 7f6b9659c640 1 --2- 172.21.15.57:0/131369658 >> v2:172.21.15.110:3300/0 conn(0x7f6b98150c60 0x7f6b980cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:43.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.218+0000 7f6b8ffff640 1 -- 172.21.15.57:0/131369658 >> v2:172.21.15.110:3300/0 conn(0x7f6b98150c60 msgr2=0x7f6b980cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:43.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.218+0000 7f6b8ffff640 1 --2- 172.21.15.57:0/131369658 >> v2:172.21.15.110:3300/0 conn(0x7f6b98150c60 0x7f6b980cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.218+0000 7f6b8ffff640 1 -- 172.21.15.57:0/131369658 >> v1:172.21.15.110:6789/0 conn(0x7f6b9806a320 legacy=0x7f6b98156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:43.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.218+0000 7f6b8ffff640 1 -- 172.21.15.57:0/131369658 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b980c6630 con 0x7f6b98072100 2023-10-16T19:41:43.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.221+0000 7f6b8ffff640 1 --2- 172.21.15.57:0/131369658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98072100 0x7f6b98069de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b9806e500 tx=0x7f6b8002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e24791b2085de16 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:43.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.225+0000 7f6b95d9b640 1 -- 172.21.15.57:0/131369658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80030610 con 0x7f6b98072100 2023-10-16T19:41:43.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.225+0000 7f6b95d9b640 1 -- 172.21.15.57:0/131369658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80030770 con 0x7f6b98072100 2023-10-16T19:41:43.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.225+0000 7f6b95d9b640 1 -- 172.21.15.57:0/131369658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80030b00 con 0x7f6b98072100 2023-10-16T19:41:43.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.226+0000 7f6b9759e640 1 -- 172.21.15.57:0/131369658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98072100 msgr2=0x7f6b98069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:43.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.226+0000 7f6b9759e640 1 --2- 172.21.15.57:0/131369658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98072100 0x7f6b98069de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b9806e500 tx=0x7f6b8002b960 comp rx=0 tx=0).stop 2023-10-16T19:41:43.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.226+0000 7f6b9759e640 1 -- 172.21.15.57:0/131369658 shutdown_connections 2023-10-16T19:41:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.226+0000 7f6b9759e640 1 --2- 172.21.15.57:0/131369658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98072100 0x7f6b98069de0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.226+0000 7f6b9759e640 1 --2- 172.21.15.57:0/131369658 >> v2:172.21.15.110:3300/0 conn(0x7f6b98150c60 0x7f6b980cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.226+0000 7f6b9759e640 1 -- 172.21.15.57:0/131369658 >> 172.21.15.57:0/131369658 conn(0x7f6b9806db70 msgr2=0x7f6b980ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.227+0000 7f6b9759e640 1 -- 172.21.15.57:0/131369658 shutdown_connections 2023-10-16T19:41:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.227+0000 7f6b9759e640 1 -- 172.21.15.57:0/131369658 wait complete. 2023-10-16T19:41:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.230+0000 7f6b9759e640 1 Processor -- start 2023-10-16T19:41:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.230+0000 7f6b9759e640 1 -- start start 2023-10-16T19:41:43.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.231+0000 7f6b9759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b9806a320 0x7f6b980c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:43.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.231+0000 7f6b9759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b98072100 0x7f6b980c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:43.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.231+0000 7f6b9759e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 0x7f6b981ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:43.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.231+0000 7f6b9759e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981ef240 con 0x7f6b98150c60 2023-10-16T19:41:43.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.231+0000 7f6b9759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981582c0 con 0x7f6b9806a320 2023-10-16T19:41:43.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.231+0000 7f6b9759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981585a0 con 0x7f6b98072100 2023-10-16T19:41:43.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.232+0000 7f6b96d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 0x7f6b981ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:43.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.232+0000 7f6b96d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 0x7f6b981ef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34368/0 (socket says 172.21.15.57:34368) 2023-10-16T19:41:43.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.232+0000 7f6b96d9d640 1 -- 172.21.15.57:0/2536751176 learned_addr learned my addr 172.21.15.57:0/2536751176 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T19:41:43.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.233+0000 7f6b8ffff640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b98072100 0x7f6b980c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.237+0000 7f6b96d9d640 1 -- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b98072100 msgr2=0x7f6b980c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.237+0000 7f6b96d9d640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b98072100 0x7f6b980c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.237+0000 7f6b96d9d640 1 -- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b9806a320 msgr2=0x7f6b980c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.237+0000 7f6b96d9d640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b9806a320 0x7f6b980c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.237+0000 7f6b96d9d640 1 -- 172.21.15.57:0/2536751176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80009400 con 0x7f6b98150c60 2023-10-16T19:41:43.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.241+0000 7f6b96d9d640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 0x7f6b981ef6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000cbc0 tx=0x7f6b9000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.246+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000ad40 con 0x7f6b98150c60 2023-10-16T19:41:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.246+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90012400 con 0x7f6b98150c60 2023-10-16T19:41:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.246+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000aea0 con 0x7f6b98150c60 2023-10-16T19:41:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.246+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b98158880 con 0x7f6b98150c60 2023-10-16T19:41:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.246+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b980c3a40 con 0x7f6b98150c60 2023-10-16T19:41:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.247+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b980c4860 con 0x7f6b98150c60 2023-10-16T19:41:43.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.275+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b90007070 con 0x7f6b98150c60 2023-10-16T19:41:43.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.277+0000 7f6b8effd640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b7806aef0 0x7f6b7806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:43.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.277+0000 7f6b9659c640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b7806aef0 0x7f6b7806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:43.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.279+0000 7f6b9659c640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b7806aef0 0x7f6b7806d3b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b88006fd0 tx=0x7f6b88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:43.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.282+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6b900587f0 con 0x7f6b98150c60 2023-10-16T19:41:43.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.593+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b90054b30 con 0x7f6b98150c60 2023-10-16T19:41:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.853+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6b9804e160 con 0x7f6b98150c60 2023-10-16T19:41:43.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.865+0000 7f6b8effd640 1 -- 172.21.15.57:0/2536751176 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6b90017070 con 0x7f6b98150c60 2023-10-16T19:41:43.867 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T19:41:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.868+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b7806aef0 msgr2=0x7f6b7806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.868+0000 7f6b9759e640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b7806aef0 0x7f6b7806d3b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b88006fd0 tx=0x7f6b88008040 comp rx=0 tx=0).stop 2023-10-16T19:41:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.868+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 msgr2=0x7f6b981ef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.868+0000 7f6b9759e640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 0x7f6b981ef6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000cbc0 tx=0x7f6b9000a430 comp rx=0 tx=0).stop 2023-10-16T19:41:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 shutdown_connections 2023-10-16T19:41:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6b7806aef0 0x7f6b7806d3b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b98150c60 0x7f6b981ef6d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b98072100 0x7f6b980c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 --2- 172.21.15.57:0/2536751176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b9806a320 0x7f6b980c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 >> 172.21.15.57:0/2536751176 conn(0x7f6b9806db70 msgr2=0x7f6b98157130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:43.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 shutdown_connections 2023-10-16T19:41:43.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:43.869+0000 7f6b9759e640 1 -- 172.21.15.57:0/2536751176 wait complete. 2023-10-16T19:41:43.890 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:41:43.890 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:41:43.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-10-16T19:41:43.891 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T19:41:43.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:43.891 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:41:43.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:41:43.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:41:43.892 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:41:43.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:43.893 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-10-16T19:41:43.945 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:41:43.946 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:41:43.946 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:41:43.946 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:43.946 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-16T19:41:43.947 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:41:43.947 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:43.947 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-10-16T19:41:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:41:43.948 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:43.948 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-10-16T19:41:43.948 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:41:43.948 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:43.948 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-10-16T19:41:43.949 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T19:41:43.949 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 41841sec preferred_lft 41841sec 2023-10-16T19:41:43.949 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2023-10-16T19:41:43.949 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:43.949 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:41:43.950 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:43.950 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-10-16T19:41:43.951 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T19:41:43.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:43.952 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-16T19:41:43.952 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-16T19:41:43.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2023-10-16T19:41:43.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2023-10-16T19:41:43.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2023-10-16T19:41:43.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T19:41:43.953 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-16T19:41:44.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:44.055 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:44.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:44.408 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:41:44.490 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-10-16T19:41:44.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:44.495 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-10-16T19:41:44.564 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-10-16T19:41:44.564 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:41:44.565 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T19:41:44.565 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T19:41:44.565 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:41:44.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:44.566 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-16T19:41:44.566 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-16T19:41:44.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T19:41:44.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T19:41:44.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T19:41:44.568 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-16T19:41:45.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:45.302 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-16T19:41:45.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:45.354 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-10-16T19:41:45.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:45.403 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-16T19:41:45.403 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-16T19:41:45.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:45.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T19:41:45.404 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-16T19:41:45.568 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T19:41:45.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:45.568 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-16T19:41:45.569 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-16T19:41:45.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T19:41:45.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T19:41:45.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T19:41:45.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T19:41:45.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T19:41:45.571 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-16T19:41:45.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:45.864 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-16T19:41:45.864 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-16T19:41:45.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-10-16T19:41:45.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T19:41:45.865 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-16T19:41:46.029 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-10-16T19:41:46.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:41:46.029 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:46.069 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:41:46.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:41:46.070 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:46.155 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-16T19:41:46.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:46.284 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:46.330 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:46.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:46.331 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:46.331 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:46.331 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:46.332 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:46.332 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:46.332 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:46.332 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:46.332 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:46.333 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:46.333 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:46.333 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:46.333 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:46.333 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:46.333 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:46.334 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:46.334 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:46.334 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:46.334 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:46.334 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:46.335 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:46.335 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:46.335 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:46.335 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:46.335 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:46.335 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:46.336 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:46.336 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:46.336 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:46.336 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:46.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:46.337 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:46.434 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T19:41:46.435 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-16T19:41:46.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:46.517 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:46.562 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:46.563 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:46.564 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:46.565 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:46.566 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:46.567 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:46.568 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:46.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:46.569 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:47.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:47.870 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:47.925 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:47.926 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:47.926 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:47.926 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:47.926 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:47.927 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:47.927 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:47.927 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:47.927 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:47.927 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:47.928 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:47.928 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:47.928 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:47.928 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:47.928 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:47.929 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:47.930 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:47.930 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:47.930 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:47.930 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:47.930 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:47.931 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:47.931 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:47.931 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:47.931 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:47.931 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:47.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:47.933 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:49.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:49.190 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:49.243 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:49.243 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:49.244 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:49.244 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:49.244 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:49.244 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:49.245 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:49.245 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:49.245 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:49.245 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:49.245 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:49.246 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:49.246 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:49.246 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:49.246 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:49.247 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:49.247 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:49.247 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:49.247 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:49.248 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:49.248 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:49.248 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:49.248 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:49.249 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:49.249 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:49.249 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:49.249 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:49.249 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:49.250 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:49.250 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:49.250 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:49.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:49.252 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:50.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:50.503 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:50.558 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:50.558 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:50.559 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:50.559 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:50.559 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:50.559 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:50.559 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:50.560 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:50.560 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:50.560 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:50.560 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:50.560 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:50.561 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:50.561 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:50.561 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:50.561 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:50.561 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:50.561 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:50.562 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:50.562 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:50.562 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:50.562 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:50.562 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:50.563 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:50.563 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:50.563 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:50.563 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:50.564 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:50.564 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:50.564 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:50.564 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:50.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:50.565 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:51.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:51.797 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:51.840 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:51.840 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:51.840 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:51.840 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:51.841 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:51.841 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:51.841 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:51.841 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:51.841 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:51.842 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:51.842 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:51.842 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:51.842 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:51.842 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:51.843 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:51.843 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:51.843 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:51.843 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:51.843 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:51.844 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:51.844 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:51.844 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:51.844 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:51.844 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:51.844 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:51.845 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:51.845 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:51.845 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:51.845 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:51.845 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:51.846 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:51.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:51.847 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:53.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:53.128 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:53.173 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:53.174 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:53.174 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:53.174 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:53.174 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:53.175 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:53.175 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:53.175 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:53.175 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:53.175 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:53.175 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:53.176 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:53.176 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:53.176 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:53.176 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:53.178 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:53.178 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:53.178 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:53.178 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:53.179 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:53.179 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:53.179 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:53.179 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:53.179 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:53.179 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:53.180 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:53.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:53.181 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:53.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[94693]: starting ceph client 2023-10-16T19:41:53.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2023-10-16T19:41:53.357+0000 64d3100 -1 init, newargv = 0x89c2270 newargc=15 2023-10-16T19:41:54.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:54.473 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:54.521 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:54.522 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:54.522 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:54.522 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:54.522 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:54.522 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:54.523 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:54.523 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:54.523 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:54.523 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:54.523 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:54.524 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:54.524 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:54.524 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:54.524 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:54.524 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:54.524 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:54.525 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:54.525 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:54.525 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:54.525 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:54.525 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:54.525 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:54.526 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:54.526 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:54.526 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:54.526 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:54.526 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:54.527 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:54.527 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:54.527 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:54.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:54.528 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:55.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[94693]: starting fuse 2023-10-16T19:41:55.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-10-16T19:41:55.765 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:41:55.816 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2023-10-16T19:41:55.816 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2023-10-16T19:41:55.816 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2023-10-16T19:41:55.817 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2023-10-16T19:41:55.817 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2023-10-16T19:41:55.817 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2023-10-16T19:41:55.817 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2023-10-16T19:41:55.817 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2023-10-16T19:41:55.817 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2023-10-16T19:41:55.818 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2023-10-16T19:41:55.818 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2023-10-16T19:41:55.818 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:41:55.818 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2023-10-16T19:41:55.818 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2023-10-16T19:41:55.819 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2023-10-16T19:41:55.819 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2023-10-16T19:41:55.819 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2023-10-16T19:41:55.819 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2023-10-16T19:41:55.819 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T19:41:55.819 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T19:41:55.820 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T19:41:55.820 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:41:55.820 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2023-10-16T19:41:55.820 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2023-10-16T19:41:55.820 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:41:55.820 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:41:55.821 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:41:55.821 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:41:55.821 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2023-10-16T19:41:55.821 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:55.821 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:55.821 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:55.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:55.823 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-10-16T19:41:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:41 2023-10-16T19:41:55.867 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-10-16T19:41:55.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2023-10-16T19:41:55.868 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2023-10-16T19:41:55.868 DEBUG:teuthology.orchestra.run.smithi057:> import re 2023-10-16T19:41:55.869 DEBUG:teuthology.orchestra.run.smithi057:> import os 2023-10-16T19:41:55.869 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2023-10-16T19:41:55.869 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-16T19:41:55.870 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2023-10-16T19:41:55.870 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-16T19:41:55.870 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2023-10-16T19:41:55.871 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-16T19:41:55.871 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-16T19:41:55.871 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2023-10-16T19:41:55.871 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2023-10-16T19:41:55.872 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2023-10-16T19:41:55.872 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2023-10-16T19:41:55.872 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-16T19:41:55.873 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2023-10-16T19:41:55.873 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T19:41:55.873 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T19:41:55.874 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T19:41:55.874 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2023-10-16T19:41:55.874 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2023-10-16T19:41:55.874 DEBUG:teuthology.orchestra.run.smithi057:> return f 2023-10-16T19:41:55.875 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T19:41:55.875 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-16T19:41:55.875 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2023-10-16T19:41:55.876 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-16T19:41:56.101 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.94693.asok 2023-10-16T19:41:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T19:41:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T19:41:56.120 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94693.asok 2023-10-16T19:41:56.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:56.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94693.asok status 2023-10-16T19:41:56.510 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T19:41:56.511 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2023-10-16T19:41:56.511 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T19:41:56.511 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T19:41:56.511 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2023-10-16T19:41:56.512 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2023-10-16T19:41:56.512 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-16T19:41:56.512 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "94693", 2023-10-16T19:41:56.512 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2023-10-16T19:41:56.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-16T19:41:56.513 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2023-10-16T19:41:56.513 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2023-10-16T19:41:56.513 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4572, 2023-10-16T19:41:56.513 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2023-10-16T19:41:56.513 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2023-10-16T19:41:56.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2023-10-16T19:41:56.514 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4572 2023-10-16T19:41:56.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-16T19:41:56.514 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2023-10-16T19:41:56.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2023-10-16T19:41:56.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2023-10-16T19:41:56.515 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2008073174 2023-10-16T19:41:56.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-16T19:41:56.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-16T19:41:56.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2023-10-16T19:41:56.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2023-10-16T19:41:56.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2023-10-16T19:41:56.516 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2008073174 2023-10-16T19:41:56.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-16T19:41:56.516 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4572 192.168.0.1:0/2008073174", 2023-10-16T19:41:56.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.1:0/2008073174", 2023-10-16T19:41:56.517 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2023-10-16T19:41:56.517 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 17, 2023-10-16T19:41:56.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 25, 2023-10-16T19:41:56.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2023-10-16T19:41:56.517 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2023-10-16T19:41:56.518 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2023-10-16T19:41:56.518 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T19:41:56.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:56.530 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2023-10-16T19:41:56.531 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:56.669 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2023-10-16T19:41:56.669 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:56.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:56.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:57.349 INFO:teuthology.run_tasks:Running task workunit... 2023-10-16T19:41:57.365 INFO:tasks.workunit:Pulling workunits from ref 19fd96fe3581520b6d9f50ffdabf29051aee5d4d 2023-10-16T19:41:57.366 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-16T19:41:57.366 INFO:tasks.workunit:timeout=3h 2023-10-16T19:41:57.366 INFO:tasks.workunit:cleanup=True 2023-10-16T19:41:57.367 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:57.534 INFO:teuthology.orchestra.run.smithi057.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:57.535 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-10-16T19:41:57.535 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 29h/41d Inode: 1 Links: 2 2023-10-16T19:41:57.535 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:41:57.535 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:fusefs_t:s0 2023-10-16T19:41:57.535 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-16T19:41:57.536 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-16 19:41:01.087844388 +0000 2023-10-16T19:41:57.536 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-16 19:41:56.810240740 +0000 2023-10-16T19:41:57.536 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-16T19:41:57.536 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:57.536 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-16T19:41:59.071 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/rishabh-d-dave/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 19fd96fe3581520b6d9f50ffdabf29051aee5d4d 2023-10-16T19:41:59.136 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-16T19:42:14.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:14.248 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:45.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:45.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:45.201 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to '19fd96fe3581520b6d9f50ffdabf29051aee5d4d'. 2023-10-16T19:42:45.201 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.202 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-16T19:42:45.202 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-16T19:42:45.202 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2023-10-16T19:42:45.202 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.202 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-16T19:42:45.203 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-16T19:42:45.203 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.203 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2023-10-16T19:42:45.203 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.203 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2023-10-16T19:42:45.203 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.204 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2023-10-16T19:42:45.204 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.204 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-16T19:42:45.204 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-16T19:42:45.204 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at 19fd96fe358 Merge remote-tracking branch 'rishabh/unique-cephfs-name' into rishabh-2023oct13-qa2 2023-10-16T19:42:45.216 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-16T19:42:45.280 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-16T19:42:45.288 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-16T19:42:45.289 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-16T19:42:46.099 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-16T19:42:46.237 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-16T19:42:46.331 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-16T19:42:46.337 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-16T19:42:46.337 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-16T19:42:46.430 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-16T19:42:46.440 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T19:42:46.440 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-16T19:42:46.496 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-10-16T19:42:46.497 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-10-16T19:42:46.498 DEBUG:teuthology.orchestra.run.smithi057:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19fd96fe3581520b6d9f50ffdabf29051aee5d4d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-10-16T19:42:47.085 INFO:tasks.workunit.client.0.smithi057.stderr:+ dbench 1 2023-10-16T19:42:47.107 INFO:tasks.workunit.client.0.smithi057.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-10-16T19:42:47.107 INFO:tasks.workunit.client.0.smithi057.stdout: 2023-10-16T19:42:47.108 INFO:tasks.workunit.client.0.smithi057.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-10-16T19:42:47.112 INFO:tasks.workunit.client.0.smithi057.stdout:0 of 1 processes prepared for launch 0 sec 2023-10-16T19:42:47.213 INFO:tasks.workunit.client.0.smithi057.stdout:1 of 1 processes prepared for launch 0 sec 2023-10-16T19:42:47.213 INFO:tasks.workunit.client.0.smithi057.stdout:releasing clients 2023-10-16T19:42:48.213 INFO:tasks.workunit.client.0.smithi057.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 12.064 ms 2023-10-16T19:42:49.213 INFO:tasks.workunit.client.0.smithi057.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 464.238 ms 2023-10-16T19:42:50.213 INFO:tasks.workunit.client.0.smithi057.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 175.068 ms 2023-10-16T19:42:51.213 INFO:tasks.workunit.client.0.smithi057.stdout: 1 51 0.52 MB/sec warmup 4 sec latency 698.534 ms 2023-10-16T19:42:52.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 71 0.63 MB/sec warmup 5 sec latency 559.616 ms 2023-10-16T19:42:53.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 108 0.85 MB/sec warmup 6 sec latency 525.421 ms 2023-10-16T19:42:54.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 121 0.79 MB/sec warmup 7 sec latency 409.258 ms 2023-10-16T19:42:55.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 135 0.74 MB/sec warmup 8 sec latency 530.396 ms 2023-10-16T19:42:56.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 147 0.70 MB/sec warmup 9 sec latency 475.732 ms 2023-10-16T19:42:57.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 155 0.65 MB/sec warmup 10 sec latency 654.371 ms 2023-10-16T19:42:58.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 165 0.62 MB/sec warmup 11 sec latency 537.063 ms 2023-10-16T19:42:59.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 181 0.61 MB/sec warmup 12 sec latency 676.459 ms 2023-10-16T19:43:00.214 INFO:tasks.workunit.client.0.smithi057.stdout: 1 189 0.58 MB/sec warmup 13 sec latency 584.055 ms 2023-10-16T19:43:01.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 201 0.56 MB/sec warmup 14 sec latency 563.931 ms 2023-10-16T19:43:02.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 215 0.56 MB/sec warmup 15 sec latency 764.226 ms 2023-10-16T19:43:03.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 223 0.54 MB/sec warmup 16 sec latency 581.128 ms 2023-10-16T19:43:04.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 239 0.54 MB/sec warmup 17 sec latency 617.198 ms 2023-10-16T19:43:05.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 247 0.52 MB/sec warmup 18 sec latency 777.140 ms 2023-10-16T19:43:06.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 255 0.51 MB/sec warmup 19 sec latency 641.371 ms 2023-10-16T19:43:07.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 271 0.51 MB/sec warmup 20 sec latency 772.419 ms 2023-10-16T19:43:08.215 INFO:tasks.workunit.client.0.smithi057.stdout: 1 279 0.50 MB/sec warmup 21 sec latency 621.151 ms 2023-10-16T19:43:09.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 289 0.49 MB/sec warmup 22 sec latency 659.623 ms 2023-10-16T19:43:10.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 302 0.48 MB/sec warmup 23 sec latency 673.618 ms 2023-10-16T19:43:11.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 313 0.48 MB/sec warmup 24 sec latency 454.885 ms 2023-10-16T19:43:12.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 323 0.47 MB/sec warmup 25 sec latency 560.983 ms 2023-10-16T19:43:13.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 339 0.47 MB/sec warmup 26 sec latency 626.765 ms 2023-10-16T19:43:14.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 349 0.46 MB/sec warmup 27 sec latency 711.853 ms 2023-10-16T19:43:15.216 INFO:tasks.workunit.client.0.smithi057.stdout: 1 357 0.46 MB/sec warmup 28 sec latency 586.076 ms 2023-10-16T19:43:15.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:43:15.303 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:43:16.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 373 0.46 MB/sec warmup 29 sec latency 553.474 ms 2023-10-16T19:43:17.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 381 0.45 MB/sec warmup 30 sec latency 600.053 ms 2023-10-16T19:43:18.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 397 0.45 MB/sec warmup 31 sec latency 650.873 ms 2023-10-16T19:43:19.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 405 0.45 MB/sec warmup 32 sec latency 729.672 ms 2023-10-16T19:43:20.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 413 0.44 MB/sec warmup 33 sec latency 727.097 ms 2023-10-16T19:43:21.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 429 0.44 MB/sec warmup 34 sec latency 652.689 ms 2023-10-16T19:43:22.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 445 0.45 MB/sec warmup 35 sec latency 620.301 ms 2023-10-16T19:43:23.217 INFO:tasks.workunit.client.0.smithi057.stdout: 1 453 0.44 MB/sec warmup 36 sec latency 673.259 ms 2023-10-16T19:43:24.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 461 0.44 MB/sec warmup 37 sec latency 671.911 ms 2023-10-16T19:43:25.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 477 0.44 MB/sec warmup 38 sec latency 690.843 ms 2023-10-16T19:43:26.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 485 0.43 MB/sec warmup 39 sec latency 629.824 ms 2023-10-16T19:43:27.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 493 0.43 MB/sec warmup 40 sec latency 650.163 ms 2023-10-16T19:43:28.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 503 0.43 MB/sec warmup 41 sec latency 673.544 ms 2023-10-16T19:43:29.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 511 0.42 MB/sec warmup 42 sec latency 787.628 ms 2023-10-16T19:43:30.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 522 0.42 MB/sec warmup 43 sec latency 1087.773 ms 2023-10-16T19:43:31.218 INFO:tasks.workunit.client.0.smithi057.stdout: 1 542 0.43 MB/sec warmup 44 sec latency 641.778 ms 2023-10-16T19:43:32.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 603 0.47 MB/sec warmup 45 sec latency 566.013 ms 2023-10-16T19:43:33.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 606 0.46 MB/sec warmup 46 sec latency 992.770 ms 2023-10-16T19:43:34.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 607 0.45 MB/sec warmup 47 sec latency 1154.736 ms 2023-10-16T19:43:35.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 609 0.44 MB/sec warmup 48 sec latency 722.981 ms 2023-10-16T19:43:36.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 614 0.43 MB/sec warmup 49 sec latency 1170.489 ms 2023-10-16T19:43:37.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 639 0.42 MB/sec warmup 50 sec latency 1191.329 ms 2023-10-16T19:43:38.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 644 0.41 MB/sec warmup 51 sec latency 840.575 ms 2023-10-16T19:43:39.219 INFO:tasks.workunit.client.0.smithi057.stdout: 1 645 0.41 MB/sec warmup 52 sec latency 1651.933 ms 2023-10-16T19:43:40.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 648 0.40 MB/sec warmup 53 sec latency 1117.424 ms 2023-10-16T19:43:41.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 649 0.39 MB/sec warmup 54 sec latency 860.144 ms 2023-10-16T19:43:42.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 653 0.38 MB/sec warmup 55 sec latency 864.876 ms 2023-10-16T19:43:43.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 654 0.38 MB/sec warmup 56 sec latency 1135.005 ms 2023-10-16T19:43:44.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 655 0.37 MB/sec warmup 57 sec latency 696.017 ms 2023-10-16T19:43:45.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 671 0.36 MB/sec warmup 58 sec latency 430.181 ms 2023-10-16T19:43:45.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:43:45.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:43:46.220 INFO:tasks.workunit.client.0.smithi057.stdout: 1 680 0.36 MB/sec warmup 59 sec latency 682.872 ms 2023-10-16T19:43:47.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 682 0.35 MB/sec warmup 60 sec latency 996.167 ms 2023-10-16T19:43:48.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 699 0.35 MB/sec warmup 61 sec latency 1038.477 ms 2023-10-16T19:43:49.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 701 0.34 MB/sec warmup 62 sec latency 692.076 ms 2023-10-16T19:43:50.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 710 0.34 MB/sec warmup 63 sec latency 493.580 ms 2023-10-16T19:43:51.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 711 0.33 MB/sec warmup 64 sec latency 734.284 ms 2023-10-16T19:43:52.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 718 0.33 MB/sec warmup 65 sec latency 706.218 ms 2023-10-16T19:43:53.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 740 0.32 MB/sec warmup 66 sec latency 407.457 ms 2023-10-16T19:43:54.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 744 0.32 MB/sec warmup 67 sec latency 537.470 ms 2023-10-16T19:43:55.221 INFO:tasks.workunit.client.0.smithi057.stdout: 1 746 0.31 MB/sec warmup 68 sec latency 1165.129 ms 2023-10-16T19:43:56.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 747 0.31 MB/sec warmup 69 sec latency 1110.794 ms 2023-10-16T19:43:57.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 769 0.31 MB/sec warmup 70 sec latency 556.192 ms 2023-10-16T19:43:58.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 774 0.30 MB/sec warmup 71 sec latency 497.410 ms 2023-10-16T19:43:59.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 779 0.30 MB/sec warmup 72 sec latency 649.835 ms 2023-10-16T19:44:00.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 780 0.29 MB/sec warmup 73 sec latency 690.952 ms 2023-10-16T19:44:01.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 801 0.29 MB/sec warmup 74 sec latency 408.119 ms 2023-10-16T19:44:02.222 INFO:tasks.workunit.client.0.smithi057.stdout: 1 812 0.29 MB/sec warmup 75 sec latency 283.002 ms 2023-10-16T19:44:03.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 813 0.28 MB/sec warmup 76 sec latency 1219.747 ms 2023-10-16T19:44:04.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 813 0.28 MB/sec warmup 77 sec latency 1021.837 ms 2023-10-16T19:44:05.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 817 0.28 MB/sec warmup 78 sec latency 1292.959 ms 2023-10-16T19:44:06.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 818 0.27 MB/sec warmup 79 sec latency 867.528 ms 2023-10-16T19:44:07.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 823 0.27 MB/sec warmup 80 sec latency 1138.945 ms 2023-10-16T19:44:08.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 853 0.27 MB/sec warmup 81 sec latency 1129.937 ms 2023-10-16T19:44:09.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 853 0.26 MB/sec warmup 82 sec latency 1122.356 ms 2023-10-16T19:44:10.223 INFO:tasks.workunit.client.0.smithi057.stdout: 1 854 0.26 MB/sec warmup 83 sec latency 1183.087 ms 2023-10-16T19:44:11.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 859 0.26 MB/sec warmup 84 sec latency 1114.775 ms 2023-10-16T19:44:12.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 862 0.25 MB/sec warmup 85 sec latency 568.073 ms 2023-10-16T19:44:13.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 863 0.25 MB/sec warmup 86 sec latency 1125.731 ms 2023-10-16T19:44:14.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 870 0.25 MB/sec warmup 87 sec latency 854.779 ms 2023-10-16T19:44:15.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 880 0.25 MB/sec warmup 88 sec latency 447.283 ms 2023-10-16T19:44:15.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:44:15.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:44:16.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 892 0.24 MB/sec warmup 89 sec latency 1037.869 ms 2023-10-16T19:44:17.224 INFO:tasks.workunit.client.0.smithi057.stdout: 1 897 0.24 MB/sec warmup 90 sec latency 538.844 ms 2023-10-16T19:44:18.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 902 0.24 MB/sec warmup 91 sec latency 440.549 ms 2023-10-16T19:44:19.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 904 0.24 MB/sec warmup 92 sec latency 675.541 ms 2023-10-16T19:44:20.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 918 0.23 MB/sec warmup 93 sec latency 430.168 ms 2023-10-16T19:44:21.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 927 0.23 MB/sec warmup 94 sec latency 296.680 ms 2023-10-16T19:44:22.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 928 0.23 MB/sec warmup 95 sec latency 1089.240 ms 2023-10-16T19:44:23.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 928 0.23 MB/sec warmup 96 sec latency 1096.421 ms 2023-10-16T19:44:24.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 930 0.22 MB/sec warmup 97 sec latency 1417.415 ms 2023-10-16T19:44:25.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 931 0.22 MB/sec warmup 98 sec latency 547.665 ms 2023-10-16T19:44:26.225 INFO:tasks.workunit.client.0.smithi057.stdout: 1 933 0.22 MB/sec warmup 99 sec latency 1164.432 ms 2023-10-16T19:44:27.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 937 0.22 MB/sec warmup 100 sec latency 544.860 ms 2023-10-16T19:44:28.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 942 0.22 MB/sec warmup 101 sec latency 1074.460 ms 2023-10-16T19:44:29.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 947 0.21 MB/sec warmup 102 sec latency 1256.404 ms 2023-10-16T19:44:30.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 961 0.21 MB/sec warmup 103 sec latency 379.290 ms 2023-10-16T19:44:31.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 969 0.21 MB/sec warmup 104 sec latency 333.293 ms 2023-10-16T19:44:32.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 970 0.21 MB/sec warmup 105 sec latency 677.839 ms 2023-10-16T19:44:33.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 977 0.21 MB/sec warmup 106 sec latency 692.757 ms 2023-10-16T19:44:34.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 993 0.20 MB/sec warmup 107 sec latency 506.262 ms 2023-10-16T19:44:35.226 INFO:tasks.workunit.client.0.smithi057.stdout: 1 994 0.20 MB/sec warmup 108 sec latency 765.173 ms 2023-10-16T19:44:36.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 995 0.20 MB/sec warmup 109 sec latency 1074.956 ms 2023-10-16T19:44:37.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1027 0.21 MB/sec warmup 110 sec latency 755.024 ms 2023-10-16T19:44:38.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1028 0.21 MB/sec warmup 111 sec latency 1101.209 ms 2023-10-16T19:44:39.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1032 0.20 MB/sec warmup 112 sec latency 758.711 ms 2023-10-16T19:44:40.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1033 0.20 MB/sec warmup 113 sec latency 961.062 ms 2023-10-16T19:44:41.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1041 0.20 MB/sec warmup 114 sec latency 1143.444 ms 2023-10-16T19:44:42.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1046 0.20 MB/sec warmup 115 sec latency 782.322 ms 2023-10-16T19:44:43.227 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1047 0.20 MB/sec warmup 116 sec latency 1159.490 ms 2023-10-16T19:44:44.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1047 0.20 MB/sec warmup 117 sec latency 1459.573 ms 2023-10-16T19:44:45.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1048 0.19 MB/sec warmup 118 sec latency 1471.971 ms 2023-10-16T19:44:45.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:44:45.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:44:46.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1051 0.19 MB/sec warmup 119 sec latency 1144.274 ms 2023-10-16T19:44:48.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1063 0.00 MB/sec execute 1 sec latency 592.603 ms 2023-10-16T19:44:49.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1067 0.00 MB/sec execute 2 sec latency 608.458 ms 2023-10-16T19:44:50.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1085 0.01 MB/sec execute 3 sec latency 556.822 ms 2023-10-16T19:44:51.228 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1088 0.01 MB/sec execute 4 sec latency 519.547 ms 2023-10-16T19:44:52.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1091 0.01 MB/sec execute 5 sec latency 1170.058 ms 2023-10-16T19:44:53.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1099 0.01 MB/sec execute 6 sec latency 561.104 ms 2023-10-16T19:44:54.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1100 0.01 MB/sec execute 7 sec latency 914.778 ms 2023-10-16T19:44:55.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1114 0.01 MB/sec execute 8 sec latency 1113.112 ms 2023-10-16T19:44:56.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1116 0.01 MB/sec execute 9 sec latency 1133.179 ms 2023-10-16T19:44:57.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1124 0.01 MB/sec execute 10 sec latency 386.125 ms 2023-10-16T19:44:58.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1134 0.01 MB/sec execute 11 sec latency 424.459 ms 2023-10-16T19:44:59.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1145 0.01 MB/sec execute 12 sec latency 545.423 ms 2023-10-16T19:45:00.229 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1148 0.01 MB/sec execute 13 sec latency 670.600 ms 2023-10-16T19:45:01.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1157 0.01 MB/sec execute 14 sec latency 442.583 ms 2023-10-16T19:45:02.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1159 0.01 MB/sec execute 15 sec latency 1149.217 ms 2023-10-16T19:45:03.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1168 0.01 MB/sec execute 16 sec latency 382.478 ms 2023-10-16T19:45:04.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1169 0.01 MB/sec execute 17 sec latency 1168.710 ms 2023-10-16T19:45:05.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1169 0.01 MB/sec execute 18 sec latency 1148.288 ms 2023-10-16T19:45:06.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1170 0.01 MB/sec execute 19 sec latency 1172.458 ms 2023-10-16T19:45:07.230 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1173 0.01 MB/sec execute 20 sec latency 1085.076 ms 2023-10-16T19:45:08.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1177 0.01 MB/sec execute 21 sec latency 383.367 ms 2023-10-16T19:45:09.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1180 0.01 MB/sec execute 22 sec latency 722.496 ms 2023-10-16T19:45:10.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1192 0.01 MB/sec execute 23 sec latency 549.848 ms 2023-10-16T19:45:11.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1201 0.01 MB/sec execute 24 sec latency 501.007 ms 2023-10-16T19:45:12.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1204 0.01 MB/sec execute 25 sec latency 725.434 ms 2023-10-16T19:45:13.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1214 0.01 MB/sec execute 26 sec latency 1089.229 ms 2023-10-16T19:45:14.231 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1215 0.01 MB/sec execute 27 sec latency 678.520 ms 2023-10-16T19:45:15.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1229 0.01 MB/sec execute 28 sec latency 382.311 ms 2023-10-16T19:45:16.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:45:16.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:45:16.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1233 0.01 MB/sec execute 29 sec latency 511.974 ms 2023-10-16T19:45:17.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1244 0.01 MB/sec execute 30 sec latency 538.434 ms 2023-10-16T19:45:18.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1248 0.01 MB/sec execute 31 sec latency 689.716 ms 2023-10-16T19:45:19.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1248 0.01 MB/sec execute 32 sec latency 1301.450 ms 2023-10-16T19:45:20.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1254 0.01 MB/sec execute 33 sec latency 1434.008 ms 2023-10-16T19:45:21.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1262 0.01 MB/sec execute 34 sec latency 385.195 ms 2023-10-16T19:45:22.232 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1274 0.01 MB/sec execute 35 sec latency 377.876 ms 2023-10-16T19:45:23.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1278 0.01 MB/sec execute 36 sec latency 554.542 ms 2023-10-16T19:45:24.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1280 0.01 MB/sec execute 37 sec latency 1181.481 ms 2023-10-16T19:45:25.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1281 0.01 MB/sec execute 38 sec latency 1101.435 ms 2023-10-16T19:45:26.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1284 0.01 MB/sec execute 39 sec latency 1156.797 ms 2023-10-16T19:45:27.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1284 0.01 MB/sec execute 40 sec latency 1031.880 ms 2023-10-16T19:45:28.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1376 0.08 MB/sec execute 41 sec latency 1146.904 ms 2023-10-16T19:45:29.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1376 0.07 MB/sec execute 42 sec latency 1337.797 ms 2023-10-16T19:45:30.233 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1377 0.07 MB/sec execute 43 sec latency 1514.052 ms 2023-10-16T19:45:31.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1379 0.07 MB/sec execute 44 sec latency 1114.572 ms 2023-10-16T19:45:32.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1381 0.07 MB/sec execute 45 sec latency 844.167 ms 2023-10-16T19:45:33.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1385 0.07 MB/sec execute 46 sec latency 1163.731 ms 2023-10-16T19:45:34.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1389 0.07 MB/sec execute 47 sec latency 1248.416 ms 2023-10-16T19:45:35.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1396 0.07 MB/sec execute 48 sec latency 261.915 ms 2023-10-16T19:45:36.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1397 0.06 MB/sec execute 49 sec latency 821.424 ms 2023-10-16T19:45:37.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1403 0.06 MB/sec execute 50 sec latency 1128.344 ms 2023-10-16T19:45:38.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1417 0.06 MB/sec execute 51 sec latency 646.614 ms 2023-10-16T19:45:39.234 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1417 0.06 MB/sec execute 52 sec latency 1058.303 ms 2023-10-16T19:45:40.235 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1419 0.06 MB/sec execute 53 sec latency 1426.926 ms 2023-10-16T19:45:41.235 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1428 0.06 MB/sec execute 54 sec latency 395.952 ms 2023-10-16T19:45:42.235 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1443 0.06 MB/sec execute 55 sec latency 408.812 ms 2023-10-16T19:45:43.235 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1446 0.06 MB/sec execute 56 sec latency 457.670 ms 2023-10-16T19:45:44.235 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1448 0.05 MB/sec execute 57 sec latency 706.152 ms 2023-10-16T19:45:45.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1457 0.05 MB/sec execute 58 sec latency 1247.601 ms 2023-10-16T19:45:46.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:45:46.224 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:45:46.235 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1465 0.05 MB/sec execute 59 sec latency 219.132 ms 2023-10-16T19:45:47.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1466 0.05 MB/sec execute 60 sec latency 755.135 ms 2023-10-16T19:45:48.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1474 0.05 MB/sec execute 61 sec latency 1158.976 ms 2023-10-16T19:45:49.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1485 0.05 MB/sec execute 62 sec latency 643.219 ms 2023-10-16T19:45:50.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1486 0.05 MB/sec execute 63 sec latency 1273.478 ms 2023-10-16T19:45:51.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1490 0.05 MB/sec execute 64 sec latency 461.260 ms 2023-10-16T19:45:52.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1490 0.05 MB/sec execute 65 sec latency 1096.887 ms 2023-10-16T19:45:53.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1500 0.05 MB/sec execute 66 sec latency 1109.417 ms 2023-10-16T19:45:54.236 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1504 0.05 MB/sec execute 67 sec latency 382.325 ms 2023-10-16T19:45:55.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1514 0.05 MB/sec execute 68 sec latency 551.275 ms 2023-10-16T19:45:56.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1523 0.05 MB/sec execute 69 sec latency 399.721 ms 2023-10-16T19:45:57.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1526 0.05 MB/sec execute 70 sec latency 437.923 ms 2023-10-16T19:45:58.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1530 0.05 MB/sec execute 71 sec latency 1109.982 ms 2023-10-16T19:45:59.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1530 0.04 MB/sec execute 72 sec latency 1028.271 ms 2023-10-16T19:46:00.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1551 0.04 MB/sec execute 73 sec latency 1332.365 ms 2023-10-16T19:46:01.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1555 0.04 MB/sec execute 74 sec latency 718.217 ms 2023-10-16T19:46:02.237 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1555 0.04 MB/sec execute 75 sec latency 1044.589 ms 2023-10-16T19:46:03.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1568 0.04 MB/sec execute 76 sec latency 1110.513 ms 2023-10-16T19:46:04.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1580 0.04 MB/sec execute 77 sec latency 174.447 ms 2023-10-16T19:46:05.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1587 0.04 MB/sec execute 78 sec latency 220.520 ms 2023-10-16T19:46:06.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1589 0.04 MB/sec execute 79 sec latency 575.289 ms 2023-10-16T19:46:07.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1591 0.04 MB/sec execute 80 sec latency 1126.125 ms 2023-10-16T19:46:08.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1606 0.04 MB/sec execute 81 sec latency 469.608 ms 2023-10-16T19:46:09.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1606 0.04 MB/sec execute 82 sec latency 1191.841 ms 2023-10-16T19:46:10.238 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1610 0.04 MB/sec execute 83 sec latency 1332.008 ms 2023-10-16T19:46:11.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1614 0.04 MB/sec execute 84 sec latency 1136.999 ms 2023-10-16T19:46:12.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1617 0.04 MB/sec execute 85 sec latency 375.365 ms 2023-10-16T19:46:13.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1619 0.04 MB/sec execute 86 sec latency 1121.225 ms 2023-10-16T19:46:14.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1641 0.04 MB/sec execute 87 sec latency 398.102 ms 2023-10-16T19:46:15.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1641 0.04 MB/sec execute 88 sec latency 1094.577 ms 2023-10-16T19:46:16.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1644 0.04 MB/sec execute 89 sec latency 1119.076 ms 2023-10-16T19:46:16.354 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:46:16.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:46:17.239 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1646 0.04 MB/sec execute 90 sec latency 1058.784 ms 2023-10-16T19:46:18.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1655 0.04 MB/sec execute 91 sec latency 658.787 ms 2023-10-16T19:46:19.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1662 0.04 MB/sec execute 92 sec latency 496.368 ms 2023-10-16T19:46:20.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1682 0.04 MB/sec execute 93 sec latency 520.270 ms 2023-10-16T19:46:21.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1687 0.04 MB/sec execute 94 sec latency 773.818 ms 2023-10-16T19:46:22.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1689 0.04 MB/sec execute 95 sec latency 571.726 ms 2023-10-16T19:46:23.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1698 0.03 MB/sec execute 96 sec latency 650.396 ms 2023-10-16T19:46:24.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1701 0.03 MB/sec execute 97 sec latency 508.150 ms 2023-10-16T19:46:25.240 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1707 0.03 MB/sec execute 98 sec latency 1233.108 ms 2023-10-16T19:46:26.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1707 0.03 MB/sec execute 99 sec latency 1060.480 ms 2023-10-16T19:46:27.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1719 0.03 MB/sec execute 100 sec latency 1173.159 ms 2023-10-16T19:46:28.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1734 0.03 MB/sec execute 101 sec latency 163.039 ms 2023-10-16T19:46:29.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1759 0.03 MB/sec execute 102 sec latency 321.352 ms 2023-10-16T19:46:30.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1770 0.03 MB/sec execute 103 sec latency 387.194 ms 2023-10-16T19:46:31.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1772 0.03 MB/sec execute 104 sec latency 769.804 ms 2023-10-16T19:46:32.241 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1779 0.03 MB/sec execute 105 sec latency 1178.254 ms 2023-10-16T19:46:33.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1802 0.03 MB/sec execute 106 sec latency 182.709 ms 2023-10-16T19:46:34.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1805 0.03 MB/sec execute 107 sec latency 376.895 ms 2023-10-16T19:46:35.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1806 0.03 MB/sec execute 108 sec latency 986.994 ms 2023-10-16T19:46:36.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1820 0.03 MB/sec execute 109 sec latency 1108.128 ms 2023-10-16T19:46:37.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1822 0.03 MB/sec execute 110 sec latency 606.230 ms 2023-10-16T19:46:38.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1826 0.03 MB/sec execute 111 sec latency 1125.330 ms 2023-10-16T19:46:39.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1826 0.03 MB/sec execute 112 sec latency 1221.764 ms 2023-10-16T19:46:40.242 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1837 0.03 MB/sec execute 113 sec latency 1357.159 ms 2023-10-16T19:46:41.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1841 0.03 MB/sec execute 114 sec latency 380.837 ms 2023-10-16T19:46:42.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1841 0.03 MB/sec execute 115 sec latency 1072.582 ms 2023-10-16T19:46:43.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1855 0.03 MB/sec execute 116 sec latency 1179.694 ms 2023-10-16T19:46:44.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1858 0.03 MB/sec execute 117 sec latency 683.871 ms 2023-10-16T19:46:45.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1862 0.03 MB/sec execute 118 sec latency 1150.672 ms 2023-10-16T19:46:46.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1864 0.03 MB/sec execute 119 sec latency 1139.121 ms 2023-10-16T19:46:46.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:46:46.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:46:47.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1869 0.03 MB/sec execute 120 sec latency 394.147 ms 2023-10-16T19:46:48.243 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1869 0.03 MB/sec execute 121 sec latency 1052.366 ms 2023-10-16T19:46:49.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1887 0.03 MB/sec execute 122 sec latency 1169.772 ms 2023-10-16T19:46:50.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1898 0.03 MB/sec execute 123 sec latency 692.056 ms 2023-10-16T19:46:51.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1903 0.03 MB/sec execute 124 sec latency 1151.193 ms 2023-10-16T19:46:52.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1909 0.03 MB/sec execute 125 sec latency 1123.499 ms 2023-10-16T19:46:53.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1912 0.03 MB/sec execute 126 sec latency 433.452 ms 2023-10-16T19:46:54.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1913 0.03 MB/sec execute 127 sec latency 1261.025 ms 2023-10-16T19:46:55.244 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1920 0.03 MB/sec execute 128 sec latency 697.078 ms 2023-10-16T19:46:56.245 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1950 0.03 MB/sec execute 129 sec latency 1202.042 ms 2023-10-16T19:46:57.245 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1961 0.03 MB/sec execute 130 sec latency 411.318 ms 2023-10-16T19:46:58.245 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1972 0.03 MB/sec execute 131 sec latency 308.307 ms 2023-10-16T19:46:59.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1974 0.03 MB/sec execute 132 sec latency 831.397 ms 2023-10-16T19:47:00.245 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1975 0.03 MB/sec execute 133 sec latency 940.152 ms 2023-10-16T19:47:01.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1989 0.03 MB/sec execute 134 sec latency 1099.690 ms 2023-10-16T19:47:02.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 1997 0.03 MB/sec execute 135 sec latency 608.354 ms 2023-10-16T19:47:03.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2004 0.03 MB/sec execute 136 sec latency 1190.025 ms 2023-10-16T19:47:04.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2014 0.03 MB/sec execute 137 sec latency 261.533 ms 2023-10-16T19:47:05.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2030 0.03 MB/sec execute 138 sec latency 182.599 ms 2023-10-16T19:47:06.246 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2034 0.03 MB/sec execute 139 sec latency 469.679 ms 2023-10-16T19:47:07.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2042 0.03 MB/sec execute 140 sec latency 1111.297 ms 2023-10-16T19:47:08.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2043 0.03 MB/sec execute 141 sec latency 951.861 ms 2023-10-16T19:47:09.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2051 0.03 MB/sec execute 142 sec latency 1146.597 ms 2023-10-16T19:47:10.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2053 0.03 MB/sec execute 143 sec latency 1230.507 ms 2023-10-16T19:47:11.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2055 0.03 MB/sec execute 144 sec latency 1114.343 ms 2023-10-16T19:47:12.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2060 0.03 MB/sec execute 145 sec latency 216.527 ms 2023-10-16T19:47:13.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2061 0.03 MB/sec execute 146 sec latency 782.869 ms 2023-10-16T19:47:14.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2072 0.03 MB/sec execute 147 sec latency 1191.164 ms 2023-10-16T19:47:15.247 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2079 0.03 MB/sec execute 148 sec latency 834.186 ms 2023-10-16T19:47:16.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2081 0.03 MB/sec execute 149 sec latency 1131.291 ms 2023-10-16T19:47:16.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:47:16.659 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:47:17.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2088 0.03 MB/sec execute 150 sec latency 1075.626 ms 2023-10-16T19:47:18.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2093 0.02 MB/sec execute 151 sec latency 583.879 ms 2023-10-16T19:47:19.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2096 0.02 MB/sec execute 152 sec latency 1270.456 ms 2023-10-16T19:47:20.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2098 0.02 MB/sec execute 153 sec latency 1150.995 ms 2023-10-16T19:47:21.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2137 0.02 MB/sec execute 154 sec latency 185.137 ms 2023-10-16T19:47:22.248 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2138 0.02 MB/sec execute 155 sec latency 756.941 ms 2023-10-16T19:47:23.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2140 0.02 MB/sec execute 156 sec latency 874.188 ms 2023-10-16T19:47:24.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2146 0.02 MB/sec execute 157 sec latency 1165.638 ms 2023-10-16T19:47:25.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2154 0.02 MB/sec execute 158 sec latency 1172.698 ms 2023-10-16T19:47:26.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2173 0.02 MB/sec execute 159 sec latency 335.800 ms 2023-10-16T19:47:27.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2174 0.02 MB/sec execute 160 sec latency 1157.270 ms 2023-10-16T19:47:28.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2175 0.02 MB/sec execute 161 sec latency 999.797 ms 2023-10-16T19:47:29.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2180 0.02 MB/sec execute 162 sec latency 1109.977 ms 2023-10-16T19:47:30.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2183 0.02 MB/sec execute 163 sec latency 398.556 ms 2023-10-16T19:47:31.249 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2185 0.02 MB/sec execute 164 sec latency 1148.225 ms 2023-10-16T19:47:32.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2199 0.02 MB/sec execute 165 sec latency 440.868 ms 2023-10-16T19:47:33.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2204 0.02 MB/sec execute 166 sec latency 388.597 ms 2023-10-16T19:47:34.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2221 0.02 MB/sec execute 167 sec latency 380.889 ms 2023-10-16T19:47:35.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2228 0.02 MB/sec execute 168 sec latency 1104.387 ms 2023-10-16T19:47:36.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2249 0.02 MB/sec execute 169 sec latency 387.586 ms 2023-10-16T19:47:37.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2264 0.02 MB/sec execute 170 sec latency 368.955 ms 2023-10-16T19:47:38.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2292 0.03 MB/sec execute 171 sec latency 407.428 ms 2023-10-16T19:47:39.250 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2292 0.03 MB/sec execute 172 sec latency 1038.716 ms 2023-10-16T19:47:40.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2298 0.03 MB/sec execute 173 sec latency 1295.857 ms 2023-10-16T19:47:41.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2303 0.03 MB/sec execute 174 sec latency 455.769 ms 2023-10-16T19:47:42.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2306 0.03 MB/sec execute 175 sec latency 1164.434 ms 2023-10-16T19:47:43.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2306 0.03 MB/sec execute 176 sec latency 1238.698 ms 2023-10-16T19:47:44.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2307 0.03 MB/sec execute 177 sec latency 1279.763 ms 2023-10-16T19:47:45.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2321 0.03 MB/sec execute 178 sec latency 1295.116 ms 2023-10-16T19:47:46.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2324 0.03 MB/sec execute 179 sec latency 1157.717 ms 2023-10-16T19:47:46.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:47:46.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:47:47.251 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2327 0.03 MB/sec execute 180 sec latency 1146.869 ms 2023-10-16T19:47:48.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2334 0.03 MB/sec execute 181 sec latency 427.794 ms 2023-10-16T19:47:49.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2335 0.03 MB/sec execute 182 sec latency 649.694 ms 2023-10-16T19:47:50.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2336 0.03 MB/sec execute 183 sec latency 1267.379 ms 2023-10-16T19:47:51.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2340 0.03 MB/sec execute 184 sec latency 563.956 ms 2023-10-16T19:47:52.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2345 0.03 MB/sec execute 185 sec latency 1129.920 ms 2023-10-16T19:47:53.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2358 0.03 MB/sec execute 186 sec latency 282.137 ms 2023-10-16T19:47:54.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2361 0.03 MB/sec execute 187 sec latency 642.428 ms 2023-10-16T19:47:55.252 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2361 0.03 MB/sec execute 188 sec latency 1120.012 ms 2023-10-16T19:47:56.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2362 0.03 MB/sec execute 189 sec latency 1130.478 ms 2023-10-16T19:47:57.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2364 0.03 MB/sec execute 190 sec latency 1125.804 ms 2023-10-16T19:47:58.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2366 0.03 MB/sec execute 191 sec latency 1096.068 ms 2023-10-16T19:47:59.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2368 0.03 MB/sec execute 192 sec latency 1202.866 ms 2023-10-16T19:48:00.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2371 0.03 MB/sec execute 193 sec latency 832.707 ms 2023-10-16T19:48:01.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2383 0.03 MB/sec execute 194 sec latency 1088.773 ms 2023-10-16T19:48:02.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2388 0.03 MB/sec execute 195 sec latency 356.453 ms 2023-10-16T19:48:03.253 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2391 0.03 MB/sec execute 196 sec latency 613.349 ms 2023-10-16T19:48:04.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2391 0.03 MB/sec execute 197 sec latency 1083.339 ms 2023-10-16T19:48:05.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2396 0.03 MB/sec execute 198 sec latency 1211.253 ms 2023-10-16T19:48:06.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2400 0.03 MB/sec execute 199 sec latency 379.605 ms 2023-10-16T19:48:07.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2406 0.03 MB/sec execute 200 sec latency 552.760 ms 2023-10-16T19:48:08.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2410 0.03 MB/sec execute 201 sec latency 660.242 ms 2023-10-16T19:48:09.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2410 0.03 MB/sec execute 202 sec latency 1309.209 ms 2023-10-16T19:48:10.254 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2423 0.03 MB/sec execute 203 sec latency 1439.995 ms 2023-10-16T19:48:11.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2428 0.03 MB/sec execute 204 sec latency 501.576 ms 2023-10-16T19:48:12.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2431 0.03 MB/sec execute 205 sec latency 610.894 ms 2023-10-16T19:48:13.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2432 0.03 MB/sec execute 206 sec latency 1126.981 ms 2023-10-16T19:48:14.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2434 0.03 MB/sec execute 207 sec latency 1146.491 ms 2023-10-16T19:48:15.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2438 0.03 MB/sec execute 208 sec latency 356.666 ms 2023-10-16T19:48:16.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2440 0.02 MB/sec execute 209 sec latency 535.940 ms 2023-10-16T19:48:17.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:48:17.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:48:17.255 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2447 0.02 MB/sec execute 210 sec latency 563.862 ms 2023-10-16T19:48:18.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2452 0.02 MB/sec execute 211 sec latency 602.519 ms 2023-10-16T19:48:19.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2454 0.02 MB/sec execute 212 sec latency 713.785 ms 2023-10-16T19:48:20.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2466 0.03 MB/sec execute 213 sec latency 473.711 ms 2023-10-16T19:48:21.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2470 0.03 MB/sec execute 214 sec latency 609.376 ms 2023-10-16T19:48:22.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2473 0.03 MB/sec execute 215 sec latency 1152.938 ms 2023-10-16T19:48:23.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2485 0.03 MB/sec execute 216 sec latency 352.160 ms 2023-10-16T19:48:24.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2490 0.03 MB/sec execute 217 sec latency 657.850 ms 2023-10-16T19:48:25.256 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2492 0.03 MB/sec execute 218 sec latency 673.624 ms 2023-10-16T19:48:26.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2494 0.03 MB/sec execute 219 sec latency 1140.103 ms 2023-10-16T19:48:27.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2499 0.03 MB/sec execute 220 sec latency 1115.013 ms 2023-10-16T19:48:28.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2506 0.03 MB/sec execute 221 sec latency 180.980 ms 2023-10-16T19:48:29.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2506 0.03 MB/sec execute 222 sec latency 1015.727 ms 2023-10-16T19:48:30.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2549 0.03 MB/sec execute 223 sec latency 1578.155 ms 2023-10-16T19:48:31.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2551 0.03 MB/sec execute 224 sec latency 1141.201 ms 2023-10-16T19:48:32.257 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2553 0.03 MB/sec execute 225 sec latency 1157.094 ms 2023-10-16T19:48:33.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2558 0.03 MB/sec execute 226 sec latency 391.958 ms 2023-10-16T19:48:34.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2560 0.03 MB/sec execute 227 sec latency 560.478 ms 2023-10-16T19:48:35.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2561 0.03 MB/sec execute 228 sec latency 1153.251 ms 2023-10-16T19:48:36.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2569 0.03 MB/sec execute 229 sec latency 478.071 ms 2023-10-16T19:48:37.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2577 0.03 MB/sec execute 230 sec latency 529.384 ms 2023-10-16T19:48:38.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2580 0.03 MB/sec execute 231 sec latency 568.960 ms 2023-10-16T19:48:39.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2581 0.03 MB/sec execute 232 sec latency 1322.633 ms 2023-10-16T19:48:40.258 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2581 0.03 MB/sec execute 233 sec latency 1109.932 ms 2023-10-16T19:48:41.259 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2586 0.03 MB/sec execute 234 sec latency 1372.838 ms 2023-10-16T19:48:42.259 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2592 0.03 MB/sec execute 235 sec latency 425.005 ms 2023-10-16T19:48:43.259 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2597 0.03 MB/sec execute 236 sec latency 596.726 ms 2023-10-16T19:48:44.259 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2600 0.03 MB/sec execute 237 sec latency 577.101 ms 2023-10-16T19:48:45.259 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2602 0.03 MB/sec execute 238 sec latency 1148.133 ms 2023-10-16T19:48:46.259 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2607 0.03 MB/sec execute 239 sec latency 387.255 ms 2023-10-16T19:48:47.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2609 0.03 MB/sec execute 240 sec latency 568.019 ms 2023-10-16T19:48:47.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:48:47.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:48:48.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2615 0.03 MB/sec execute 241 sec latency 759.746 ms 2023-10-16T19:48:49.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2617 0.03 MB/sec execute 242 sec latency 1019.167 ms 2023-10-16T19:48:50.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2618 0.03 MB/sec execute 243 sec latency 1542.159 ms 2023-10-16T19:48:51.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2619 0.03 MB/sec execute 244 sec latency 1130.115 ms 2023-10-16T19:48:52.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2621 0.03 MB/sec execute 245 sec latency 850.600 ms 2023-10-16T19:48:53.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2716 0.04 MB/sec execute 246 sec latency 1148.701 ms 2023-10-16T19:48:54.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2718 0.04 MB/sec execute 247 sec latency 709.678 ms 2023-10-16T19:48:55.260 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2745 0.04 MB/sec execute 248 sec latency 1286.154 ms 2023-10-16T19:48:56.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2745 0.04 MB/sec execute 249 sec latency 1034.852 ms 2023-10-16T19:48:57.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2752 0.04 MB/sec execute 250 sec latency 1208.777 ms 2023-10-16T19:48:58.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2760 0.04 MB/sec execute 251 sec latency 393.445 ms 2023-10-16T19:48:59.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2760 0.04 MB/sec execute 252 sec latency 1204.289 ms 2023-10-16T19:49:00.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2762 0.04 MB/sec execute 253 sec latency 1633.148 ms 2023-10-16T19:49:01.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2770 0.04 MB/sec execute 254 sec latency 374.408 ms 2023-10-16T19:49:02.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2775 0.04 MB/sec execute 255 sec latency 516.282 ms 2023-10-16T19:49:03.261 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2780 0.04 MB/sec execute 256 sec latency 598.379 ms 2023-10-16T19:49:04.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2780 0.04 MB/sec execute 257 sec latency 1036.403 ms 2023-10-16T19:49:05.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2826 0.04 MB/sec execute 258 sec latency 1286.289 ms 2023-10-16T19:49:06.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2872 0.04 MB/sec execute 259 sec latency 992.510 ms 2023-10-16T19:49:06.758 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:09:06.318 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:06.909 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:09:06.470 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:06.934 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:09:06.483 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:06.938 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:09:06.486 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:07.055 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:09:06.604 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:07.075 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:09:06.623 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:07.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2878 0.04 MB/sec execute 260 sec latency 1163.294 ms 2023-10-16T19:49:07.477 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:09:07.038 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:07.489 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:09:07.037 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:07.566 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:09:07.114 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:08.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2880 0.04 MB/sec execute 261 sec latency 470.210 ms 2023-10-16T19:49:09.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2896 0.04 MB/sec execute 262 sec latency 519.199 ms 2023-10-16T19:49:10.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2898 0.04 MB/sec execute 263 sec latency 733.401 ms 2023-10-16T19:49:11.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2902 0.04 MB/sec execute 264 sec latency 385.217 ms 2023-10-16T19:49:12.262 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2917 0.04 MB/sec execute 265 sec latency 595.647 ms 2023-10-16T19:49:13.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2922 0.04 MB/sec execute 266 sec latency 704.629 ms 2023-10-16T19:49:14.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2927 0.04 MB/sec execute 267 sec latency 379.398 ms 2023-10-16T19:49:15.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2932 0.04 MB/sec execute 268 sec latency 626.929 ms 2023-10-16T19:49:16.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2937 0.04 MB/sec execute 269 sec latency 587.738 ms 2023-10-16T19:49:17.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2938 0.04 MB/sec execute 270 sec latency 980.539 ms 2023-10-16T19:49:17.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:49:17.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:49:18.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2966 0.04 MB/sec execute 271 sec latency 1156.667 ms 2023-10-16T19:49:19.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2968 0.04 MB/sec execute 272 sec latency 1145.936 ms 2023-10-16T19:49:20.263 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2973 0.04 MB/sec execute 273 sec latency 337.148 ms 2023-10-16T19:49:21.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2974 0.04 MB/sec execute 274 sec latency 982.951 ms 2023-10-16T19:49:22.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2977 0.04 MB/sec execute 275 sec latency 1096.019 ms 2023-10-16T19:49:23.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2984 0.04 MB/sec execute 276 sec latency 433.903 ms 2023-10-16T19:49:24.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2990 0.04 MB/sec execute 277 sec latency 552.679 ms 2023-10-16T19:49:25.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2994 0.04 MB/sec execute 278 sec latency 661.015 ms 2023-10-16T19:49:26.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 2995 0.04 MB/sec execute 279 sec latency 1124.459 ms 2023-10-16T19:49:27.264 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3002 0.04 MB/sec execute 280 sec latency 394.021 ms 2023-10-16T19:49:28.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3012 0.04 MB/sec execute 281 sec latency 354.952 ms 2023-10-16T19:49:29.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3013 0.04 MB/sec execute 282 sec latency 859.175 ms 2023-10-16T19:49:30.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3019 0.04 MB/sec execute 283 sec latency 491.236 ms 2023-10-16T19:49:31.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3024 0.04 MB/sec execute 284 sec latency 335.848 ms 2023-10-16T19:49:32.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3031 0.04 MB/sec execute 285 sec latency 576.263 ms 2023-10-16T19:49:33.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3031 0.04 MB/sec execute 286 sec latency 1094.466 ms 2023-10-16T19:49:34.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3167 0.04 MB/sec execute 287 sec latency 1158.174 ms 2023-10-16T19:49:35.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3170 0.04 MB/sec execute 288 sec latency 1333.824 ms 2023-10-16T19:49:36.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3175 0.04 MB/sec execute 289 sec latency 378.576 ms 2023-10-16T19:49:37.265 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3177 0.04 MB/sec execute 290 sec latency 590.563 ms 2023-10-16T19:49:38.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3188 0.04 MB/sec execute 291 sec latency 692.623 ms 2023-10-16T19:49:39.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3189 0.04 MB/sec execute 292 sec latency 1128.068 ms 2023-10-16T19:49:40.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3202 0.04 MB/sec execute 293 sec latency 639.481 ms 2023-10-16T19:49:41.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3209 0.04 MB/sec execute 294 sec latency 309.597 ms 2023-10-16T19:49:42.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3212 0.04 MB/sec execute 295 sec latency 647.859 ms 2023-10-16T19:49:43.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3246 0.04 MB/sec execute 296 sec latency 346.747 ms 2023-10-16T19:49:44.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3266 0.04 MB/sec execute 297 sec latency 589.765 ms 2023-10-16T19:49:45.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3268 0.04 MB/sec execute 298 sec latency 1409.251 ms 2023-10-16T19:49:45.851 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:09:45.412 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:45.869 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:09:45.430 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:45.890 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:09:45.438 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:45.897 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:09:45.445 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:45.919 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:09:45.467 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:45.929 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:09:45.477 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:46.000 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:09:45.561 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:46.057 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:09:45.605 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:46.057 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:09:45.605 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:49:46.266 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3269 0.04 MB/sec execute 299 sec latency 1141.591 ms 2023-10-16T19:49:47.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3275 0.04 MB/sec execute 300 sec latency 300.408 ms 2023-10-16T19:49:47.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:49:47.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:49:48.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3280 0.04 MB/sec execute 301 sec latency 484.080 ms 2023-10-16T19:49:49.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3281 0.04 MB/sec execute 302 sec latency 1203.013 ms 2023-10-16T19:49:50.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3282 0.04 MB/sec execute 303 sec latency 1117.954 ms 2023-10-16T19:49:51.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3283 0.04 MB/sec execute 304 sec latency 1128.369 ms 2023-10-16T19:49:52.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3283 0.04 MB/sec execute 305 sec latency 1035.139 ms 2023-10-16T19:49:53.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3285 0.04 MB/sec execute 306 sec latency 1119.880 ms 2023-10-16T19:49:54.267 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3286 0.04 MB/sec execute 307 sec latency 1116.254 ms 2023-10-16T19:49:55.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3287 0.04 MB/sec execute 308 sec latency 1533.859 ms 2023-10-16T19:49:56.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3290 0.04 MB/sec execute 309 sec latency 1152.313 ms 2023-10-16T19:49:57.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3290 0.04 MB/sec execute 310 sec latency 1021.612 ms 2023-10-16T19:49:58.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3291 0.04 MB/sec execute 311 sec latency 1145.074 ms 2023-10-16T19:49:59.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3292 0.04 MB/sec execute 312 sec latency 1288.093 ms 2023-10-16T19:50:00.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3293 0.04 MB/sec execute 313 sec latency 1159.982 ms 2023-10-16T19:50:01.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3294 0.04 MB/sec execute 314 sec latency 1161.153 ms 2023-10-16T19:50:02.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3295 0.04 MB/sec execute 315 sec latency 1125.097 ms 2023-10-16T19:50:03.268 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3297 0.04 MB/sec execute 316 sec latency 1114.543 ms 2023-10-16T19:50:04.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3298 0.04 MB/sec execute 317 sec latency 946.984 ms 2023-10-16T19:50:05.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3299 0.04 MB/sec execute 318 sec latency 1368.673 ms 2023-10-16T19:50:06.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3303 0.04 MB/sec execute 319 sec latency 1143.638 ms 2023-10-16T19:50:07.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3306 0.04 MB/sec execute 320 sec latency 1167.276 ms 2023-10-16T19:50:08.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3307 0.04 MB/sec execute 321 sec latency 1126.187 ms 2023-10-16T19:50:09.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3307 0.04 MB/sec execute 322 sec latency 1026.140 ms 2023-10-16T19:50:10.269 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3308 0.04 MB/sec execute 323 sec latency 1348.130 ms 2023-10-16T19:50:11.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3309 0.04 MB/sec execute 324 sec latency 1130.880 ms 2023-10-16T19:50:12.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3310 0.04 MB/sec execute 325 sec latency 1177.032 ms 2023-10-16T19:50:13.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3311 0.04 MB/sec execute 326 sec latency 1177.343 ms 2023-10-16T19:50:14.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3312 0.04 MB/sec execute 327 sec latency 1175.965 ms 2023-10-16T19:50:15.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3312 0.04 MB/sec execute 328 sec latency 1017.543 ms 2023-10-16T19:50:16.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3313 0.04 MB/sec execute 329 sec latency 1210.796 ms 2023-10-16T19:50:17.270 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3314 0.04 MB/sec execute 330 sec latency 1127.509 ms 2023-10-16T19:50:17.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:50:17.993 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:50:18.271 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3316 0.04 MB/sec execute 331 sec latency 1163.047 ms 2023-10-16T19:50:19.271 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3317 0.04 MB/sec execute 332 sec latency 993.678 ms 2023-10-16T19:50:20.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3318 0.04 MB/sec execute 333 sec latency 1232.481 ms 2023-10-16T19:50:21.271 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3319 0.04 MB/sec execute 334 sec latency 1068.512 ms 2023-10-16T19:50:22.271 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3320 0.04 MB/sec execute 335 sec latency 1164.007 ms 2023-10-16T19:50:23.271 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3320 0.04 MB/sec execute 336 sec latency 1043.256 ms 2023-10-16T19:50:24.271 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3322 0.04 MB/sec execute 337 sec latency 1121.833 ms 2023-10-16T19:50:25.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3323 0.04 MB/sec execute 338 sec latency 1229.866 ms 2023-10-16T19:50:26.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3324 0.04 MB/sec execute 339 sec latency 1179.811 ms 2023-10-16T19:50:27.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3325 0.04 MB/sec execute 340 sec latency 1128.800 ms 2023-10-16T19:50:28.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3326 0.04 MB/sec execute 341 sec latency 1137.291 ms 2023-10-16T19:50:29.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3327 0.04 MB/sec execute 342 sec latency 1121.634 ms 2023-10-16T19:50:30.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3327 0.04 MB/sec execute 343 sec latency 1028.609 ms 2023-10-16T19:50:31.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3330 0.04 MB/sec execute 344 sec latency 1098.961 ms 2023-10-16T19:50:32.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3331 0.04 MB/sec execute 345 sec latency 1134.841 ms 2023-10-16T19:50:33.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3332 0.04 MB/sec execute 346 sec latency 1120.199 ms 2023-10-16T19:50:34.272 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3333 0.04 MB/sec execute 347 sec latency 1148.043 ms 2023-10-16T19:50:35.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3334 0.04 MB/sec execute 348 sec latency 1208.961 ms 2023-10-16T19:50:36.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3335 0.04 MB/sec execute 349 sec latency 1150.316 ms 2023-10-16T19:50:37.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3335 0.04 MB/sec execute 350 sec latency 1086.247 ms 2023-10-16T19:50:38.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3336 0.04 MB/sec execute 351 sec latency 1147.877 ms 2023-10-16T19:50:39.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3337 0.04 MB/sec execute 352 sec latency 1114.054 ms 2023-10-16T19:50:40.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3342 0.04 MB/sec execute 353 sec latency 1303.780 ms 2023-10-16T19:50:41.273 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3351 0.04 MB/sec execute 354 sec latency 372.660 ms 2023-10-16T19:50:42.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3353 0.04 MB/sec execute 355 sec latency 553.282 ms 2023-10-16T19:50:43.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3360 0.04 MB/sec execute 356 sec latency 642.976 ms 2023-10-16T19:50:44.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3364 0.04 MB/sec execute 357 sec latency 412.355 ms 2023-10-16T19:50:45.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3366 0.04 MB/sec execute 358 sec latency 557.280 ms 2023-10-16T19:50:46.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3374 0.03 MB/sec execute 359 sec latency 620.835 ms 2023-10-16T19:50:47.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3377 0.03 MB/sec execute 360 sec latency 407.036 ms 2023-10-16T19:50:48.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:50:48.152 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:50:48.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3386 0.03 MB/sec execute 361 sec latency 529.961 ms 2023-10-16T19:50:49.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3391 0.03 MB/sec execute 362 sec latency 448.868 ms 2023-10-16T19:50:50.274 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3391 0.03 MB/sec execute 363 sec latency 1191.518 ms 2023-10-16T19:50:51.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3393 0.03 MB/sec execute 364 sec latency 1246.543 ms 2023-10-16T19:50:52.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3395 0.03 MB/sec execute 365 sec latency 1175.094 ms 2023-10-16T19:50:53.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3398 0.03 MB/sec execute 366 sec latency 1182.269 ms 2023-10-16T19:50:54.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3410 0.04 MB/sec execute 367 sec latency 1367.342 ms 2023-10-16T19:50:55.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3493 0.04 MB/sec execute 368 sec latency 319.906 ms 2023-10-16T19:50:56.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3494 0.04 MB/sec execute 369 sec latency 835.752 ms 2023-10-16T19:50:57.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3503 0.04 MB/sec execute 370 sec latency 846.334 ms 2023-10-16T19:50:58.275 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3513 0.04 MB/sec execute 371 sec latency 398.050 ms 2023-10-16T19:50:59.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3516 0.04 MB/sec execute 372 sec latency 382.818 ms 2023-10-16T19:51:00.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3523 0.04 MB/sec execute 373 sec latency 645.343 ms 2023-10-16T19:51:01.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3531 0.04 MB/sec execute 374 sec latency 359.047 ms 2023-10-16T19:51:02.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3531 0.04 MB/sec execute 375 sec latency 1154.389 ms 2023-10-16T19:51:03.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3536 0.04 MB/sec execute 376 sec latency 1195.378 ms 2023-10-16T19:51:04.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3541 0.04 MB/sec execute 377 sec latency 633.152 ms 2023-10-16T19:51:05.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3549 0.04 MB/sec execute 378 sec latency 469.681 ms 2023-10-16T19:51:06.276 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3553 0.04 MB/sec execute 379 sec latency 511.447 ms 2023-10-16T19:51:07.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3557 0.04 MB/sec execute 380 sec latency 550.929 ms 2023-10-16T19:51:08.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3558 0.04 MB/sec execute 381 sec latency 1189.345 ms 2023-10-16T19:51:09.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3562 0.04 MB/sec execute 382 sec latency 646.393 ms 2023-10-16T19:51:10.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3569 0.04 MB/sec execute 383 sec latency 571.377 ms 2023-10-16T19:51:11.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3573 0.04 MB/sec execute 384 sec latency 617.631 ms 2023-10-16T19:51:12.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3579 0.04 MB/sec execute 385 sec latency 1155.632 ms 2023-10-16T19:51:13.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3588 0.04 MB/sec execute 386 sec latency 229.687 ms 2023-10-16T19:51:14.277 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3588 0.04 MB/sec execute 387 sec latency 1229.823 ms 2023-10-16T19:51:15.278 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3626 0.04 MB/sec execute 388 sec latency 1329.257 ms 2023-10-16T19:51:16.278 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3627 0.04 MB/sec execute 389 sec latency 605.622 ms 2023-10-16T19:51:17.278 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3633 0.04 MB/sec execute 390 sec latency 765.991 ms 2023-10-16T19:51:18.278 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3638 0.04 MB/sec execute 391 sec latency 717.369 ms 2023-10-16T19:51:18.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:51:18.303 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:51:19.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3642 0.04 MB/sec execute 392 sec latency 526.669 ms 2023-10-16T19:51:20.278 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3642 0.04 MB/sec execute 393 sec latency 1309.180 ms 2023-10-16T19:51:21.278 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3647 0.04 MB/sec execute 394 sec latency 1436.968 ms 2023-10-16T19:51:22.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3651 0.04 MB/sec execute 395 sec latency 385.061 ms 2023-10-16T19:51:23.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3665 0.04 MB/sec execute 396 sec latency 472.820 ms 2023-10-16T19:51:24.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3671 0.04 MB/sec execute 397 sec latency 390.890 ms 2023-10-16T19:51:25.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3672 0.04 MB/sec execute 398 sec latency 855.827 ms 2023-10-16T19:51:26.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3674 0.04 MB/sec execute 399 sec latency 1119.014 ms 2023-10-16T19:51:27.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3682 0.04 MB/sec execute 400 sec latency 400.330 ms 2023-10-16T19:51:28.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3686 0.04 MB/sec execute 401 sec latency 427.705 ms 2023-10-16T19:51:29.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3689 0.04 MB/sec execute 402 sec latency 1164.713 ms 2023-10-16T19:51:30.279 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3695 0.04 MB/sec execute 403 sec latency 568.504 ms 2023-10-16T19:51:31.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3697 0.04 MB/sec execute 404 sec latency 703.905 ms 2023-10-16T19:51:32.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3705 0.04 MB/sec execute 405 sec latency 708.301 ms 2023-10-16T19:51:33.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3708 0.04 MB/sec execute 406 sec latency 504.512 ms 2023-10-16T19:51:34.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3716 0.04 MB/sec execute 407 sec latency 592.598 ms 2023-10-16T19:51:35.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3721 0.04 MB/sec execute 408 sec latency 425.689 ms 2023-10-16T19:51:36.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3755 0.04 MB/sec execute 409 sec latency 519.223 ms 2023-10-16T19:51:37.280 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3758 0.04 MB/sec execute 410 sec latency 684.531 ms 2023-10-16T19:51:38.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3760 0.04 MB/sec execute 411 sec latency 1140.463 ms 2023-10-16T19:51:39.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3768 0.04 MB/sec execute 412 sec latency 579.917 ms 2023-10-16T19:51:40.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3770 0.04 MB/sec execute 413 sec latency 1001.718 ms 2023-10-16T19:51:41.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3773 0.04 MB/sec execute 414 sec latency 494.271 ms 2023-10-16T19:51:42.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3778 0.04 MB/sec execute 415 sec latency 583.160 ms 2023-10-16T19:51:43.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3780 0.04 MB/sec execute 416 sec latency 519.938 ms 2023-10-16T19:51:44.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3784 0.04 MB/sec execute 417 sec latency 631.196 ms 2023-10-16T19:51:45.281 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3785 0.04 MB/sec execute 418 sec latency 715.006 ms 2023-10-16T19:51:46.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3789 0.04 MB/sec execute 419 sec latency 782.101 ms 2023-10-16T19:51:47.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3791 0.04 MB/sec execute 420 sec latency 615.511 ms 2023-10-16T19:51:48.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3792 0.04 MB/sec execute 421 sec latency 617.247 ms 2023-10-16T19:51:48.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:51:48.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:51:49.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3796 0.04 MB/sec execute 422 sec latency 814.923 ms 2023-10-16T19:51:50.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3797 0.04 MB/sec execute 423 sec latency 917.517 ms 2023-10-16T19:51:51.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3800 0.04 MB/sec execute 424 sec latency 766.534 ms 2023-10-16T19:51:52.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3801 0.04 MB/sec execute 425 sec latency 842.185 ms 2023-10-16T19:51:53.282 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3805 0.04 MB/sec execute 426 sec latency 853.878 ms 2023-10-16T19:51:54.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3808 0.04 MB/sec execute 427 sec latency 752.034 ms 2023-10-16T19:51:55.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3812 0.04 MB/sec execute 428 sec latency 372.110 ms 2023-10-16T19:51:56.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3816 0.04 MB/sec execute 429 sec latency 593.525 ms 2023-10-16T19:51:57.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3820 0.04 MB/sec execute 430 sec latency 376.801 ms 2023-10-16T19:51:58.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3823 0.04 MB/sec execute 431 sec latency 581.266 ms 2023-10-16T19:51:59.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3827 0.04 MB/sec execute 432 sec latency 388.220 ms 2023-10-16T19:52:00.283 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3829 0.04 MB/sec execute 433 sec latency 735.791 ms 2023-10-16T19:52:01.284 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3834 0.04 MB/sec execute 434 sec latency 378.612 ms 2023-10-16T19:52:02.284 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3836 0.04 MB/sec execute 435 sec latency 520.791 ms 2023-10-16T19:52:03.284 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3840 0.04 MB/sec execute 436 sec latency 623.910 ms 2023-10-16T19:52:04.284 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3844 0.04 MB/sec execute 437 sec latency 397.009 ms 2023-10-16T19:52:05.284 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3848 0.04 MB/sec execute 438 sec latency 698.959 ms 2023-10-16T19:52:06.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3852 0.04 MB/sec execute 439 sec latency 399.579 ms 2023-10-16T19:52:07.284 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3855 0.04 MB/sec execute 440 sec latency 636.035 ms 2023-10-16T19:52:08.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3859 0.04 MB/sec execute 441 sec latency 388.131 ms 2023-10-16T19:52:09.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3861 0.04 MB/sec execute 442 sec latency 606.136 ms 2023-10-16T19:52:10.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3866 0.04 MB/sec execute 443 sec latency 369.397 ms 2023-10-16T19:52:11.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3868 0.04 MB/sec execute 444 sec latency 470.104 ms 2023-10-16T19:52:12.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3870 0.04 MB/sec execute 445 sec latency 673.524 ms 2023-10-16T19:52:13.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3873 0.04 MB/sec execute 446 sec latency 1091.599 ms 2023-10-16T19:52:14.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3876 0.04 MB/sec execute 447 sec latency 527.047 ms 2023-10-16T19:52:15.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3878 0.04 MB/sec execute 448 sec latency 1253.558 ms 2023-10-16T19:52:16.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3882 0.04 MB/sec execute 449 sec latency 561.565 ms 2023-10-16T19:52:17.285 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3884 0.04 MB/sec execute 450 sec latency 465.613 ms 2023-10-16T19:52:18.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3896 0.04 MB/sec execute 451 sec latency 542.935 ms 2023-10-16T19:52:18.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:52:18.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:52:19.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3897 0.04 MB/sec execute 452 sec latency 997.242 ms 2023-10-16T19:52:20.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3898 0.04 MB/sec execute 453 sec latency 840.091 ms 2023-10-16T19:52:21.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3901 0.04 MB/sec execute 454 sec latency 1382.333 ms 2023-10-16T19:52:22.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3914 0.04 MB/sec execute 455 sec latency 212.767 ms 2023-10-16T19:52:23.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3915 0.04 MB/sec execute 456 sec latency 1136.631 ms 2023-10-16T19:52:24.286 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3919 0.04 MB/sec execute 457 sec latency 406.144 ms 2023-10-16T19:52:25.287 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3922 0.04 MB/sec execute 458 sec latency 590.623 ms 2023-10-16T19:52:26.287 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3926 0.04 MB/sec execute 459 sec latency 396.539 ms 2023-10-16T19:52:27.287 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3928 0.04 MB/sec execute 460 sec latency 614.677 ms 2023-10-16T19:52:28.287 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3932 0.04 MB/sec execute 461 sec latency 361.695 ms 2023-10-16T19:52:29.287 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3935 0.04 MB/sec execute 462 sec latency 794.373 ms 2023-10-16T19:52:30.287 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3937 0.04 MB/sec execute 463 sec latency 628.236 ms 2023-10-16T19:52:31.288 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3938 0.04 MB/sec execute 464 sec latency 600.568 ms 2023-10-16T19:52:32.288 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3939 0.04 MB/sec execute 465 sec latency 906.561 ms 2023-10-16T19:52:33.288 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3943 0.04 MB/sec execute 466 sec latency 914.190 ms 2023-10-16T19:52:34.288 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3944 0.04 MB/sec execute 467 sec latency 805.025 ms 2023-10-16T19:52:35.288 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3948 0.04 MB/sec execute 468 sec latency 867.797 ms 2023-10-16T19:52:36.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3951 0.04 MB/sec execute 469 sec latency 860.790 ms 2023-10-16T19:52:37.288 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3954 0.04 MB/sec execute 470 sec latency 652.934 ms 2023-10-16T19:52:38.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3958 0.04 MB/sec execute 471 sec latency 355.421 ms 2023-10-16T19:52:39.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3962 0.04 MB/sec execute 472 sec latency 597.366 ms 2023-10-16T19:52:40.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3965 0.04 MB/sec execute 473 sec latency 441.546 ms 2023-10-16T19:52:41.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3968 0.04 MB/sec execute 474 sec latency 626.672 ms 2023-10-16T19:52:42.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3973 0.04 MB/sec execute 475 sec latency 363.862 ms 2023-10-16T19:52:43.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3975 0.04 MB/sec execute 476 sec latency 426.801 ms 2023-10-16T19:52:44.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3979 0.04 MB/sec execute 477 sec latency 612.884 ms 2023-10-16T19:52:45.289 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3983 0.04 MB/sec execute 478 sec latency 437.048 ms 2023-10-16T19:52:46.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3985 0.04 MB/sec execute 479 sec latency 710.562 ms 2023-10-16T19:52:47.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3990 0.04 MB/sec execute 480 sec latency 374.531 ms 2023-10-16T19:52:48.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3993 0.04 MB/sec execute 481 sec latency 610.413 ms 2023-10-16T19:52:48.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:52:48.751 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:52:49.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3998 0.04 MB/sec execute 482 sec latency 342.336 ms 2023-10-16T19:52:50.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 3999 0.04 MB/sec execute 483 sec latency 590.999 ms 2023-10-16T19:52:51.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4004 0.04 MB/sec execute 484 sec latency 627.715 ms 2023-10-16T19:52:52.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4006 0.04 MB/sec execute 485 sec latency 403.516 ms 2023-10-16T19:52:53.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4010 0.04 MB/sec execute 486 sec latency 586.011 ms 2023-10-16T19:52:54.290 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4014 0.04 MB/sec execute 487 sec latency 361.017 ms 2023-10-16T19:52:55.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4018 0.04 MB/sec execute 488 sec latency 598.061 ms 2023-10-16T19:52:56.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4022 0.04 MB/sec execute 489 sec latency 364.184 ms 2023-10-16T19:52:57.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4025 0.04 MB/sec execute 490 sec latency 600.364 ms 2023-10-16T19:52:58.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4027 0.03 MB/sec execute 491 sec latency 420.164 ms 2023-10-16T19:52:59.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4028 0.03 MB/sec execute 492 sec latency 1139.267 ms 2023-10-16T19:53:00.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4031 0.03 MB/sec execute 493 sec latency 940.752 ms 2023-10-16T19:53:01.291 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4032 0.03 MB/sec execute 494 sec latency 783.246 ms 2023-10-16T19:53:02.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4034 0.03 MB/sec execute 495 sec latency 1145.295 ms 2023-10-16T19:53:03.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4035 0.03 MB/sec execute 496 sec latency 860.470 ms 2023-10-16T19:53:04.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4039 0.03 MB/sec execute 497 sec latency 1148.061 ms 2023-10-16T19:53:05.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4044 0.03 MB/sec execute 498 sec latency 197.638 ms 2023-10-16T19:53:06.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4047 0.03 MB/sec execute 499 sec latency 817.186 ms 2023-10-16T19:53:07.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4058 0.03 MB/sec execute 500 sec latency 1211.162 ms 2023-10-16T19:53:08.292 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4059 0.03 MB/sec execute 501 sec latency 1148.348 ms 2023-10-16T19:53:09.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4062 0.03 MB/sec execute 502 sec latency 584.591 ms 2023-10-16T19:53:10.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4067 0.03 MB/sec execute 503 sec latency 269.719 ms 2023-10-16T19:53:11.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4071 0.03 MB/sec execute 504 sec latency 522.224 ms 2023-10-16T19:53:12.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4081 0.03 MB/sec execute 505 sec latency 1156.489 ms 2023-10-16T19:53:12.300 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:13:11.861 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.309 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:13:11.870 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.419 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:13:11.967 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.423 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:13:11.971 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.428 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:13:11.976 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.434 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:13:11.983 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.527 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:13:12.076 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.564 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:13:12.124 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:12.570 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:13:12.118 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:53:13.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4082 0.03 MB/sec execute 506 sec latency 984.760 ms 2023-10-16T19:53:14.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4085 0.03 MB/sec execute 507 sec latency 1155.220 ms 2023-10-16T19:53:15.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4091 0.03 MB/sec execute 508 sec latency 728.010 ms 2023-10-16T19:53:16.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4094 0.03 MB/sec execute 509 sec latency 543.110 ms 2023-10-16T19:53:17.293 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4099 0.03 MB/sec execute 510 sec latency 487.192 ms 2023-10-16T19:53:18.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4103 0.03 MB/sec execute 511 sec latency 384.337 ms 2023-10-16T19:53:18.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:53:18.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:53:19.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4107 0.03 MB/sec execute 512 sec latency 425.367 ms 2023-10-16T19:53:20.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4111 0.03 MB/sec execute 513 sec latency 534.745 ms 2023-10-16T19:53:21.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4115 0.03 MB/sec execute 514 sec latency 482.403 ms 2023-10-16T19:53:22.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4117 0.03 MB/sec execute 515 sec latency 501.495 ms 2023-10-16T19:53:23.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4123 0.03 MB/sec execute 516 sec latency 539.232 ms 2023-10-16T19:53:24.294 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4127 0.03 MB/sec execute 517 sec latency 424.408 ms 2023-10-16T19:53:25.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4130 0.03 MB/sec execute 518 sec latency 451.716 ms 2023-10-16T19:53:26.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4135 0.03 MB/sec execute 519 sec latency 439.999 ms 2023-10-16T19:53:27.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4139 0.03 MB/sec execute 520 sec latency 384.569 ms 2023-10-16T19:53:28.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4144 0.03 MB/sec execute 521 sec latency 436.924 ms 2023-10-16T19:53:29.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4148 0.03 MB/sec execute 522 sec latency 430.116 ms 2023-10-16T19:53:30.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4153 0.03 MB/sec execute 523 sec latency 383.613 ms 2023-10-16T19:53:31.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4156 0.03 MB/sec execute 524 sec latency 573.506 ms 2023-10-16T19:53:32.295 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4160 0.03 MB/sec execute 525 sec latency 516.963 ms 2023-10-16T19:53:33.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4162 0.03 MB/sec execute 526 sec latency 456.173 ms 2023-10-16T19:53:34.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4167 0.03 MB/sec execute 527 sec latency 584.919 ms 2023-10-16T19:53:35.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4171 0.03 MB/sec execute 528 sec latency 426.784 ms 2023-10-16T19:53:36.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4173 0.03 MB/sec execute 529 sec latency 484.725 ms 2023-10-16T19:53:37.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4176 0.03 MB/sec execute 530 sec latency 1127.461 ms 2023-10-16T19:53:38.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4179 0.03 MB/sec execute 531 sec latency 1146.788 ms 2023-10-16T19:53:39.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4181 0.03 MB/sec execute 532 sec latency 684.983 ms 2023-10-16T19:53:40.296 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4184 0.03 MB/sec execute 533 sec latency 1654.101 ms 2023-10-16T19:53:41.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4186 0.03 MB/sec execute 534 sec latency 928.669 ms 2023-10-16T19:53:42.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4216 0.03 MB/sec execute 535 sec latency 1128.723 ms 2023-10-16T19:53:43.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4217 0.03 MB/sec execute 536 sec latency 1150.313 ms 2023-10-16T19:53:44.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4217 0.03 MB/sec execute 537 sec latency 1269.486 ms 2023-10-16T19:53:45.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4223 0.03 MB/sec execute 538 sec latency 1321.168 ms 2023-10-16T19:53:46.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4225 0.03 MB/sec execute 539 sec latency 503.792 ms 2023-10-16T19:53:47.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4226 0.03 MB/sec execute 540 sec latency 1119.687 ms 2023-10-16T19:53:48.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4233 0.03 MB/sec execute 541 sec latency 649.722 ms 2023-10-16T19:53:49.084 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:53:49.097 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:53:49.297 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4252 0.03 MB/sec execute 542 sec latency 412.919 ms 2023-10-16T19:53:50.298 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4254 0.03 MB/sec execute 543 sec latency 1046.976 ms 2023-10-16T19:53:51.298 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4257 0.03 MB/sec execute 544 sec latency 1090.302 ms 2023-10-16T19:53:52.298 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4272 0.03 MB/sec execute 545 sec latency 526.930 ms 2023-10-16T19:53:53.298 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4279 0.03 MB/sec execute 546 sec latency 337.738 ms 2023-10-16T19:53:54.298 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4282 0.03 MB/sec execute 547 sec latency 648.757 ms 2023-10-16T19:53:55.298 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4283 0.03 MB/sec execute 548 sec latency 941.311 ms 2023-10-16T19:53:56.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4304 0.03 MB/sec execute 549 sec latency 400.813 ms 2023-10-16T19:53:57.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4315 0.03 MB/sec execute 550 sec latency 327.091 ms 2023-10-16T19:53:58.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4315 0.03 MB/sec execute 551 sec latency 1151.737 ms 2023-10-16T19:53:59.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4317 0.03 MB/sec execute 552 sec latency 1357.415 ms 2023-10-16T19:54:00.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4336 0.03 MB/sec execute 553 sec latency 1042.679 ms 2023-10-16T19:54:01.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4344 0.03 MB/sec execute 554 sec latency 488.256 ms 2023-10-16T19:54:02.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4349 0.03 MB/sec execute 555 sec latency 324.391 ms 2023-10-16T19:54:03.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4350 0.03 MB/sec execute 556 sec latency 668.852 ms 2023-10-16T19:54:04.299 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4362 0.03 MB/sec execute 557 sec latency 686.278 ms 2023-10-16T19:54:05.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4382 0.03 MB/sec execute 558 sec latency 199.807 ms 2023-10-16T19:54:06.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4383 0.03 MB/sec execute 559 sec latency 741.140 ms 2023-10-16T19:54:07.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4384 0.03 MB/sec execute 560 sec latency 1156.712 ms 2023-10-16T19:54:08.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4386 0.03 MB/sec execute 561 sec latency 1157.616 ms 2023-10-16T19:54:09.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4388 0.03 MB/sec execute 562 sec latency 729.855 ms 2023-10-16T19:54:10.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4393 0.03 MB/sec execute 563 sec latency 1330.751 ms 2023-10-16T19:54:11.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4393 0.03 MB/sec execute 564 sec latency 1119.489 ms 2023-10-16T19:54:12.300 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4423 0.03 MB/sec execute 565 sec latency 1159.890 ms 2023-10-16T19:54:13.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4424 0.03 MB/sec execute 566 sec latency 1144.762 ms 2023-10-16T19:54:14.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4427 0.03 MB/sec execute 567 sec latency 1157.253 ms 2023-10-16T19:54:15.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4431 0.03 MB/sec execute 568 sec latency 468.637 ms 2023-10-16T19:54:16.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4432 0.03 MB/sec execute 569 sec latency 934.018 ms 2023-10-16T19:54:17.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4434 0.03 MB/sec execute 570 sec latency 1156.771 ms 2023-10-16T19:54:18.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4448 0.03 MB/sec execute 571 sec latency 394.810 ms 2023-10-16T19:54:19.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:54:19.285 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:54:19.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4450 0.03 MB/sec execute 572 sec latency 949.238 ms 2023-10-16T19:54:20.301 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4464 0.03 MB/sec execute 573 sec latency 1064.108 ms 2023-10-16T19:54:21.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4469 0.03 MB/sec execute 574 sec latency 369.130 ms 2023-10-16T19:54:22.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4473 0.03 MB/sec execute 575 sec latency 676.197 ms 2023-10-16T19:54:23.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4480 0.03 MB/sec execute 576 sec latency 753.986 ms 2023-10-16T19:54:24.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4493 0.03 MB/sec execute 577 sec latency 404.251 ms 2023-10-16T19:54:25.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4497 0.03 MB/sec execute 578 sec latency 491.524 ms 2023-10-16T19:54:26.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4498 0.03 MB/sec execute 579 sec latency 1124.933 ms 2023-10-16T19:54:27.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4499 0.03 MB/sec execute 580 sec latency 1067.369 ms 2023-10-16T19:54:28.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4501 0.03 MB/sec execute 581 sec latency 620.399 ms 2023-10-16T19:54:29.302 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4501 0.03 MB/sec execute 582 sec latency 1020.449 ms 2023-10-16T19:54:30.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4504 0.03 MB/sec execute 583 sec latency 1222.225 ms 2023-10-16T19:54:31.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4506 0.03 MB/sec execute 584 sec latency 691.812 ms 2023-10-16T19:54:32.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4511 0.03 MB/sec execute 585 sec latency 1136.457 ms 2023-10-16T19:54:33.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4526 0.03 MB/sec execute 586 sec latency 1178.031 ms 2023-10-16T19:54:34.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4533 0.03 MB/sec execute 587 sec latency 367.060 ms 2023-10-16T19:54:35.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4538 0.03 MB/sec execute 588 sec latency 492.185 ms 2023-10-16T19:54:36.303 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4540 0.03 MB/sec execute 589 sec latency 742.909 ms 2023-10-16T19:54:37.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4554 0.03 MB/sec execute 590 sec latency 396.417 ms 2023-10-16T19:54:38.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4563 0.03 MB/sec execute 591 sec latency 304.374 ms 2023-10-16T19:54:39.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4564 0.03 MB/sec execute 592 sec latency 1238.825 ms 2023-10-16T19:54:40.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4596 0.03 MB/sec execute 593 sec latency 393.323 ms 2023-10-16T19:54:41.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4597 0.03 MB/sec execute 594 sec latency 1143.078 ms 2023-10-16T19:54:42.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4602 0.03 MB/sec execute 595 sec latency 557.460 ms 2023-10-16T19:54:43.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4606 0.03 MB/sec execute 596 sec latency 1140.501 ms 2023-10-16T19:54:44.304 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4614 0.03 MB/sec execute 597 sec latency 538.737 ms 2023-10-16T19:54:45.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4614 0.03 MB/sec execute 598 sec latency 1431.111 ms 2023-10-16T19:54:46.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 4615 0.03 MB/sec execute 599 sec latency 1457.531 ms 2023-10-16T19:54:47.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 600 sec 2023-10-16T19:54:48.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 601 sec 2023-10-16T19:54:49.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 602 sec 2023-10-16T19:54:49.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:54:49.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:54:50.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 603 sec 2023-10-16T19:54:51.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 604 sec 2023-10-16T19:54:52.305 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 605 sec 2023-10-16T19:54:53.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 606 sec 2023-10-16T19:54:54.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 607 sec 2023-10-16T19:54:55.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 608 sec 2023-10-16T19:54:56.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 609 sec 2023-10-16T19:54:57.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 610 sec 2023-10-16T19:54:58.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 611 sec 2023-10-16T19:54:59.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 612 sec 2023-10-16T19:55:00.306 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 613 sec 2023-10-16T19:55:01.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 614 sec 2023-10-16T19:55:02.307 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 615 sec 2023-10-16T19:55:03.307 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 616 sec 2023-10-16T19:55:04.307 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 617 sec 2023-10-16T19:55:05.307 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 618 sec 2023-10-16T19:55:06.307 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 619 sec 2023-10-16T19:55:07.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 620 sec 2023-10-16T19:55:08.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 621 sec 2023-10-16T19:55:09.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 622 sec 2023-10-16T19:55:10.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 623 sec 2023-10-16T19:55:11.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 624 sec 2023-10-16T19:55:12.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 625 sec 2023-10-16T19:55:13.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 626 sec 2023-10-16T19:55:14.308 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 627 sec 2023-10-16T19:55:15.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 628 sec 2023-10-16T19:55:16.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 629 sec 2023-10-16T19:55:17.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 630 sec 2023-10-16T19:55:18.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 631 sec 2023-10-16T19:55:19.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 632 sec 2023-10-16T19:55:19.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:55:19.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:55:20.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 633 sec 2023-10-16T19:55:21.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 634 sec 2023-10-16T19:55:22.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 635 sec 2023-10-16T19:55:23.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 636 sec 2023-10-16T19:55:24.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 637 sec 2023-10-16T19:55:25.309 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 638 sec 2023-10-16T19:55:26.310 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 639 sec 2023-10-16T19:55:27.310 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 640 sec 2023-10-16T19:55:28.310 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 641 sec 2023-10-16T19:55:28.358 INFO:tasks.workunit.client.0.smithi057.stdout: 0 cleanup 641 sec 2023-10-16T19:55:28.359 INFO:tasks.workunit.client.0.smithi057.stdout: 2023-10-16T19:55:28.359 INFO:tasks.workunit.client.0.smithi057.stdout: Operation Count AvgLat MaxLat 2023-10-16T19:55:28.359 INFO:tasks.workunit.client.0.smithi057.stdout: ---------------------------------------- 2023-10-16T19:55:28.359 INFO:tasks.workunit.client.0.smithi057.stdout: NTCreateX 612 271.821 1001.702 2023-10-16T19:55:28.359 INFO:tasks.workunit.client.0.smithi057.stdout: Close 444 4.247 80.134 2023-10-16T19:55:28.360 INFO:tasks.workunit.client.0.smithi057.stdout: Rename 26 613.825 859.152 2023-10-16T19:55:28.360 INFO:tasks.workunit.client.0.smithi057.stdout: Unlink 123 306.798 633.124 2023-10-16T19:55:28.360 INFO:tasks.workunit.client.0.smithi057.stdout: Qpathinfo 577 197.861 831.370 2023-10-16T19:55:28.360 INFO:tasks.workunit.client.0.smithi057.stdout: Qfileinfo 97 3.679 18.210 2023-10-16T19:55:28.360 INFO:tasks.workunit.client.0.smithi057.stdout: Qfsinfo 101 32.912 172.954 2023-10-16T19:55:28.361 INFO:tasks.workunit.client.0.smithi057.stdout: Sfileinfo 50 82.588 424.988 2023-10-16T19:55:28.361 INFO:tasks.workunit.client.0.smithi057.stdout: Find 215 1157.475 1654.085 2023-10-16T19:55:28.361 INFO:tasks.workunit.client.0.smithi057.stdout: WriteX 303 11.693 29.170 2023-10-16T19:55:28.361 INFO:tasks.workunit.client.0.smithi057.stdout: ReadX 962 0.143 62.458 2023-10-16T19:55:28.361 INFO:tasks.workunit.client.0.smithi057.stdout: LockX 2 92.223 145.523 2023-10-16T19:55:28.362 INFO:tasks.workunit.client.0.smithi057.stdout: UnlockX 2 56.719 72.189 2023-10-16T19:55:28.362 INFO:tasks.workunit.client.0.smithi057.stdout: Flush 43 85.746 147.348 2023-10-16T19:55:28.362 INFO:tasks.workunit.client.0.smithi057.stdout: 2023-10-16T19:55:28.363 INFO:tasks.workunit.client.0.smithi057.stdout:Throughput 0.0319153 MB/sec 1 clients 1 procs max_latency=1654.101 ms 2023-10-16T19:55:28.363 INFO:tasks.workunit.client.0.smithi057.stderr:+ dbench 10 2023-10-16T19:55:28.363 INFO:tasks.workunit.client.0.smithi057.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-10-16T19:55:28.364 INFO:tasks.workunit.client.0.smithi057.stdout: 2023-10-16T19:55:28.364 INFO:tasks.workunit.client.0.smithi057.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-10-16T19:55:28.368 INFO:tasks.workunit.client.0.smithi057.stdout:9 of 10 processes prepared for launch 0 sec 2023-10-16T19:55:28.468 INFO:tasks.workunit.client.0.smithi057.stdout:10 of 10 processes prepared for launch 0 sec 2023-10-16T19:55:28.469 INFO:tasks.workunit.client.0.smithi057.stdout:releasing clients 2023-10-16T19:55:29.468 INFO:tasks.workunit.client.0.smithi057.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.682 ms 2023-10-16T19:55:30.468 INFO:tasks.workunit.client.0.smithi057.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.848 ms 2023-10-16T19:55:31.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 2 0.00 MB/sec warmup 3 sec latency 2999.968 ms 2023-10-16T19:55:32.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 3 0.00 MB/sec warmup 4 sec latency 4000.109 ms 2023-10-16T19:55:33.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 4 0.00 MB/sec warmup 5 sec latency 5000.263 ms 2023-10-16T19:55:34.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 5 0.00 MB/sec warmup 6 sec latency 6000.357 ms 2023-10-16T19:55:35.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 6 0.00 MB/sec warmup 7 sec latency 7000.444 ms 2023-10-16T19:55:36.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 6 0.00 MB/sec warmup 8 sec latency 8000.566 ms 2023-10-16T19:55:37.469 INFO:tasks.workunit.client.0.smithi057.stdout: 0 8 0.00 MB/sec warmup 9 sec latency 910.996 ms 2023-10-16T19:55:38.469 INFO:tasks.workunit.client.0.smithi057.stdout: 1 9 0.01 MB/sec warmup 10 sec latency 1527.959 ms 2023-10-16T19:55:39.470 INFO:tasks.workunit.client.0.smithi057.stdout: 4 14 0.17 MB/sec warmup 11 sec latency 1281.366 ms 2023-10-16T19:55:40.470 INFO:tasks.workunit.client.0.smithi057.stdout: 5 18 0.34 MB/sec warmup 12 sec latency 1938.695 ms 2023-10-16T19:55:41.470 INFO:tasks.workunit.client.0.smithi057.stdout: 9 23 0.47 MB/sec warmup 13 sec latency 1896.774 ms 2023-10-16T19:55:42.470 INFO:tasks.workunit.client.0.smithi057.stdout: 9 28 0.64 MB/sec warmup 14 sec latency 2031.937 ms 2023-10-16T19:55:43.470 INFO:tasks.workunit.client.0.smithi057.stdout: 9 33 0.77 MB/sec warmup 15 sec latency 2072.666 ms 2023-10-16T19:55:44.470 INFO:tasks.workunit.client.0.smithi057.stdout: 10 37 0.85 MB/sec warmup 16 sec latency 2295.505 ms 2023-10-16T19:55:45.470 INFO:tasks.workunit.client.0.smithi057.stdout: 10 42 0.95 MB/sec warmup 17 sec latency 2413.114 ms 2023-10-16T19:55:46.470 INFO:tasks.workunit.client.0.smithi057.stdout: 10 47 1.06 MB/sec warmup 18 sec latency 2485.929 ms 2023-10-16T19:55:47.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 50 1.09 MB/sec warmup 19 sec latency 3063.301 ms 2023-10-16T19:55:48.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 54 1.15 MB/sec warmup 20 sec latency 4063.439 ms 2023-10-16T19:55:49.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 57 1.16 MB/sec warmup 21 sec latency 4311.086 ms 2023-10-16T19:55:49.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:55:49.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:55:50.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 62 1.22 MB/sec warmup 22 sec latency 4420.097 ms 2023-10-16T19:55:51.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 66 1.26 MB/sec warmup 23 sec latency 5056.692 ms 2023-10-16T19:55:52.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 70 1.30 MB/sec warmup 24 sec latency 5286.424 ms 2023-10-16T19:55:53.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 74 1.33 MB/sec warmup 25 sec latency 3741.842 ms 2023-10-16T19:55:54.471 INFO:tasks.workunit.client.0.smithi057.stdout: 10 78 1.37 MB/sec warmup 26 sec latency 4473.689 ms 2023-10-16T19:55:55.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 81 1.36 MB/sec warmup 27 sec latency 5473.780 ms 2023-10-16T19:55:56.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 84 1.37 MB/sec warmup 28 sec latency 6473.851 ms 2023-10-16T19:55:57.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 86 1.35 MB/sec warmup 29 sec latency 6893.753 ms 2023-10-16T19:55:58.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 93 1.41 MB/sec warmup 30 sec latency 4922.256 ms 2023-10-16T19:55:59.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 99 1.49 MB/sec warmup 31 sec latency 2416.844 ms 2023-10-16T19:56:00.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 103 1.51 MB/sec warmup 32 sec latency 2426.426 ms 2023-10-16T19:56:01.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 103 1.46 MB/sec warmup 33 sec latency 2591.224 ms 2023-10-16T19:56:02.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 103 1.42 MB/sec warmup 34 sec latency 3591.334 ms 2023-10-16T19:56:03.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 106 1.41 MB/sec warmup 35 sec latency 3990.857 ms 2023-10-16T19:56:04.472 INFO:tasks.workunit.client.0.smithi057.stdout: 10 111 1.43 MB/sec warmup 36 sec latency 4144.208 ms 2023-10-16T19:56:05.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 113 1.42 MB/sec warmup 37 sec latency 4346.996 ms 2023-10-16T19:56:06.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 115 1.39 MB/sec warmup 38 sec latency 2287.419 ms 2023-10-16T19:56:07.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 118 1.38 MB/sec warmup 39 sec latency 2741.223 ms 2023-10-16T19:56:08.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 120 1.37 MB/sec warmup 40 sec latency 2665.148 ms 2023-10-16T19:56:09.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 123 1.36 MB/sec warmup 41 sec latency 2399.286 ms 2023-10-16T19:56:10.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 127 1.36 MB/sec warmup 42 sec latency 2494.933 ms 2023-10-16T19:56:11.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 128 1.34 MB/sec warmup 43 sec latency 2206.374 ms 2023-10-16T19:56:12.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 130 1.32 MB/sec warmup 44 sec latency 2949.964 ms 2023-10-16T19:56:13.473 INFO:tasks.workunit.client.0.smithi057.stdout: 10 132 1.30 MB/sec warmup 45 sec latency 3555.315 ms 2023-10-16T19:56:14.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 134 1.29 MB/sec warmup 46 sec latency 3552.793 ms 2023-10-16T19:56:15.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 136 1.27 MB/sec warmup 47 sec latency 2365.083 ms 2023-10-16T19:56:16.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 139 1.26 MB/sec warmup 48 sec latency 2744.515 ms 2023-10-16T19:56:17.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 141 1.25 MB/sec warmup 49 sec latency 2442.525 ms 2023-10-16T19:56:18.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 143 1.24 MB/sec warmup 50 sec latency 2593.576 ms 2023-10-16T19:56:19.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 147 1.23 MB/sec warmup 51 sec latency 2672.663 ms 2023-10-16T19:56:19.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:19.873 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:20.474 INFO:tasks.workunit.client.0.smithi057.stdout: 10 149 1.22 MB/sec warmup 52 sec latency 2500.821 ms 2023-10-16T19:56:21.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 152 1.21 MB/sec warmup 53 sec latency 2530.174 ms 2023-10-16T19:56:22.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 152 1.19 MB/sec warmup 54 sec latency 2074.794 ms 2023-10-16T19:56:23.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 155 1.18 MB/sec warmup 55 sec latency 2354.813 ms 2023-10-16T19:56:24.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 159 1.19 MB/sec warmup 56 sec latency 2225.149 ms 2023-10-16T19:56:25.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 160 1.17 MB/sec warmup 57 sec latency 2066.988 ms 2023-10-16T19:56:26.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 162 1.16 MB/sec warmup 58 sec latency 3067.103 ms 2023-10-16T19:56:27.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 165 1.16 MB/sec warmup 59 sec latency 3894.048 ms 2023-10-16T19:56:28.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 167 1.15 MB/sec warmup 60 sec latency 2344.702 ms 2023-10-16T19:56:29.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 171 1.14 MB/sec warmup 61 sec latency 2529.128 ms 2023-10-16T19:56:29.793 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:16:29.353 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:29.806 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:16:29.366 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:29.906 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:16:29.455 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:29.915 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:16:29.463 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:29.915 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:16:29.464 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:29.924 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:16:29.472 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:30.041 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:16:29.602 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:30.046 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:16:29.595 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:30.056 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:16:29.604 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:56:30.475 INFO:tasks.workunit.client.0.smithi057.stdout: 10 173 1.14 MB/sec warmup 62 sec latency 2497.508 ms 2023-10-16T19:56:31.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 174 1.13 MB/sec warmup 63 sec latency 2535.152 ms 2023-10-16T19:56:32.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 179 1.13 MB/sec warmup 64 sec latency 2640.540 ms 2023-10-16T19:56:33.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 181 1.13 MB/sec warmup 65 sec latency 2498.298 ms 2023-10-16T19:56:34.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 182 1.12 MB/sec warmup 66 sec latency 2557.572 ms 2023-10-16T19:56:35.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 186 1.12 MB/sec warmup 67 sec latency 2968.159 ms 2023-10-16T19:56:36.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 189 1.12 MB/sec warmup 68 sec latency 2502.676 ms 2023-10-16T19:56:37.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 189 1.10 MB/sec warmup 69 sec latency 2744.118 ms 2023-10-16T19:56:38.476 INFO:tasks.workunit.client.0.smithi057.stdout: 10 193 1.10 MB/sec warmup 70 sec latency 2728.016 ms 2023-10-16T19:56:39.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 194 1.09 MB/sec warmup 71 sec latency 2726.428 ms 2023-10-16T19:56:40.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 196 1.08 MB/sec warmup 72 sec latency 2663.664 ms 2023-10-16T19:56:41.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 199 1.08 MB/sec warmup 73 sec latency 2573.867 ms 2023-10-16T19:56:42.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 201 1.07 MB/sec warmup 74 sec latency 2135.173 ms 2023-10-16T19:56:43.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 204 1.07 MB/sec warmup 75 sec latency 2347.996 ms 2023-10-16T19:56:44.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 206 1.07 MB/sec warmup 76 sec latency 2609.537 ms 2023-10-16T19:56:45.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 207 1.05 MB/sec warmup 77 sec latency 3363.330 ms 2023-10-16T19:56:46.477 INFO:tasks.workunit.client.0.smithi057.stdout: 10 211 1.06 MB/sec warmup 78 sec latency 2212.651 ms 2023-10-16T19:56:47.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 214 1.06 MB/sec warmup 79 sec latency 2495.470 ms 2023-10-16T19:56:48.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 215 1.05 MB/sec warmup 80 sec latency 2680.487 ms 2023-10-16T19:56:49.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 219 1.05 MB/sec warmup 81 sec latency 2742.061 ms 2023-10-16T19:56:50.009 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:50.019 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:50.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 223 1.05 MB/sec warmup 82 sec latency 2492.846 ms 2023-10-16T19:56:51.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 223 1.04 MB/sec warmup 83 sec latency 2279.285 ms 2023-10-16T19:56:52.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 227 1.04 MB/sec warmup 84 sec latency 2559.524 ms 2023-10-16T19:56:53.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 230 1.04 MB/sec warmup 85 sec latency 2649.609 ms 2023-10-16T19:56:54.478 INFO:tasks.workunit.client.0.smithi057.stdout: 10 231 1.03 MB/sec warmup 86 sec latency 2262.603 ms 2023-10-16T19:56:55.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 234 1.03 MB/sec warmup 87 sec latency 3001.048 ms 2023-10-16T19:56:56.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 237 1.03 MB/sec warmup 88 sec latency 3086.476 ms 2023-10-16T19:56:57.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 239 1.03 MB/sec warmup 89 sec latency 2250.169 ms 2023-10-16T19:56:58.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 241 1.02 MB/sec warmup 90 sec latency 2656.376 ms 2023-10-16T19:56:59.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 245 1.03 MB/sec warmup 91 sec latency 2695.979 ms 2023-10-16T19:57:00.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 246 1.02 MB/sec warmup 92 sec latency 3198.390 ms 2023-10-16T19:57:01.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 248 1.02 MB/sec warmup 93 sec latency 2736.925 ms 2023-10-16T19:57:02.479 INFO:tasks.workunit.client.0.smithi057.stdout: 10 252 1.02 MB/sec warmup 94 sec latency 2608.646 ms 2023-10-16T19:57:03.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 254 1.01 MB/sec warmup 95 sec latency 2518.304 ms 2023-10-16T19:57:04.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 255 1.01 MB/sec warmup 96 sec latency 3086.717 ms 2023-10-16T19:57:05.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 259 1.01 MB/sec warmup 97 sec latency 2677.071 ms 2023-10-16T19:57:06.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 261 1.01 MB/sec warmup 98 sec latency 2598.419 ms 2023-10-16T19:57:07.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 262 1.00 MB/sec warmup 99 sec latency 2627.317 ms 2023-10-16T19:57:08.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 266 1.00 MB/sec warmup 100 sec latency 2975.778 ms 2023-10-16T19:57:09.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 268 1.00 MB/sec warmup 101 sec latency 2778.692 ms 2023-10-16T19:57:10.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 270 1.00 MB/sec warmup 102 sec latency 2643.402 ms 2023-10-16T19:57:11.480 INFO:tasks.workunit.client.0.smithi057.stdout: 10 272 0.99 MB/sec warmup 103 sec latency 3048.389 ms 2023-10-16T19:57:12.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 275 0.99 MB/sec warmup 104 sec latency 4048.493 ms 2023-10-16T19:57:13.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 276 0.99 MB/sec warmup 105 sec latency 5048.605 ms 2023-10-16T19:57:14.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 278 0.98 MB/sec warmup 106 sec latency 6048.686 ms 2023-10-16T19:57:15.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 281 0.98 MB/sec warmup 107 sec latency 7048.796 ms 2023-10-16T19:57:16.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 283 0.98 MB/sec warmup 108 sec latency 7062.931 ms 2023-10-16T19:57:17.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 286 0.98 MB/sec warmup 109 sec latency 3289.088 ms 2023-10-16T19:57:18.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 287 0.97 MB/sec warmup 110 sec latency 2485.396 ms 2023-10-16T19:57:19.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 290 0.97 MB/sec warmup 111 sec latency 2872.469 ms 2023-10-16T19:57:20.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:20.196 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:20.481 INFO:tasks.workunit.client.0.smithi057.stdout: 10 293 0.97 MB/sec warmup 112 sec latency 2616.524 ms 2023-10-16T19:57:21.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 293 0.96 MB/sec warmup 113 sec latency 2092.558 ms 2023-10-16T19:57:22.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 299 0.97 MB/sec warmup 114 sec latency 2537.200 ms 2023-10-16T19:57:23.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 301 0.97 MB/sec warmup 115 sec latency 2129.388 ms 2023-10-16T19:57:24.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 302 0.96 MB/sec warmup 116 sec latency 2300.203 ms 2023-10-16T19:57:25.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 304 0.96 MB/sec warmup 117 sec latency 2875.691 ms 2023-10-16T19:57:26.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 307 0.96 MB/sec warmup 118 sec latency 3258.021 ms 2023-10-16T19:57:27.482 INFO:tasks.workunit.client.0.smithi057.stdout: 10 309 0.95 MB/sec warmup 119 sec latency 2834.830 ms 2023-10-16T19:57:29.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 313 0.45 MB/sec execute 1 sec latency 2919.939 ms 2023-10-16T19:57:30.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 316 0.75 MB/sec execute 2 sec latency 2410.130 ms 2023-10-16T19:57:31.208 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:17:30.768 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.216 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:17:30.776 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.298 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:17:30.859 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.322 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:17:30.869 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.327 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:17:30.875 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.334 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:17:30.882 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.338 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:17:30.886 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.408 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:17:30.956 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.418 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:17:30.967 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T19:57:31.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 319 0.76 MB/sec execute 3 sec latency 3019.713 ms 2023-10-16T19:57:32.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 320 0.59 MB/sec execute 4 sec latency 2275.320 ms 2023-10-16T19:57:33.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 323 0.66 MB/sec execute 5 sec latency 2256.400 ms 2023-10-16T19:57:34.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 326 0.77 MB/sec execute 6 sec latency 2477.737 ms 2023-10-16T19:57:35.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 328 0.70 MB/sec execute 7 sec latency 2543.351 ms 2023-10-16T19:57:36.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 329 0.66 MB/sec execute 8 sec latency 2573.428 ms 2023-10-16T19:57:37.483 INFO:tasks.workunit.client.0.smithi057.stdout: 10 333 0.72 MB/sec execute 9 sec latency 2457.790 ms 2023-10-16T19:57:38.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 335 0.72 MB/sec execute 10 sec latency 2160.798 ms 2023-10-16T19:57:39.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 337 0.69 MB/sec execute 11 sec latency 2758.640 ms 2023-10-16T19:57:40.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 340 0.70 MB/sec execute 12 sec latency 2521.756 ms 2023-10-16T19:57:41.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 341 0.70 MB/sec execute 13 sec latency 2670.437 ms 2023-10-16T19:57:42.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 344 0.71 MB/sec execute 14 sec latency 2575.998 ms 2023-10-16T19:57:43.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 346 0.69 MB/sec execute 15 sec latency 2683.002 ms 2023-10-16T19:57:44.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 348 0.67 MB/sec execute 16 sec latency 2374.729 ms 2023-10-16T19:57:45.484 INFO:tasks.workunit.client.0.smithi057.stdout: 10 352 0.73 MB/sec execute 17 sec latency 2411.627 ms 2023-10-16T19:57:46.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 355 0.73 MB/sec execute 18 sec latency 2280.172 ms 2023-10-16T19:57:47.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 356 0.71 MB/sec execute 19 sec latency 2434.862 ms 2023-10-16T19:57:48.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 360 0.74 MB/sec execute 20 sec latency 2614.259 ms 2023-10-16T19:57:49.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 362 0.74 MB/sec execute 21 sec latency 2635.572 ms 2023-10-16T19:57:50.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 364 0.74 MB/sec execute 22 sec latency 2392.729 ms 2023-10-16T19:57:50.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:50.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:51.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 368 0.75 MB/sec execute 23 sec latency 2710.696 ms 2023-10-16T19:57:52.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 370 0.76 MB/sec execute 24 sec latency 2874.060 ms 2023-10-16T19:57:53.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 372 0.75 MB/sec execute 25 sec latency 2549.980 ms 2023-10-16T19:57:54.485 INFO:tasks.workunit.client.0.smithi057.stdout: 10 375 0.76 MB/sec execute 26 sec latency 2578.748 ms 2023-10-16T19:57:55.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 377 0.76 MB/sec execute 27 sec latency 2694.339 ms 2023-10-16T19:57:56.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 379 0.74 MB/sec execute 28 sec latency 2682.920 ms 2023-10-16T19:57:57.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 383 0.76 MB/sec execute 29 sec latency 2813.452 ms 2023-10-16T19:57:58.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 385 0.76 MB/sec execute 30 sec latency 2521.341 ms 2023-10-16T19:57:59.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 386 0.75 MB/sec execute 31 sec latency 2676.970 ms 2023-10-16T19:58:00.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 391 0.77 MB/sec execute 32 sec latency 2875.919 ms 2023-10-16T19:58:01.486 INFO:tasks.workunit.client.0.smithi057.stdout: 10 393 0.78 MB/sec execute 33 sec latency 2404.763 ms 2023-10-16T19:58:02.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 394 0.76 MB/sec execute 34 sec latency 2140.094 ms 2023-10-16T19:58:03.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 397 0.76 MB/sec execute 35 sec latency 2785.234 ms 2023-10-16T19:58:04.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 401 0.78 MB/sec execute 36 sec latency 2807.272 ms 2023-10-16T19:58:05.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 402 0.77 MB/sec execute 37 sec latency 2866.999 ms 2023-10-16T19:58:06.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 403 0.75 MB/sec execute 38 sec latency 2757.181 ms 2023-10-16T19:58:07.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 407 0.77 MB/sec execute 39 sec latency 2942.855 ms 2023-10-16T19:58:08.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 410 0.78 MB/sec execute 40 sec latency 2715.459 ms 2023-10-16T19:58:09.487 INFO:tasks.workunit.client.0.smithi057.stdout: 10 410 0.76 MB/sec execute 41 sec latency 2523.174 ms 2023-10-16T19:58:10.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 414 0.76 MB/sec execute 42 sec latency 2802.597 ms 2023-10-16T19:58:11.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 418 0.78 MB/sec execute 43 sec latency 2700.478 ms 2023-10-16T19:58:12.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 418 0.77 MB/sec execute 44 sec latency 2191.801 ms 2023-10-16T19:58:13.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 419 0.75 MB/sec execute 45 sec latency 2807.463 ms 2023-10-16T19:58:14.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 424 0.77 MB/sec execute 46 sec latency 2821.573 ms 2023-10-16T19:58:15.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 426 0.77 MB/sec execute 47 sec latency 3050.100 ms 2023-10-16T19:58:16.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 426 0.76 MB/sec execute 48 sec latency 2568.173 ms 2023-10-16T19:58:17.488 INFO:tasks.workunit.client.0.smithi057.stdout: 10 430 0.76 MB/sec execute 49 sec latency 2988.835 ms 2023-10-16T19:58:18.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 434 0.78 MB/sec execute 50 sec latency 3014.219 ms 2023-10-16T19:58:19.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 434 0.76 MB/sec execute 51 sec latency 2359.535 ms 2023-10-16T19:58:20.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 435 0.75 MB/sec execute 52 sec latency 2954.860 ms 2023-10-16T19:58:20.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:20.663 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:21.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 441 0.77 MB/sec execute 53 sec latency 3088.002 ms 2023-10-16T19:58:22.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 442 0.77 MB/sec execute 54 sec latency 1894.094 ms 2023-10-16T19:58:23.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 443 0.76 MB/sec execute 55 sec latency 2695.433 ms 2023-10-16T19:58:24.489 INFO:tasks.workunit.client.0.smithi057.stdout: 10 445 0.75 MB/sec execute 56 sec latency 3105.854 ms 2023-10-16T19:58:25.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 449 0.77 MB/sec execute 57 sec latency 3398.510 ms 2023-10-16T19:58:26.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 450 0.76 MB/sec execute 58 sec latency 2253.297 ms 2023-10-16T19:58:27.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 452 0.76 MB/sec execute 59 sec latency 2622.005 ms 2023-10-16T19:58:28.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 455 0.76 MB/sec execute 60 sec latency 3060.324 ms 2023-10-16T19:58:29.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 457 0.76 MB/sec execute 61 sec latency 3741.164 ms 2023-10-16T19:58:30.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 459 0.76 MB/sec execute 62 sec latency 3863.364 ms 2023-10-16T19:58:31.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 461 0.75 MB/sec execute 63 sec latency 2957.188 ms 2023-10-16T19:58:32.490 INFO:tasks.workunit.client.0.smithi057.stdout: 10 464 0.76 MB/sec execute 64 sec latency 3071.128 ms 2023-10-16T19:58:33.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 465 0.76 MB/sec execute 65 sec latency 3170.466 ms 2023-10-16T19:58:34.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 467 0.75 MB/sec execute 66 sec latency 3386.728 ms 2023-10-16T19:58:35.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 470 0.75 MB/sec execute 67 sec latency 3128.826 ms 2023-10-16T19:58:36.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 473 0.76 MB/sec execute 68 sec latency 2762.604 ms 2023-10-16T19:58:37.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 474 0.75 MB/sec execute 69 sec latency 2759.752 ms 2023-10-16T19:58:38.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 476 0.75 MB/sec execute 70 sec latency 2995.923 ms 2023-10-16T19:58:39.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 479 0.75 MB/sec execute 71 sec latency 3153.660 ms 2023-10-16T19:58:40.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 481 0.75 MB/sec execute 72 sec latency 3290.251 ms 2023-10-16T19:58:41.491 INFO:tasks.workunit.client.0.smithi057.stdout: 10 482 0.75 MB/sec execute 73 sec latency 3130.258 ms 2023-10-16T19:58:42.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 484 0.74 MB/sec execute 74 sec latency 3542.400 ms 2023-10-16T19:58:43.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 487 0.75 MB/sec execute 75 sec latency 3102.242 ms 2023-10-16T19:58:44.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 490 0.75 MB/sec execute 76 sec latency 3008.871 ms 2023-10-16T19:58:45.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 491 0.74 MB/sec execute 77 sec latency 2820.703 ms 2023-10-16T19:58:46.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 493 0.74 MB/sec execute 78 sec latency 3168.232 ms 2023-10-16T19:58:47.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 496 0.74 MB/sec execute 79 sec latency 3239.041 ms 2023-10-16T19:58:48.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 497 0.74 MB/sec execute 80 sec latency 2646.424 ms 2023-10-16T19:58:49.492 INFO:tasks.workunit.client.0.smithi057.stdout: 10 499 0.74 MB/sec execute 81 sec latency 2853.591 ms 2023-10-16T19:58:50.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 502 0.74 MB/sec execute 82 sec latency 3042.980 ms 2023-10-16T19:58:50.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:50.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:51.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 503 0.73 MB/sec execute 83 sec latency 2549.329 ms 2023-10-16T19:58:52.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 506 0.73 MB/sec execute 84 sec latency 2665.390 ms 2023-10-16T19:58:53.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 509 0.74 MB/sec execute 85 sec latency 2254.549 ms 2023-10-16T19:58:54.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 511 0.74 MB/sec execute 86 sec latency 2445.062 ms 2023-10-16T19:58:55.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 514 0.75 MB/sec execute 87 sec latency 3162.936 ms 2023-10-16T19:58:56.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 516 0.74 MB/sec execute 88 sec latency 2959.046 ms 2023-10-16T19:58:57.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 518 0.74 MB/sec execute 89 sec latency 2590.885 ms 2023-10-16T19:58:58.493 INFO:tasks.workunit.client.0.smithi057.stdout: 10 524 0.75 MB/sec execute 90 sec latency 2023.821 ms 2023-10-16T19:58:59.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 529 0.75 MB/sec execute 91 sec latency 2409.936 ms 2023-10-16T19:59:00.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 534 0.77 MB/sec execute 92 sec latency 2439.389 ms 2023-10-16T19:59:01.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 538 0.79 MB/sec execute 93 sec latency 2480.146 ms 2023-10-16T19:59:02.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 544 0.80 MB/sec execute 94 sec latency 2371.684 ms 2023-10-16T19:59:03.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 549 0.82 MB/sec execute 95 sec latency 2634.670 ms 2023-10-16T19:59:04.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 553 0.82 MB/sec execute 96 sec latency 2143.575 ms 2023-10-16T19:59:05.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 557 0.82 MB/sec execute 97 sec latency 2571.566 ms 2023-10-16T19:59:06.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 562 0.82 MB/sec execute 98 sec latency 3356.746 ms 2023-10-16T19:59:07.494 INFO:tasks.workunit.client.0.smithi057.stdout: 10 572 0.83 MB/sec execute 99 sec latency 3164.509 ms 2023-10-16T19:59:08.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 579 0.85 MB/sec execute 100 sec latency 1194.315 ms 2023-10-16T19:59:09.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 584 0.86 MB/sec execute 101 sec latency 1528.908 ms 2023-10-16T19:59:10.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 588 0.88 MB/sec execute 102 sec latency 2529.023 ms 2023-10-16T19:59:11.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 593 0.89 MB/sec execute 103 sec latency 3088.385 ms 2023-10-16T19:59:12.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 594 0.89 MB/sec execute 104 sec latency 3268.928 ms 2023-10-16T19:59:13.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 596 0.88 MB/sec execute 105 sec latency 3974.400 ms 2023-10-16T19:59:14.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 596 0.87 MB/sec execute 106 sec latency 4561.466 ms 2023-10-16T19:59:15.495 INFO:tasks.workunit.client.0.smithi057.stdout: 10 598 0.87 MB/sec execute 107 sec latency 4270.378 ms 2023-10-16T19:59:16.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 599 0.86 MB/sec execute 108 sec latency 3193.197 ms 2023-10-16T19:59:17.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 600 0.85 MB/sec execute 109 sec latency 3150.707 ms 2023-10-16T19:59:18.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 601 0.84 MB/sec execute 110 sec latency 3751.355 ms 2023-10-16T19:59:19.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 603 0.84 MB/sec execute 111 sec latency 4024.446 ms 2023-10-16T19:59:20.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 608 0.84 MB/sec execute 112 sec latency 4354.173 ms 2023-10-16T19:59:21.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:21.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:21.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 609 0.83 MB/sec execute 113 sec latency 3527.630 ms 2023-10-16T19:59:22.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 610 0.82 MB/sec execute 114 sec latency 4527.745 ms 2023-10-16T19:59:23.496 INFO:tasks.workunit.client.0.smithi057.stdout: 10 612 0.82 MB/sec execute 115 sec latency 5069.599 ms 2023-10-16T19:59:24.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 614 0.81 MB/sec execute 116 sec latency 4129.470 ms 2023-10-16T19:59:25.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 618 0.81 MB/sec execute 117 sec latency 3724.853 ms 2023-10-16T19:59:26.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 622 0.80 MB/sec execute 118 sec latency 3627.518 ms 2023-10-16T19:59:27.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 623 0.80 MB/sec execute 119 sec latency 4371.348 ms 2023-10-16T19:59:28.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 627 0.80 MB/sec execute 120 sec latency 4496.535 ms 2023-10-16T19:59:29.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 632 0.80 MB/sec execute 121 sec latency 5215.754 ms 2023-10-16T19:59:30.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 637 0.79 MB/sec execute 122 sec latency 3300.290 ms 2023-10-16T19:59:31.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 638 0.78 MB/sec execute 123 sec latency 4300.378 ms 2023-10-16T19:59:32.497 INFO:tasks.workunit.client.0.smithi057.stdout: 10 640 0.78 MB/sec execute 124 sec latency 4431.665 ms 2023-10-16T19:59:33.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 641 0.77 MB/sec execute 125 sec latency 3813.554 ms 2023-10-16T19:59:34.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 641 0.77 MB/sec execute 126 sec latency 3713.582 ms 2023-10-16T19:59:35.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 642 0.76 MB/sec execute 127 sec latency 4117.249 ms 2023-10-16T19:59:36.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 642 0.75 MB/sec execute 128 sec latency 4138.489 ms 2023-10-16T19:59:37.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 643 0.75 MB/sec execute 129 sec latency 4670.290 ms 2023-10-16T19:59:38.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 643 0.74 MB/sec execute 130 sec latency 4893.762 ms 2023-10-16T19:59:39.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 644 0.74 MB/sec execute 131 sec latency 4348.236 ms 2023-10-16T19:59:40.498 INFO:tasks.workunit.client.0.smithi057.stdout: 10 645 0.73 MB/sec execute 132 sec latency 4742.592 ms 2023-10-16T19:59:41.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 646 0.72 MB/sec execute 133 sec latency 4651.125 ms 2023-10-16T19:59:42.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 647 0.72 MB/sec execute 134 sec latency 4188.638 ms 2023-10-16T19:59:43.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 647 0.71 MB/sec execute 135 sec latency 3189.592 ms 2023-10-16T19:59:44.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 648 0.71 MB/sec execute 136 sec latency 3473.310 ms 2023-10-16T19:59:45.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 650 0.71 MB/sec execute 137 sec latency 3691.687 ms 2023-10-16T19:59:46.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 654 0.70 MB/sec execute 138 sec latency 2110.464 ms 2023-10-16T19:59:47.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 655 0.70 MB/sec execute 139 sec latency 2419.055 ms 2023-10-16T19:59:48.499 INFO:tasks.workunit.client.0.smithi057.stdout: 10 657 0.69 MB/sec execute 140 sec latency 3419.157 ms 2023-10-16T19:59:49.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 659 0.69 MB/sec execute 141 sec latency 3912.089 ms 2023-10-16T19:59:50.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 661 0.68 MB/sec execute 142 sec latency 4417.317 ms 2023-10-16T19:59:51.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:51.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:51.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 662 0.68 MB/sec execute 143 sec latency 4370.646 ms 2023-10-16T19:59:52.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 663 0.67 MB/sec execute 144 sec latency 4416.977 ms 2023-10-16T19:59:53.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 665 0.67 MB/sec execute 145 sec latency 4585.985 ms 2023-10-16T19:59:54.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 666 0.67 MB/sec execute 146 sec latency 4475.598 ms 2023-10-16T19:59:55.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 669 0.66 MB/sec execute 147 sec latency 3422.107 ms 2023-10-16T19:59:56.500 INFO:tasks.workunit.client.0.smithi057.stdout: 10 672 0.66 MB/sec execute 148 sec latency 4358.127 ms 2023-10-16T19:59:57.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 674 0.65 MB/sec execute 149 sec latency 4046.019 ms 2023-10-16T19:59:58.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 676 0.65 MB/sec execute 150 sec latency 4883.013 ms 2023-10-16T19:59:59.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 678 0.65 MB/sec execute 151 sec latency 4405.340 ms 2023-10-16T20:00:00.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 678 0.64 MB/sec execute 152 sec latency 3810.149 ms 2023-10-16T20:00:01.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 679 0.64 MB/sec execute 153 sec latency 3819.973 ms 2023-10-16T20:00:02.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 681 0.63 MB/sec execute 154 sec latency 3966.467 ms 2023-10-16T20:00:03.501 INFO:tasks.workunit.client.0.smithi057.stdout: 10 683 0.63 MB/sec execute 155 sec latency 4143.726 ms 2023-10-16T20:00:04.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 684 0.63 MB/sec execute 156 sec latency 3503.856 ms 2023-10-16T20:00:05.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 685 0.62 MB/sec execute 157 sec latency 4342.331 ms 2023-10-16T20:00:06.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 686 0.62 MB/sec execute 158 sec latency 4250.899 ms 2023-10-16T20:00:07.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 688 0.61 MB/sec execute 159 sec latency 4320.605 ms 2023-10-16T20:00:08.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 689 0.61 MB/sec execute 160 sec latency 4626.770 ms 2023-10-16T20:00:09.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 691 0.61 MB/sec execute 161 sec latency 4041.537 ms 2023-10-16T20:00:10.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 694 0.60 MB/sec execute 162 sec latency 4212.782 ms 2023-10-16T20:00:11.502 INFO:tasks.workunit.client.0.smithi057.stdout: 10 696 0.60 MB/sec execute 163 sec latency 1551.562 ms 2023-10-16T20:00:12.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 698 0.60 MB/sec execute 164 sec latency 2448.445 ms 2023-10-16T20:00:13.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 699 0.59 MB/sec execute 165 sec latency 2521.258 ms 2023-10-16T20:00:14.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 700 0.59 MB/sec execute 166 sec latency 3197.329 ms 2023-10-16T20:00:15.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 703 0.59 MB/sec execute 167 sec latency 3229.017 ms 2023-10-16T20:00:16.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 705 0.58 MB/sec execute 168 sec latency 3178.091 ms 2023-10-16T20:00:17.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 706 0.58 MB/sec execute 169 sec latency 2066.024 ms 2023-10-16T20:00:18.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 708 0.58 MB/sec execute 170 sec latency 2919.898 ms 2023-10-16T20:00:19.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 710 0.57 MB/sec execute 171 sec latency 3493.233 ms 2023-10-16T20:00:20.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 713 0.57 MB/sec execute 172 sec latency 2989.283 ms 2023-10-16T20:00:21.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:00:21.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:00:21.503 INFO:tasks.workunit.client.0.smithi057.stdout: 10 715 0.57 MB/sec execute 173 sec latency 3135.981 ms 2023-10-16T20:00:22.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 717 0.57 MB/sec execute 174 sec latency 3526.503 ms 2023-10-16T20:00:23.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 719 0.56 MB/sec execute 175 sec latency 1609.688 ms 2023-10-16T20:00:24.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 722 0.56 MB/sec execute 176 sec latency 2215.794 ms 2023-10-16T20:00:25.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 724 0.56 MB/sec execute 177 sec latency 3215.899 ms 2023-10-16T20:00:26.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 727 0.55 MB/sec execute 178 sec latency 3747.759 ms 2023-10-16T20:00:27.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 729 0.55 MB/sec execute 179 sec latency 3149.579 ms 2023-10-16T20:00:28.504 INFO:tasks.workunit.client.0.smithi057.stdout: 10 731 0.55 MB/sec execute 180 sec latency 2846.839 ms 2023-10-16T20:00:29.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 732 0.55 MB/sec execute 181 sec latency 3846.967 ms 2023-10-16T20:00:30.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 734 0.54 MB/sec execute 182 sec latency 4746.444 ms 2023-10-16T20:00:31.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 735 0.54 MB/sec execute 183 sec latency 4452.053 ms 2023-10-16T20:00:32.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 737 0.54 MB/sec execute 184 sec latency 3751.497 ms 2023-10-16T20:00:33.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 737 0.53 MB/sec execute 185 sec latency 2902.974 ms 2023-10-16T20:00:34.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 738 0.53 MB/sec execute 186 sec latency 3793.551 ms 2023-10-16T20:00:35.505 INFO:tasks.workunit.client.0.smithi057.stdout: 10 740 0.53 MB/sec execute 187 sec latency 4405.229 ms 2023-10-16T20:00:36.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 743 0.53 MB/sec execute 188 sec latency 4577.184 ms 2023-10-16T20:00:37.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 745 0.52 MB/sec execute 189 sec latency 4403.840 ms 2023-10-16T20:00:38.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 748 0.52 MB/sec execute 190 sec latency 4068.107 ms 2023-10-16T20:00:39.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 749 0.52 MB/sec execute 191 sec latency 3568.969 ms 2023-10-16T20:00:40.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 750 0.52 MB/sec execute 192 sec latency 3799.666 ms 2023-10-16T20:00:41.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 751 0.51 MB/sec execute 193 sec latency 4208.603 ms 2023-10-16T20:00:42.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 754 0.51 MB/sec execute 194 sec latency 3853.766 ms 2023-10-16T20:00:43.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 756 0.51 MB/sec execute 195 sec latency 3649.032 ms 2023-10-16T20:00:44.506 INFO:tasks.workunit.client.0.smithi057.stdout: 10 759 0.51 MB/sec execute 196 sec latency 2938.697 ms 2023-10-16T20:00:45.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 762 0.50 MB/sec execute 197 sec latency 3530.752 ms 2023-10-16T20:00:46.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 763 0.50 MB/sec execute 198 sec latency 1295.237 ms 2023-10-16T20:00:47.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 764 0.50 MB/sec execute 199 sec latency 2231.453 ms 2023-10-16T20:00:48.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 766 0.50 MB/sec execute 200 sec latency 3191.623 ms 2023-10-16T20:00:49.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 767 0.49 MB/sec execute 201 sec latency 4089.418 ms 2023-10-16T20:00:50.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 769 0.49 MB/sec execute 202 sec latency 2929.976 ms 2023-10-16T20:00:51.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 772 0.49 MB/sec execute 203 sec latency 3486.981 ms 2023-10-16T20:00:51.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:00:51.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:00:52.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 774 0.49 MB/sec execute 204 sec latency 1868.811 ms 2023-10-16T20:00:53.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 775 0.49 MB/sec execute 205 sec latency 2868.885 ms 2023-10-16T20:00:54.507 INFO:tasks.workunit.client.0.smithi057.stdout: 10 778 0.48 MB/sec execute 206 sec latency 3025.545 ms 2023-10-16T20:00:55.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 780 0.48 MB/sec execute 207 sec latency 1896.639 ms 2023-10-16T20:00:56.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 782 0.48 MB/sec execute 208 sec latency 1997.273 ms 2023-10-16T20:00:57.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 784 0.48 MB/sec execute 209 sec latency 2867.681 ms 2023-10-16T20:00:58.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 787 0.48 MB/sec execute 210 sec latency 3254.304 ms 2023-10-16T20:00:59.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 790 0.47 MB/sec execute 211 sec latency 2639.632 ms 2023-10-16T20:01:00.508 INFO:tasks.workunit.client.0.smithi057.stdout: 10 793 0.47 MB/sec execute 212 sec latency 3639.748 ms 2023-10-16T20:01:01.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 795 0.47 MB/sec execute 213 sec latency 4132.694 ms 2023-10-16T20:01:02.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 796 0.47 MB/sec execute 214 sec latency 2590.599 ms 2023-10-16T20:01:03.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 797 0.47 MB/sec execute 215 sec latency 3590.716 ms 2023-10-16T20:01:04.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 799 0.46 MB/sec execute 216 sec latency 3672.913 ms 2023-10-16T20:01:05.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 800 0.46 MB/sec execute 217 sec latency 4074.786 ms 2023-10-16T20:01:06.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 801 0.46 MB/sec execute 218 sec latency 3956.535 ms 2023-10-16T20:01:07.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 802 0.46 MB/sec execute 219 sec latency 3918.272 ms 2023-10-16T20:01:08.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 803 0.46 MB/sec execute 220 sec latency 4432.632 ms 2023-10-16T20:01:09.509 INFO:tasks.workunit.client.0.smithi057.stdout: 10 804 0.45 MB/sec execute 221 sec latency 4199.115 ms 2023-10-16T20:01:10.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 805 0.45 MB/sec execute 222 sec latency 4123.361 ms 2023-10-16T20:01:11.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 806 0.45 MB/sec execute 223 sec latency 4624.526 ms 2023-10-16T20:01:12.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 807 0.45 MB/sec execute 224 sec latency 4746.401 ms 2023-10-16T20:01:13.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 808 0.45 MB/sec execute 225 sec latency 4427.122 ms 2023-10-16T20:01:14.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 809 0.44 MB/sec execute 226 sec latency 3972.954 ms 2023-10-16T20:01:15.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 810 0.44 MB/sec execute 227 sec latency 4179.526 ms 2023-10-16T20:01:16.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 811 0.44 MB/sec execute 228 sec latency 4615.590 ms 2023-10-16T20:01:17.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 813 0.44 MB/sec execute 229 sec latency 4115.772 ms 2023-10-16T20:01:18.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 814 0.44 MB/sec execute 230 sec latency 2011.161 ms 2023-10-16T20:01:19.510 INFO:tasks.workunit.client.0.smithi057.stdout: 10 814 0.44 MB/sec execute 231 sec latency 3011.303 ms 2023-10-16T20:01:20.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 814 0.43 MB/sec execute 232 sec latency 4011.422 ms 2023-10-16T20:01:21.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 817 0.43 MB/sec execute 233 sec latency 4619.822 ms 2023-10-16T20:01:21.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:01:21.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:01:22.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 818 0.43 MB/sec execute 234 sec latency 4354.268 ms 2023-10-16T20:01:23.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 824 0.43 MB/sec execute 235 sec latency 3972.404 ms 2023-10-16T20:01:24.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 825 0.43 MB/sec execute 236 sec latency 4449.187 ms 2023-10-16T20:01:25.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 826 0.43 MB/sec execute 237 sec latency 3069.033 ms 2023-10-16T20:01:26.511 INFO:tasks.workunit.client.0.smithi057.stdout: 10 827 0.42 MB/sec execute 238 sec latency 3840.056 ms 2023-10-16T20:01:27.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 830 0.42 MB/sec execute 239 sec latency 4559.914 ms 2023-10-16T20:01:28.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 834 0.42 MB/sec execute 240 sec latency 4772.437 ms 2023-10-16T20:01:29.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 839 0.42 MB/sec execute 241 sec latency 5045.091 ms 2023-10-16T20:01:30.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 840 0.42 MB/sec execute 242 sec latency 3839.039 ms 2023-10-16T20:01:31.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 841 0.42 MB/sec execute 243 sec latency 2630.486 ms 2023-10-16T20:01:32.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 842 0.42 MB/sec execute 244 sec latency 3630.592 ms 2023-10-16T20:01:33.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 843 0.41 MB/sec execute 245 sec latency 4085.121 ms 2023-10-16T20:01:34.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 845 0.41 MB/sec execute 246 sec latency 4615.450 ms 2023-10-16T20:01:35.512 INFO:tasks.workunit.client.0.smithi057.stdout: 10 846 0.41 MB/sec execute 247 sec latency 4682.309 ms 2023-10-16T20:01:36.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 847 0.41 MB/sec execute 248 sec latency 4269.988 ms 2023-10-16T20:01:37.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 848 0.41 MB/sec execute 249 sec latency 4818.532 ms 2023-10-16T20:01:38.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 848 0.41 MB/sec execute 250 sec latency 4217.604 ms 2023-10-16T20:01:39.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 849 0.40 MB/sec execute 251 sec latency 4643.604 ms 2023-10-16T20:01:40.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 849 0.40 MB/sec execute 252 sec latency 4579.459 ms 2023-10-16T20:01:41.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 850 0.40 MB/sec execute 253 sec latency 4567.173 ms 2023-10-16T20:01:42.513 INFO:tasks.workunit.client.0.smithi057.stdout: 10 850 0.40 MB/sec execute 254 sec latency 4605.364 ms 2023-10-16T20:01:43.514 INFO:tasks.workunit.client.0.smithi057.stdout: 10 852 0.40 MB/sec execute 255 sec latency 4720.675 ms 2023-10-16T20:01:44.514 INFO:tasks.workunit.client.0.smithi057.stdout: 10 855 0.40 MB/sec execute 256 sec latency 4776.939 ms 2023-10-16T20:01:45.514 INFO:tasks.workunit.client.0.smithi057.stdout: 10 856 0.40 MB/sec execute 257 sec latency 3702.247 ms 2023-10-16T20:01:46.514 INFO:tasks.workunit.client.0.smithi057.stdout: 10 857 0.39 MB/sec execute 258 sec latency 2195.806 ms 2023-10-16T20:01:47.514 INFO:tasks.workunit.client.0.smithi057.stdout: 10 859 0.39 MB/sec execute 259 sec latency 3195.954 ms 2023-10-16T20:01:48.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 860 0.39 MB/sec execute 260 sec latency 4144.443 ms 2023-10-16T20:01:49.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 861 0.39 MB/sec execute 261 sec latency 4348.441 ms 2023-10-16T20:01:50.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 862 0.39 MB/sec execute 262 sec latency 4464.407 ms 2023-10-16T20:01:51.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 862 0.39 MB/sec execute 263 sec latency 4731.124 ms 2023-10-16T20:01:51.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:01:51.936 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:01:52.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 863 0.39 MB/sec execute 264 sec latency 5057.926 ms 2023-10-16T20:01:53.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 865 0.39 MB/sec execute 265 sec latency 4104.947 ms 2023-10-16T20:01:54.515 INFO:tasks.workunit.client.0.smithi057.stdout: 10 868 0.38 MB/sec execute 266 sec latency 4174.113 ms 2023-10-16T20:01:55.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 870 0.38 MB/sec execute 267 sec latency 4720.036 ms 2023-10-16T20:01:56.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 873 0.38 MB/sec execute 268 sec latency 3768.655 ms 2023-10-16T20:01:57.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 876 0.38 MB/sec execute 269 sec latency 1936.651 ms 2023-10-16T20:01:58.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 876 0.38 MB/sec execute 270 sec latency 2837.351 ms 2023-10-16T20:01:59.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 878 0.38 MB/sec execute 271 sec latency 3837.470 ms 2023-10-16T20:02:00.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 879 0.38 MB/sec execute 272 sec latency 4308.408 ms 2023-10-16T20:02:01.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 882 0.38 MB/sec execute 273 sec latency 4135.237 ms 2023-10-16T20:02:02.516 INFO:tasks.workunit.client.0.smithi057.stdout: 10 884 0.37 MB/sec execute 274 sec latency 1956.793 ms 2023-10-16T20:02:03.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 885 0.37 MB/sec execute 275 sec latency 2956.957 ms 2023-10-16T20:02:04.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 886 0.37 MB/sec execute 276 sec latency 3284.329 ms 2023-10-16T20:02:05.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 887 0.37 MB/sec execute 277 sec latency 2985.226 ms 2023-10-16T20:02:06.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 888 0.37 MB/sec execute 278 sec latency 3496.338 ms 2023-10-16T20:02:07.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 889 0.37 MB/sec execute 279 sec latency 4041.952 ms 2023-10-16T20:02:08.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 891 0.37 MB/sec execute 280 sec latency 3897.323 ms 2023-10-16T20:02:09.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 893 0.37 MB/sec execute 281 sec latency 1895.583 ms 2023-10-16T20:02:10.517 INFO:tasks.workunit.client.0.smithi057.stdout: 10 895 0.36 MB/sec execute 282 sec latency 1532.891 ms 2023-10-16T20:02:11.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 898 0.36 MB/sec execute 283 sec latency 2162.972 ms 2023-10-16T20:02:12.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 899 0.36 MB/sec execute 284 sec latency 3014.823 ms 2023-10-16T20:02:13.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 900 0.36 MB/sec execute 285 sec latency 2836.031 ms 2023-10-16T20:02:14.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 902 0.36 MB/sec execute 286 sec latency 3045.804 ms 2023-10-16T20:02:15.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 903 0.36 MB/sec execute 287 sec latency 3223.319 ms 2023-10-16T20:02:16.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 904 0.36 MB/sec execute 288 sec latency 4223.459 ms 2023-10-16T20:02:17.518 INFO:tasks.workunit.client.0.smithi057.stdout: 10 906 0.36 MB/sec execute 289 sec latency 5223.559 ms 2023-10-16T20:02:18.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 907 0.36 MB/sec execute 290 sec latency 5771.373 ms 2023-10-16T20:02:19.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 909 0.35 MB/sec execute 291 sec latency 3495.562 ms 2023-10-16T20:02:20.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 911 0.35 MB/sec execute 292 sec latency 4210.746 ms 2023-10-16T20:02:21.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 912 0.35 MB/sec execute 293 sec latency 3142.066 ms 2023-10-16T20:02:22.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:02:22.214 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:02:22.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 914 0.35 MB/sec execute 294 sec latency 3445.275 ms 2023-10-16T20:02:23.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 915 0.35 MB/sec execute 295 sec latency 3717.702 ms 2023-10-16T20:02:24.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 917 0.35 MB/sec execute 296 sec latency 3444.372 ms 2023-10-16T20:02:25.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 918 0.35 MB/sec execute 297 sec latency 3697.252 ms 2023-10-16T20:02:26.519 INFO:tasks.workunit.client.0.smithi057.stdout: 10 919 0.35 MB/sec execute 298 sec latency 3786.809 ms 2023-10-16T20:02:27.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 919 0.35 MB/sec execute 299 sec latency 4527.231 ms 2023-10-16T20:02:28.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 920 0.34 MB/sec execute 300 sec latency 4641.464 ms 2023-10-16T20:02:29.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 920 0.34 MB/sec execute 301 sec latency 4674.946 ms 2023-10-16T20:02:30.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 921 0.34 MB/sec execute 302 sec latency 4586.976 ms 2023-10-16T20:02:31.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 921 0.34 MB/sec execute 303 sec latency 3787.462 ms 2023-10-16T20:02:32.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 922 0.34 MB/sec execute 304 sec latency 4631.239 ms 2023-10-16T20:02:33.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 923 0.34 MB/sec execute 305 sec latency 4465.255 ms 2023-10-16T20:02:34.520 INFO:tasks.workunit.client.0.smithi057.stdout: 10 924 0.34 MB/sec execute 306 sec latency 4454.090 ms 2023-10-16T20:02:35.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 924 0.34 MB/sec execute 307 sec latency 4239.694 ms 2023-10-16T20:02:36.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 926 0.34 MB/sec execute 308 sec latency 4466.299 ms 2023-10-16T20:02:37.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 927 0.33 MB/sec execute 309 sec latency 4127.288 ms 2023-10-16T20:02:38.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 927 0.33 MB/sec execute 310 sec latency 2623.494 ms 2023-10-16T20:02:39.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 928 0.33 MB/sec execute 311 sec latency 3325.040 ms 2023-10-16T20:02:40.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 928 0.33 MB/sec execute 312 sec latency 4325.164 ms 2023-10-16T20:02:41.521 INFO:tasks.workunit.client.0.smithi057.stdout: 10 929 0.33 MB/sec execute 313 sec latency 4531.788 ms 2023-10-16T20:02:42.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 930 0.33 MB/sec execute 314 sec latency 4554.624 ms 2023-10-16T20:02:43.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 931 0.33 MB/sec execute 315 sec latency 4096.421 ms 2023-10-16T20:02:44.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 932 0.33 MB/sec execute 316 sec latency 3560.470 ms 2023-10-16T20:02:45.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 932 0.33 MB/sec execute 317 sec latency 3564.276 ms 2023-10-16T20:02:46.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 933 0.33 MB/sec execute 318 sec latency 3941.363 ms 2023-10-16T20:02:47.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 934 0.32 MB/sec execute 319 sec latency 4061.959 ms 2023-10-16T20:02:48.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 936 0.32 MB/sec execute 320 sec latency 3982.713 ms 2023-10-16T20:02:49.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 938 0.32 MB/sec execute 321 sec latency 4260.734 ms 2023-10-16T20:02:50.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 940 0.32 MB/sec execute 322 sec latency 4133.731 ms 2023-10-16T20:02:51.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 942 0.32 MB/sec execute 323 sec latency 2204.781 ms 2023-10-16T20:02:52.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:02:52.354 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:02:52.522 INFO:tasks.workunit.client.0.smithi057.stdout: 10 943 0.32 MB/sec execute 324 sec latency 3204.877 ms 2023-10-16T20:02:53.523 INFO:tasks.workunit.client.0.smithi057.stdout: 10 944 0.32 MB/sec execute 325 sec latency 3974.146 ms 2023-10-16T20:02:54.523 INFO:tasks.workunit.client.0.smithi057.stdout: 10 945 0.32 MB/sec execute 326 sec latency 3726.045 ms 2023-10-16T20:02:55.523 INFO:tasks.workunit.client.0.smithi057.stdout: 10 947 0.32 MB/sec execute 327 sec latency 4021.687 ms 2023-10-16T20:02:56.523 INFO:tasks.workunit.client.0.smithi057.stdout: 10 949 0.32 MB/sec execute 328 sec latency 4136.560 ms 2023-10-16T20:02:57.523 INFO:tasks.workunit.client.0.smithi057.stdout: 10 951 0.32 MB/sec execute 329 sec latency 3545.441 ms 2023-10-16T20:02:58.523 INFO:tasks.workunit.client.0.smithi057.stdout: 10 952 0.31 MB/sec execute 330 sec latency 3004.051 ms 2023-10-16T20:02:59.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 953 0.31 MB/sec execute 331 sec latency 4004.178 ms 2023-10-16T20:03:00.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 954 0.31 MB/sec execute 332 sec latency 4235.816 ms 2023-10-16T20:03:01.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 955 0.31 MB/sec execute 333 sec latency 3611.484 ms 2023-10-16T20:03:02.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 956 0.31 MB/sec execute 334 sec latency 4564.545 ms 2023-10-16T20:03:03.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 959 0.31 MB/sec execute 335 sec latency 4284.688 ms 2023-10-16T20:03:04.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 961 0.31 MB/sec execute 336 sec latency 3587.021 ms 2023-10-16T20:03:05.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 963 0.31 MB/sec execute 337 sec latency 2658.037 ms 2023-10-16T20:03:05.959 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:23:05.520 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:05.969 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:23:05.530 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:05.998 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:23:05.546 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:05.998 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:23:05.546 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:06.008 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:23:05.556 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:06.016 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:23:05.564 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:06.174 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:23:05.735 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:06.194 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:23:05.742 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:06.217 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:23:05.765 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:03:06.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 965 0.31 MB/sec execute 338 sec latency 3038.154 ms 2023-10-16T20:03:07.524 INFO:tasks.workunit.client.0.smithi057.stdout: 10 966 0.31 MB/sec execute 339 sec latency 2869.039 ms 2023-10-16T20:03:08.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 967 0.31 MB/sec execute 340 sec latency 2870.180 ms 2023-10-16T20:03:09.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 969 0.31 MB/sec execute 341 sec latency 1814.536 ms 2023-10-16T20:03:10.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 970 0.30 MB/sec execute 342 sec latency 2814.683 ms 2023-10-16T20:03:11.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 971 0.30 MB/sec execute 343 sec latency 3814.796 ms 2023-10-16T20:03:12.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 973 0.30 MB/sec execute 344 sec latency 4172.179 ms 2023-10-16T20:03:13.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 974 0.30 MB/sec execute 345 sec latency 3490.695 ms 2023-10-16T20:03:14.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 975 0.30 MB/sec execute 346 sec latency 4067.248 ms 2023-10-16T20:03:15.525 INFO:tasks.workunit.client.0.smithi057.stdout: 10 977 0.30 MB/sec execute 347 sec latency 4204.634 ms 2023-10-16T20:03:16.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 979 0.30 MB/sec execute 348 sec latency 3311.936 ms 2023-10-16T20:03:17.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 982 0.30 MB/sec execute 349 sec latency 3683.553 ms 2023-10-16T20:03:18.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 985 0.30 MB/sec execute 350 sec latency 2229.360 ms 2023-10-16T20:03:19.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 990 0.31 MB/sec execute 351 sec latency 3120.949 ms 2023-10-16T20:03:20.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 992 0.31 MB/sec execute 352 sec latency 3863.423 ms 2023-10-16T20:03:21.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 993 0.30 MB/sec execute 353 sec latency 3751.856 ms 2023-10-16T20:03:22.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 994 0.30 MB/sec execute 354 sec latency 3971.754 ms 2023-10-16T20:03:22.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:03:22.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:03:23.526 INFO:tasks.workunit.client.0.smithi057.stdout: 10 996 0.30 MB/sec execute 355 sec latency 4140.173 ms 2023-10-16T20:03:24.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 997 0.30 MB/sec execute 356 sec latency 4516.557 ms 2023-10-16T20:03:25.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1000 0.30 MB/sec execute 357 sec latency 4175.770 ms 2023-10-16T20:03:26.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1004 0.31 MB/sec execute 358 sec latency 4280.447 ms 2023-10-16T20:03:27.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1008 0.31 MB/sec execute 359 sec latency 1465.128 ms 2023-10-16T20:03:28.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1009 0.31 MB/sec execute 360 sec latency 2465.251 ms 2023-10-16T20:03:29.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1009 0.31 MB/sec execute 361 sec latency 3348.888 ms 2023-10-16T20:03:30.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1009 0.31 MB/sec execute 362 sec latency 4349.027 ms 2023-10-16T20:03:31.527 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1010 0.30 MB/sec execute 363 sec latency 4526.821 ms 2023-10-16T20:03:32.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1011 0.30 MB/sec execute 364 sec latency 4562.587 ms 2023-10-16T20:03:33.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1014 0.30 MB/sec execute 365 sec latency 4755.296 ms 2023-10-16T20:03:34.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1017 0.30 MB/sec execute 366 sec latency 1303.573 ms 2023-10-16T20:03:35.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1021 0.31 MB/sec execute 367 sec latency 1296.616 ms 2023-10-16T20:03:36.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1023 0.31 MB/sec execute 368 sec latency 1968.889 ms 2023-10-16T20:03:37.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1024 0.31 MB/sec execute 369 sec latency 2969.028 ms 2023-10-16T20:03:38.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1025 0.30 MB/sec execute 370 sec latency 3969.160 ms 2023-10-16T20:03:39.528 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1025 0.30 MB/sec execute 371 sec latency 4140.118 ms 2023-10-16T20:03:40.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1026 0.30 MB/sec execute 372 sec latency 4323.674 ms 2023-10-16T20:03:41.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1027 0.30 MB/sec execute 373 sec latency 4636.614 ms 2023-10-16T20:03:42.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1029 0.30 MB/sec execute 374 sec latency 4592.608 ms 2023-10-16T20:03:43.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1029 0.30 MB/sec execute 375 sec latency 2878.217 ms 2023-10-16T20:03:44.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1031 0.30 MB/sec execute 376 sec latency 3878.323 ms 2023-10-16T20:03:45.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1032 0.30 MB/sec execute 377 sec latency 4664.621 ms 2023-10-16T20:03:46.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1033 0.30 MB/sec execute 378 sec latency 4121.389 ms 2023-10-16T20:03:47.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1033 0.30 MB/sec execute 379 sec latency 4276.308 ms 2023-10-16T20:03:48.529 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1035 0.30 MB/sec execute 380 sec latency 4201.450 ms 2023-10-16T20:03:49.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1036 0.30 MB/sec execute 381 sec latency 4486.040 ms 2023-10-16T20:03:50.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1038 0.30 MB/sec execute 382 sec latency 4570.331 ms 2023-10-16T20:03:51.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1038 0.30 MB/sec execute 383 sec latency 3667.907 ms 2023-10-16T20:03:52.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1039 0.30 MB/sec execute 384 sec latency 4061.341 ms 2023-10-16T20:03:52.721 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:03:52.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:03:53.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1040 0.30 MB/sec execute 385 sec latency 4280.453 ms 2023-10-16T20:03:54.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1042 0.29 MB/sec execute 386 sec latency 4618.295 ms 2023-10-16T20:03:55.530 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1043 0.29 MB/sec execute 387 sec latency 4848.405 ms 2023-10-16T20:03:56.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1044 0.29 MB/sec execute 388 sec latency 4334.946 ms 2023-10-16T20:03:57.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1045 0.29 MB/sec execute 389 sec latency 4190.393 ms 2023-10-16T20:03:58.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1046 0.29 MB/sec execute 390 sec latency 4280.551 ms 2023-10-16T20:03:59.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1047 0.29 MB/sec execute 391 sec latency 4802.615 ms 2023-10-16T20:04:00.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1049 0.29 MB/sec execute 392 sec latency 3364.582 ms 2023-10-16T20:04:01.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1051 0.29 MB/sec execute 393 sec latency 3791.460 ms 2023-10-16T20:04:02.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1052 0.29 MB/sec execute 394 sec latency 3478.382 ms 2023-10-16T20:04:03.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1054 0.29 MB/sec execute 395 sec latency 4006.989 ms 2023-10-16T20:04:04.531 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1055 0.29 MB/sec execute 396 sec latency 4493.569 ms 2023-10-16T20:04:04.802 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:24:04.363 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:04.889 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:24:04.449 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:04.985 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:24:04.533 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:04.995 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:24:04.544 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:04.998 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:24:04.546 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:05.001 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:24:04.562 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:05.018 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:24:04.566 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:05.078 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:24:04.626 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:05.083 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:24:04.631 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:04:05.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1057 0.29 MB/sec execute 397 sec latency 4446.862 ms 2023-10-16T20:04:06.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1058 0.29 MB/sec execute 398 sec latency 4689.601 ms 2023-10-16T20:04:07.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1060 0.29 MB/sec execute 399 sec latency 3684.515 ms 2023-10-16T20:04:08.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1061 0.29 MB/sec execute 400 sec latency 3506.027 ms 2023-10-16T20:04:09.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1064 0.29 MB/sec execute 401 sec latency 3721.806 ms 2023-10-16T20:04:10.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1066 0.29 MB/sec execute 402 sec latency 2654.371 ms 2023-10-16T20:04:11.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1068 0.29 MB/sec execute 403 sec latency 2227.609 ms 2023-10-16T20:04:12.532 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1069 0.28 MB/sec execute 404 sec latency 3227.740 ms 2023-10-16T20:04:13.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1070 0.28 MB/sec execute 405 sec latency 4025.717 ms 2023-10-16T20:04:14.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1071 0.28 MB/sec execute 406 sec latency 3156.304 ms 2023-10-16T20:04:15.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1072 0.28 MB/sec execute 407 sec latency 4059.037 ms 2023-10-16T20:04:16.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1073 0.28 MB/sec execute 408 sec latency 4055.158 ms 2023-10-16T20:04:17.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1074 0.28 MB/sec execute 409 sec latency 3836.715 ms 2023-10-16T20:04:18.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1075 0.28 MB/sec execute 410 sec latency 3378.990 ms 2023-10-16T20:04:19.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1078 0.28 MB/sec execute 411 sec latency 2482.417 ms 2023-10-16T20:04:20.533 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1078 0.28 MB/sec execute 412 sec latency 3482.510 ms 2023-10-16T20:04:21.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1079 0.28 MB/sec execute 413 sec latency 4170.479 ms 2023-10-16T20:04:22.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1080 0.28 MB/sec execute 414 sec latency 3888.282 ms 2023-10-16T20:04:22.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:04:22.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:04:23.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1082 0.28 MB/sec execute 415 sec latency 4440.664 ms 2023-10-16T20:04:24.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1084 0.28 MB/sec execute 416 sec latency 3648.268 ms 2023-10-16T20:04:25.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1086 0.28 MB/sec execute 417 sec latency 3770.868 ms 2023-10-16T20:04:26.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1087 0.28 MB/sec execute 418 sec latency 3448.137 ms 2023-10-16T20:04:27.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1089 0.27 MB/sec execute 419 sec latency 3941.198 ms 2023-10-16T20:04:28.534 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1091 0.27 MB/sec execute 420 sec latency 3796.357 ms 2023-10-16T20:04:29.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1091 0.27 MB/sec execute 421 sec latency 3328.406 ms 2023-10-16T20:04:30.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1092 0.27 MB/sec execute 422 sec latency 3913.850 ms 2023-10-16T20:04:31.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1093 0.27 MB/sec execute 423 sec latency 4507.588 ms 2023-10-16T20:04:32.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1094 0.27 MB/sec execute 424 sec latency 4672.534 ms 2023-10-16T20:04:33.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1097 0.27 MB/sec execute 425 sec latency 3894.518 ms 2023-10-16T20:04:34.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1098 0.27 MB/sec execute 426 sec latency 2391.069 ms 2023-10-16T20:04:35.535 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1100 0.27 MB/sec execute 427 sec latency 3372.881 ms 2023-10-16T20:04:36.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1101 0.27 MB/sec execute 428 sec latency 3619.028 ms 2023-10-16T20:04:37.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1103 0.27 MB/sec execute 429 sec latency 3621.463 ms 2023-10-16T20:04:38.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1104 0.27 MB/sec execute 430 sec latency 3907.306 ms 2023-10-16T20:04:39.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1105 0.27 MB/sec execute 431 sec latency 3954.862 ms 2023-10-16T20:04:40.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1107 0.27 MB/sec execute 432 sec latency 3702.410 ms 2023-10-16T20:04:41.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1108 0.27 MB/sec execute 433 sec latency 3687.906 ms 2023-10-16T20:04:42.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1110 0.27 MB/sec execute 434 sec latency 1515.961 ms 2023-10-16T20:04:43.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1111 0.27 MB/sec execute 435 sec latency 1975.822 ms 2023-10-16T20:04:44.536 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1113 0.26 MB/sec execute 436 sec latency 2968.104 ms 2023-10-16T20:04:45.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1115 0.26 MB/sec execute 437 sec latency 3156.853 ms 2023-10-16T20:04:46.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1117 0.26 MB/sec execute 438 sec latency 2499.476 ms 2023-10-16T20:04:47.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1119 0.26 MB/sec execute 439 sec latency 3499.608 ms 2023-10-16T20:04:48.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1120 0.26 MB/sec execute 440 sec latency 3807.401 ms 2023-10-16T20:04:49.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1122 0.26 MB/sec execute 441 sec latency 3394.736 ms 2023-10-16T20:04:50.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1124 0.26 MB/sec execute 442 sec latency 2880.838 ms 2023-10-16T20:04:51.537 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1125 0.26 MB/sec execute 443 sec latency 2456.260 ms 2023-10-16T20:04:52.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1126 0.26 MB/sec execute 444 sec latency 2884.304 ms 2023-10-16T20:04:53.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:04:53.013 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:04:53.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1128 0.26 MB/sec execute 445 sec latency 3254.469 ms 2023-10-16T20:04:54.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1131 0.26 MB/sec execute 446 sec latency 2609.273 ms 2023-10-16T20:04:55.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1132 0.26 MB/sec execute 447 sec latency 3291.095 ms 2023-10-16T20:04:56.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1134 0.26 MB/sec execute 448 sec latency 2710.855 ms 2023-10-16T20:04:57.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1135 0.26 MB/sec execute 449 sec latency 3363.220 ms 2023-10-16T20:04:58.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1136 0.26 MB/sec execute 450 sec latency 3177.303 ms 2023-10-16T20:04:59.538 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1136 0.26 MB/sec execute 451 sec latency 3318.964 ms 2023-10-16T20:05:00.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1139 0.26 MB/sec execute 452 sec latency 4264.284 ms 2023-10-16T20:05:01.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1140 0.26 MB/sec execute 453 sec latency 3506.196 ms 2023-10-16T20:05:02.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1142 0.26 MB/sec execute 454 sec latency 1531.638 ms 2023-10-16T20:05:03.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1144 0.25 MB/sec execute 455 sec latency 1926.600 ms 2023-10-16T20:05:04.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1144 0.25 MB/sec execute 456 sec latency 2926.745 ms 2023-10-16T20:05:05.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1146 0.25 MB/sec execute 457 sec latency 3449.349 ms 2023-10-16T20:05:06.539 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1147 0.25 MB/sec execute 458 sec latency 3948.084 ms 2023-10-16T20:05:07.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1147 0.25 MB/sec execute 459 sec latency 4278.299 ms 2023-10-16T20:05:08.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1148 0.25 MB/sec execute 460 sec latency 4085.232 ms 2023-10-16T20:05:09.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1150 0.25 MB/sec execute 461 sec latency 4236.792 ms 2023-10-16T20:05:10.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1152 0.25 MB/sec execute 462 sec latency 1938.589 ms 2023-10-16T20:05:11.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1154 0.25 MB/sec execute 463 sec latency 2938.700 ms 2023-10-16T20:05:12.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1154 0.25 MB/sec execute 464 sec latency 3870.049 ms 2023-10-16T20:05:13.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1155 0.25 MB/sec execute 465 sec latency 3815.531 ms 2023-10-16T20:05:14.540 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1156 0.25 MB/sec execute 466 sec latency 3273.718 ms 2023-10-16T20:05:15.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1157 0.25 MB/sec execute 467 sec latency 4273.862 ms 2023-10-16T20:05:16.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1157 0.25 MB/sec execute 468 sec latency 5111.547 ms 2023-10-16T20:05:17.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1158 0.25 MB/sec execute 469 sec latency 5050.416 ms 2023-10-16T20:05:18.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1159 0.25 MB/sec execute 470 sec latency 4625.648 ms 2023-10-16T20:05:19.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1159 0.25 MB/sec execute 471 sec latency 4147.083 ms 2023-10-16T20:05:20.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1160 0.25 MB/sec execute 472 sec latency 2554.609 ms 2023-10-16T20:05:21.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1161 0.25 MB/sec execute 473 sec latency 3516.442 ms 2023-10-16T20:05:22.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1163 0.24 MB/sec execute 474 sec latency 4366.507 ms 2023-10-16T20:05:23.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:23.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:23.541 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1164 0.24 MB/sec execute 475 sec latency 3815.037 ms 2023-10-16T20:05:24.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1164 0.24 MB/sec execute 476 sec latency 2622.812 ms 2023-10-16T20:05:25.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1165 0.24 MB/sec execute 477 sec latency 3622.938 ms 2023-10-16T20:05:26.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1166 0.24 MB/sec execute 478 sec latency 4162.618 ms 2023-10-16T20:05:27.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1167 0.24 MB/sec execute 479 sec latency 4159.847 ms 2023-10-16T20:05:28.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1168 0.24 MB/sec execute 480 sec latency 4106.595 ms 2023-10-16T20:05:29.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1169 0.24 MB/sec execute 481 sec latency 3688.964 ms 2023-10-16T20:05:30.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1171 0.24 MB/sec execute 482 sec latency 3791.299 ms 2023-10-16T20:05:31.542 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1172 0.24 MB/sec execute 483 sec latency 2764.787 ms 2023-10-16T20:05:32.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1173 0.24 MB/sec execute 484 sec latency 3170.255 ms 2023-10-16T20:05:33.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1175 0.24 MB/sec execute 485 sec latency 3433.192 ms 2023-10-16T20:05:34.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1177 0.24 MB/sec execute 486 sec latency 1736.266 ms 2023-10-16T20:05:35.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1178 0.24 MB/sec execute 487 sec latency 2629.496 ms 2023-10-16T20:05:36.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1180 0.24 MB/sec execute 488 sec latency 3629.626 ms 2023-10-16T20:05:37.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1181 0.24 MB/sec execute 489 sec latency 3858.178 ms 2023-10-16T20:05:38.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1182 0.24 MB/sec execute 490 sec latency 3541.316 ms 2023-10-16T20:05:39.543 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1184 0.24 MB/sec execute 491 sec latency 3726.084 ms 2023-10-16T20:05:40.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1185 0.24 MB/sec execute 492 sec latency 3771.921 ms 2023-10-16T20:05:41.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1187 0.24 MB/sec execute 493 sec latency 3936.373 ms 2023-10-16T20:05:42.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1188 0.24 MB/sec execute 494 sec latency 4276.693 ms 2023-10-16T20:05:43.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1189 0.23 MB/sec execute 495 sec latency 4267.165 ms 2023-10-16T20:05:44.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1190 0.23 MB/sec execute 496 sec latency 3762.108 ms 2023-10-16T20:05:45.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1191 0.23 MB/sec execute 497 sec latency 2548.887 ms 2023-10-16T20:05:46.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1193 0.23 MB/sec execute 498 sec latency 3549.020 ms 2023-10-16T20:05:47.544 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1194 0.23 MB/sec execute 499 sec latency 3809.595 ms 2023-10-16T20:05:48.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1195 0.23 MB/sec execute 500 sec latency 2521.398 ms 2023-10-16T20:05:49.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1196 0.23 MB/sec execute 501 sec latency 3521.506 ms 2023-10-16T20:05:50.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1198 0.23 MB/sec execute 502 sec latency 3872.843 ms 2023-10-16T20:05:51.043 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:25:50.603 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.048 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:25:50.609 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.146 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:25:50.707 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.148 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:25:50.696 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.161 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:25:50.708 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.162 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:25:50.709 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.168 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:25:50.716 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.259 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:25:50.807 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.282 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:25:50.830 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:05:51.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1199 0.23 MB/sec execute 503 sec latency 3775.444 ms 2023-10-16T20:05:52.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1201 0.23 MB/sec execute 504 sec latency 2409.732 ms 2023-10-16T20:05:53.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1202 0.23 MB/sec execute 505 sec latency 1352.849 ms 2023-10-16T20:05:53.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:53.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:54.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1205 0.23 MB/sec execute 506 sec latency 2245.876 ms 2023-10-16T20:05:55.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1205 0.23 MB/sec execute 507 sec latency 3246.005 ms 2023-10-16T20:05:56.545 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1206 0.23 MB/sec execute 508 sec latency 3964.319 ms 2023-10-16T20:05:57.546 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1206 0.23 MB/sec execute 509 sec latency 3418.567 ms 2023-10-16T20:05:58.546 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1210 0.23 MB/sec execute 510 sec latency 2717.409 ms 2023-10-16T20:05:59.546 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1212 0.23 MB/sec execute 511 sec latency 3282.188 ms 2023-10-16T20:06:00.546 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1215 0.23 MB/sec execute 512 sec latency 3919.215 ms 2023-10-16T20:06:01.546 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1216 0.23 MB/sec execute 513 sec latency 1879.633 ms 2023-10-16T20:06:02.546 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1218 0.23 MB/sec execute 514 sec latency 2452.493 ms 2023-10-16T20:06:03.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1219 0.23 MB/sec execute 515 sec latency 3363.492 ms 2023-10-16T20:06:04.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1220 0.23 MB/sec execute 516 sec latency 3428.175 ms 2023-10-16T20:06:05.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1221 0.23 MB/sec execute 517 sec latency 2806.032 ms 2023-10-16T20:06:06.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1223 0.22 MB/sec execute 518 sec latency 2788.803 ms 2023-10-16T20:06:07.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1225 0.22 MB/sec execute 519 sec latency 2813.778 ms 2023-10-16T20:06:08.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1225 0.22 MB/sec execute 520 sec latency 1763.009 ms 2023-10-16T20:06:09.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1227 0.22 MB/sec execute 521 sec latency 2763.076 ms 2023-10-16T20:06:10.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1228 0.22 MB/sec execute 522 sec latency 3763.174 ms 2023-10-16T20:06:11.547 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1229 0.22 MB/sec execute 523 sec latency 4402.798 ms 2023-10-16T20:06:12.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1230 0.22 MB/sec execute 524 sec latency 2367.236 ms 2023-10-16T20:06:13.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1231 0.22 MB/sec execute 525 sec latency 2753.039 ms 2023-10-16T20:06:14.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1232 0.22 MB/sec execute 526 sec latency 3284.376 ms 2023-10-16T20:06:15.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1234 0.22 MB/sec execute 527 sec latency 3669.148 ms 2023-10-16T20:06:16.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1236 0.22 MB/sec execute 528 sec latency 3680.533 ms 2023-10-16T20:06:17.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1238 0.22 MB/sec execute 529 sec latency 2265.541 ms 2023-10-16T20:06:18.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1239 0.22 MB/sec execute 530 sec latency 3265.660 ms 2023-10-16T20:06:19.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1241 0.22 MB/sec execute 531 sec latency 3539.509 ms 2023-10-16T20:06:20.548 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1243 0.22 MB/sec execute 532 sec latency 2942.087 ms 2023-10-16T20:06:21.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1245 0.22 MB/sec execute 533 sec latency 3656.038 ms 2023-10-16T20:06:22.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1246 0.22 MB/sec execute 534 sec latency 1802.811 ms 2023-10-16T20:06:23.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1248 0.22 MB/sec execute 535 sec latency 2016.271 ms 2023-10-16T20:06:23.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:23.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:24.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1250 0.22 MB/sec execute 536 sec latency 3016.391 ms 2023-10-16T20:06:25.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1252 0.22 MB/sec execute 537 sec latency 3126.657 ms 2023-10-16T20:06:26.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1254 0.22 MB/sec execute 538 sec latency 2597.215 ms 2023-10-16T20:06:26.656 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:26:26.216 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.675 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:26:26.235 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.693 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:26:26.241 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.701 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:26:26.249 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.704 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:26:26.252 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.716 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:26:26.264 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.781 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:26:26.342 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.796 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:26:26.344 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:26.810 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:26:26.358 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:06:27.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1254 0.22 MB/sec execute 539 sec latency 3597.338 ms 2023-10-16T20:06:28.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1257 0.22 MB/sec execute 540 sec latency 4059.514 ms 2023-10-16T20:06:29.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1258 0.22 MB/sec execute 541 sec latency 4014.729 ms 2023-10-16T20:06:30.549 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1260 0.22 MB/sec execute 542 sec latency 4744.663 ms 2023-10-16T20:06:31.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1261 0.22 MB/sec execute 543 sec latency 3451.179 ms 2023-10-16T20:06:32.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1263 0.22 MB/sec execute 544 sec latency 4204.040 ms 2023-10-16T20:06:33.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1264 0.21 MB/sec execute 545 sec latency 2794.095 ms 2023-10-16T20:06:34.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1264 0.21 MB/sec execute 546 sec latency 3287.388 ms 2023-10-16T20:06:35.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1265 0.21 MB/sec execute 547 sec latency 4094.144 ms 2023-10-16T20:06:36.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1266 0.21 MB/sec execute 548 sec latency 4068.858 ms 2023-10-16T20:06:37.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1267 0.21 MB/sec execute 549 sec latency 3905.008 ms 2023-10-16T20:06:38.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1267 0.21 MB/sec execute 550 sec latency 3500.743 ms 2023-10-16T20:06:39.550 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1268 0.21 MB/sec execute 551 sec latency 4021.524 ms 2023-10-16T20:06:40.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1269 0.21 MB/sec execute 552 sec latency 4529.039 ms 2023-10-16T20:06:41.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1270 0.21 MB/sec execute 553 sec latency 4810.012 ms 2023-10-16T20:06:42.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1274 0.21 MB/sec execute 554 sec latency 3739.469 ms 2023-10-16T20:06:43.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1283 0.22 MB/sec execute 555 sec latency 4617.412 ms 2023-10-16T20:06:44.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1290 0.22 MB/sec execute 556 sec latency 4272.215 ms 2023-10-16T20:06:45.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1290 0.22 MB/sec execute 557 sec latency 3984.186 ms 2023-10-16T20:06:46.551 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1291 0.22 MB/sec execute 558 sec latency 4385.573 ms 2023-10-16T20:06:47.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1293 0.22 MB/sec execute 559 sec latency 3956.557 ms 2023-10-16T20:06:48.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1296 0.22 MB/sec execute 560 sec latency 4169.631 ms 2023-10-16T20:06:49.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1303 0.22 MB/sec execute 561 sec latency 4685.023 ms 2023-10-16T20:06:50.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1305 0.22 MB/sec execute 562 sec latency 3854.988 ms 2023-10-16T20:06:51.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1311 0.23 MB/sec execute 563 sec latency 3952.963 ms 2023-10-16T20:06:52.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1318 0.23 MB/sec execute 564 sec latency 3882.900 ms 2023-10-16T20:06:53.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1324 0.23 MB/sec execute 565 sec latency 4337.557 ms 2023-10-16T20:06:53.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:53.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:54.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1325 0.23 MB/sec execute 566 sec latency 3743.766 ms 2023-10-16T20:06:55.552 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1326 0.23 MB/sec execute 567 sec latency 3989.996 ms 2023-10-16T20:06:56.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1329 0.23 MB/sec execute 568 sec latency 4492.971 ms 2023-10-16T20:06:57.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1336 0.24 MB/sec execute 569 sec latency 4631.924 ms 2023-10-16T20:06:58.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1337 0.24 MB/sec execute 570 sec latency 4291.210 ms 2023-10-16T20:06:59.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1339 0.24 MB/sec execute 571 sec latency 3939.912 ms 2023-10-16T20:07:00.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1345 0.24 MB/sec execute 572 sec latency 4122.081 ms 2023-10-16T20:07:01.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1346 0.24 MB/sec execute 573 sec latency 4434.069 ms 2023-10-16T20:07:02.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1347 0.24 MB/sec execute 574 sec latency 4758.821 ms 2023-10-16T20:07:03.553 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1347 0.24 MB/sec execute 575 sec latency 4022.142 ms 2023-10-16T20:07:04.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1347 0.24 MB/sec execute 576 sec latency 5022.311 ms 2023-10-16T20:07:05.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1348 0.24 MB/sec execute 577 sec latency 5088.616 ms 2023-10-16T20:07:06.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1349 0.24 MB/sec execute 578 sec latency 4500.936 ms 2023-10-16T20:07:07.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1350 0.24 MB/sec execute 579 sec latency 3069.874 ms 2023-10-16T20:07:08.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1351 0.24 MB/sec execute 580 sec latency 4069.998 ms 2023-10-16T20:07:09.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1352 0.24 MB/sec execute 581 sec latency 4584.172 ms 2023-10-16T20:07:10.554 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1353 0.24 MB/sec execute 582 sec latency 4694.137 ms 2023-10-16T20:07:11.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1353 0.24 MB/sec execute 583 sec latency 4708.877 ms 2023-10-16T20:07:12.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1356 0.24 MB/sec execute 584 sec latency 4221.143 ms 2023-10-16T20:07:13.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1359 0.24 MB/sec execute 585 sec latency 4244.068 ms 2023-10-16T20:07:14.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1365 0.24 MB/sec execute 586 sec latency 4246.973 ms 2023-10-16T20:07:15.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1366 0.24 MB/sec execute 587 sec latency 4163.304 ms 2023-10-16T20:07:16.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1366 0.24 MB/sec execute 588 sec latency 4212.208 ms 2023-10-16T20:07:17.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1367 0.24 MB/sec execute 589 sec latency 4295.778 ms 2023-10-16T20:07:18.555 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1368 0.24 MB/sec execute 590 sec latency 4776.271 ms 2023-10-16T20:07:19.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1369 0.24 MB/sec execute 591 sec latency 4916.586 ms 2023-10-16T20:07:20.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1371 0.24 MB/sec execute 592 sec latency 4321.859 ms 2023-10-16T20:07:21.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1374 0.24 MB/sec execute 593 sec latency 2532.892 ms 2023-10-16T20:07:22.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1375 0.24 MB/sec execute 594 sec latency 3532.991 ms 2023-10-16T20:07:23.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1382 0.24 MB/sec execute 595 sec latency 3976.877 ms 2023-10-16T20:07:24.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:24.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:24.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1383 0.24 MB/sec execute 596 sec latency 4724.853 ms 2023-10-16T20:07:25.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1384 0.24 MB/sec execute 597 sec latency 2755.537 ms 2023-10-16T20:07:26.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1385 0.24 MB/sec execute 598 sec latency 3755.658 ms 2023-10-16T20:07:27.556 INFO:tasks.workunit.client.0.smithi057.stdout: 10 1385 0.24 MB/sec execute 599 sec latency 4386.785 ms 2023-10-16T20:07:28.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 600 sec 2023-10-16T20:07:29.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 601 sec 2023-10-16T20:07:30.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 602 sec 2023-10-16T20:07:31.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 603 sec 2023-10-16T20:07:32.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 604 sec 2023-10-16T20:07:33.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 605 sec 2023-10-16T20:07:34.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 606 sec 2023-10-16T20:07:35.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 607 sec 2023-10-16T20:07:36.557 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 608 sec 2023-10-16T20:07:37.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 609 sec 2023-10-16T20:07:38.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 610 sec 2023-10-16T20:07:39.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 611 sec 2023-10-16T20:07:40.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 612 sec 2023-10-16T20:07:41.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 613 sec 2023-10-16T20:07:42.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 614 sec 2023-10-16T20:07:43.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 615 sec 2023-10-16T20:07:44.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 616 sec 2023-10-16T20:07:45.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 617 sec 2023-10-16T20:07:46.558 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 618 sec 2023-10-16T20:07:47.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 619 sec 2023-10-16T20:07:48.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 620 sec 2023-10-16T20:07:49.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 621 sec 2023-10-16T20:07:50.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 622 sec 2023-10-16T20:07:51.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 623 sec 2023-10-16T20:07:52.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 624 sec 2023-10-16T20:07:53.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 625 sec 2023-10-16T20:07:54.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:54.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:54.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 626 sec 2023-10-16T20:07:55.559 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 627 sec 2023-10-16T20:07:56.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 628 sec 2023-10-16T20:07:57.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 629 sec 2023-10-16T20:07:58.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 630 sec 2023-10-16T20:07:59.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 631 sec 2023-10-16T20:08:00.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 632 sec 2023-10-16T20:08:01.560 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 633 sec 2023-10-16T20:08:02.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 634 sec 2023-10-16T20:08:03.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 635 sec 2023-10-16T20:08:04.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 636 sec 2023-10-16T20:08:05.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 637 sec 2023-10-16T20:08:06.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 638 sec 2023-10-16T20:08:07.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 639 sec 2023-10-16T20:08:08.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 640 sec 2023-10-16T20:08:09.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 641 sec 2023-10-16T20:08:10.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 642 sec 2023-10-16T20:08:11.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 643 sec 2023-10-16T20:08:12.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 644 sec 2023-10-16T20:08:13.561 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 645 sec 2023-10-16T20:08:14.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 646 sec 2023-10-16T20:08:15.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 647 sec 2023-10-16T20:08:16.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 648 sec 2023-10-16T20:08:17.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 649 sec 2023-10-16T20:08:18.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 650 sec 2023-10-16T20:08:19.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 651 sec 2023-10-16T20:08:20.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 652 sec 2023-10-16T20:08:21.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 653 sec 2023-10-16T20:08:22.562 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 654 sec 2023-10-16T20:08:23.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 655 sec 2023-10-16T20:08:24.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:24.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:24.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 656 sec 2023-10-16T20:08:25.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 657 sec 2023-10-16T20:08:26.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 658 sec 2023-10-16T20:08:27.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 659 sec 2023-10-16T20:08:28.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 660 sec 2023-10-16T20:08:29.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 661 sec 2023-10-16T20:08:30.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 662 sec 2023-10-16T20:08:31.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 663 sec 2023-10-16T20:08:32.563 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 664 sec 2023-10-16T20:08:33.565 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 665 sec 2023-10-16T20:08:34.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 666 sec 2023-10-16T20:08:35.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 667 sec 2023-10-16T20:08:36.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 668 sec 2023-10-16T20:08:37.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 669 sec 2023-10-16T20:08:38.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 670 sec 2023-10-16T20:08:39.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 671 sec 2023-10-16T20:08:40.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 672 sec 2023-10-16T20:08:41.566 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 673 sec 2023-10-16T20:08:42.564 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 674 sec 2023-10-16T20:08:43.565 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 675 sec 2023-10-16T20:08:44.565 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 676 sec 2023-10-16T20:08:45.565 INFO:tasks.workunit.client.0.smithi057.stdout: 10 cleanup 677 sec 2023-10-16T20:08:46.565 INFO:tasks.workunit.client.0.smithi057.stdout: 9 cleanup 678 sec 2023-10-16T20:08:47.565 INFO:tasks.workunit.client.0.smithi057.stdout: 7 cleanup 679 sec 2023-10-16T20:08:48.565 INFO:tasks.workunit.client.0.smithi057.stdout: 6 cleanup 680 sec 2023-10-16T20:08:49.565 INFO:tasks.workunit.client.0.smithi057.stdout: 5 cleanup 681 sec 2023-10-16T20:08:50.565 INFO:tasks.workunit.client.0.smithi057.stdout: 4 cleanup 682 sec 2023-10-16T20:08:51.566 INFO:tasks.workunit.client.0.smithi057.stdout: 4 cleanup 683 sec 2023-10-16T20:08:52.566 INFO:tasks.workunit.client.0.smithi057.stdout: 4 cleanup 684 sec 2023-10-16T20:08:53.566 INFO:tasks.workunit.client.0.smithi057.stdout: 3 cleanup 685 sec 2023-10-16T20:08:54.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:54.426 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:54.566 INFO:tasks.workunit.client.0.smithi057.stdout: 3 cleanup 686 sec 2023-10-16T20:08:55.566 INFO:tasks.workunit.client.0.smithi057.stdout: 2 cleanup 687 sec 2023-10-16T20:08:56.566 INFO:tasks.workunit.client.0.smithi057.stdout: 2 cleanup 688 sec 2023-10-16T20:08:57.566 INFO:tasks.workunit.client.0.smithi057.stdout: 2 cleanup 689 sec 2023-10-16T20:08:58.567 INFO:tasks.workunit.client.0.smithi057.stdout: 2 cleanup 690 sec 2023-10-16T20:08:59.566 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 691 sec 2023-10-16T20:09:00.567 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 692 sec 2023-10-16T20:09:01.567 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 693 sec 2023-10-16T20:09:02.567 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 694 sec 2023-10-16T20:09:03.567 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 695 sec 2023-10-16T20:09:04.567 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 696 sec 2023-10-16T20:09:05.567 INFO:tasks.workunit.client.0.smithi057.stdout: 1 cleanup 697 sec 2023-10-16T20:09:06.468 INFO:tasks.workunit.client.0.smithi057.stdout: 0 cleanup 698 sec 2023-10-16T20:09:06.468 INFO:tasks.workunit.client.0.smithi057.stdout: 2023-10-16T20:09:06.469 INFO:tasks.workunit.client.0.smithi057.stdout: Operation Count AvgLat MaxLat 2023-10-16T20:09:06.469 INFO:tasks.workunit.client.0.smithi057.stdout: ---------------------------------------- 2023-10-16T20:09:06.469 INFO:tasks.workunit.client.0.smithi057.stdout: NTCreateX 1459 1512.101 3863.347 2023-10-16T20:09:06.469 INFO:tasks.workunit.client.0.smithi057.stdout: Close 1325 21.330 165.936 2023-10-16T20:09:06.469 INFO:tasks.workunit.client.0.smithi057.stdout: Rename 100 2894.994 4314.602 2023-10-16T20:09:06.470 INFO:tasks.workunit.client.0.smithi057.stdout: Unlink 170 1154.584 1978.674 2023-10-16T20:09:06.470 INFO:tasks.workunit.client.0.smithi057.stdout: Qpathinfo 940 801.091 3564.254 2023-10-16T20:09:06.470 INFO:tasks.workunit.client.0.smithi057.stdout: Qfileinfo 570 79.968 250.480 2023-10-16T20:09:06.470 INFO:tasks.workunit.client.0.smithi057.stdout: Qfsinfo 330 169.591 388.670 2023-10-16T20:09:06.470 INFO:tasks.workunit.client.0.smithi057.stdout: Sfileinfo 340 510.347 1218.465 2023-10-16T20:09:06.471 INFO:tasks.workunit.client.0.smithi057.stdout: Find 460 4140.110 5771.355 2023-10-16T20:09:06.471 INFO:tasks.workunit.client.0.smithi057.stdout: WriteX 2692 113.994 424.985 2023-10-16T20:09:06.471 INFO:tasks.workunit.client.0.smithi057.stdout: ReadX 2132 0.543 173.636 2023-10-16T20:09:06.471 INFO:tasks.workunit.client.0.smithi057.stdout: Flush 240 266.350 1119.643 2023-10-16T20:09:06.471 INFO:tasks.workunit.client.0.smithi057.stdout: 2023-10-16T20:09:06.472 INFO:tasks.workunit.client.0.smithi057.stdout:Throughput 0.238883 MB/sec 10 clients 10 procs max_latency=5771.373 ms 2023-10-16T20:09:06.473 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-16T20:09:06.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-16T20:09:24.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:24.776 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:41.094 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:29:40.654 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.119 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:29:40.679 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.137 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:29:40.685 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.140 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:29:40.688 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.143 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:29:40.692 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.149 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:29:40.697 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.287 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:29:40.835 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.290 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:29:40.839 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:41.314 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:29:40.874 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:09:54.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:54.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:20.667 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-10-16T20:10:20.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-16T20:10:21.748 DEBUG:teuthology.parallel:result is None 2023-10-16T20:10:21.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-16T20:10:22.723 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-16T20:10:22.723 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-16T20:10:22.733 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-16T20:10:22.733 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T20:10:22.734 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:10:22.794 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T20:10:22.795 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:10:22.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:10:23.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.070+0000 7fc94b4da640 1 Processor -- start 2023-10-16T20:10:23.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.070+0000 7fc94b4da640 1 -- start start 2023-10-16T20:10:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.072+0000 7fc94b4da640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 0x7fc94406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.072+0000 7fc94b4da640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc944151570 con 0x7fc9440c12f0 2023-10-16T20:10:23.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.072+0000 7fc94b4da640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9440c5530 con 0x7fc944151190 2023-10-16T20:10:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.072+0000 7fc94b4da640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c4010 con 0x7fc9440c2c70 2023-10-16T20:10:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.073+0000 7fc948a75640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc9440c12f0 0x7fc94406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38542/0 (socket says 172.21.15.57:38542) 2023-10-16T20:10:23.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.073+0000 7fc948a75640 1 -- 172.21.15.57:0/3271526186 learned_addr learned my addr 172.21.15.57:0/3271526186 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:23.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.074+0000 7fc949a77640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 0x7fc94406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:23.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.076+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638336388 0 0) 0x7fc944151570 con 0x7fc9440c12f0 2023-10-16T20:10:23.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.077+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc92c003520 con 0x7fc9440c12f0 2023-10-16T20:10:23.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.080+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623149286 0 0) 0x7fc92c003520 con 0x7fc9440c12f0 2023-10-16T20:10:23.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.080+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 msgr2=0x7fc94406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:23.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.080+0000 7fc943fff640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 0x7fc94406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.080+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 >> v1:172.21.15.110:6789/0 conn(0x7fc944151190 legacy=0x7fc9440c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94415af20 con 0x7fc9440c12f0 2023-10-16T20:10:23.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7fc938001670 con 0x7fc9440c12f0 2023-10-16T20:10:23.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 >> v1:172.21.15.57:6789/0 conn(0x7fc9440c12f0 legacy=0x7fc94406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 0x7fc92c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc92c003f70 0x7fc92c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc92c004d00 0x7fc92c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c4010 con 0x7fc92c004d00 2023-10-16T20:10:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c00bac0 con 0x7fc92c003f70 2023-10-16T20:10:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.081+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c00bc80 con 0x7fc9440c2c70 2023-10-16T20:10:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.085+0000 7fc949a77640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc92c004d00 0x7fc92c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:23.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.088+0000 7fc949a77640 1 -- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 msgr2=0x7fc92c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:23.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.088+0000 7fc949a77640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9440c2c70 0x7fc92c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.088+0000 7fc949a77640 1 -- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc92c003f70 msgr2=0x7fc92c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:23.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.088+0000 7fc949a77640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc92c003f70 0x7fc92c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.088+0000 7fc949a77640 1 -- 172.21.15.57:0/3271526186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c003520 con 0x7fc92c004d00 2023-10-16T20:10:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.090+0000 7fc949a77640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc92c004d00 0x7fc92c005180 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009ac0 tx=0x7fc92c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4f8f3dd15222e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c02c710 con 0x7fc92c004d00 2023-10-16T20:10:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c02c870 con 0x7fc92c004d00 2023-10-16T20:10:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc943fff640 1 -- 172.21.15.57:0/3271526186 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c02cc00 con 0x7fc92c004d00 2023-10-16T20:10:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc94b4da640 1 -- 172.21.15.57:0/3271526186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc92c004d00 msgr2=0x7fc92c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc94b4da640 1 --2- 172.21.15.57:0/3271526186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc92c004d00 0x7fc92c005180 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009ac0 tx=0x7fc92c0057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc949a77640 1 -- 172.21.15.57:0/3271526186 reap_dead start 2023-10-16T20:10:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc94b4da640 1 -- 172.21.15.57:0/3271526186 shutdown_connections 2023-10-16T20:10:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.096+0000 7fc94b4da640 1 -- 172.21.15.57:0/3271526186 >> 172.21.15.57:0/3271526186 conn(0x7fc94406c430 msgr2=0x7fc944069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.097+0000 7fc94b4da640 1 -- 172.21.15.57:0/3271526186 shutdown_connections 2023-10-16T20:10:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.097+0000 7fc94b4da640 1 -- 172.21.15.57:0/3271526186 wait complete. 2023-10-16T20:10:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.099+0000 7fc94b4da640 1 Processor -- start 2023-10-16T20:10:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.099+0000 7fc94b4da640 1 -- start start 2023-10-16T20:10:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.100+0000 7fc94b4da640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9441e4890 0x7fc9441e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.100+0000 7fc94b4da640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9441e51b0 0x7fc9441e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.100+0000 7fc94b4da640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 0x7fc9441e1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.100+0000 7fc94b4da640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c0260 con 0x7fc9440bfd20 2023-10-16T20:10:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.100+0000 7fc94b4da640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440bed00 con 0x7fc9441e51b0 2023-10-16T20:10:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.100+0000 7fc94b4da640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440befe0 con 0x7fc9441e4890 2023-10-16T20:10:23.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.101+0000 7fc949a77640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 0x7fc9441e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:23.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.101+0000 7fc949a77640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 0x7fc9441e1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45784/0 (socket says 172.21.15.57:45784) 2023-10-16T20:10:23.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.101+0000 7fc949a77640 1 -- 172.21.15.57:0/1138938701 learned_addr learned my addr 172.21.15.57:0/1138938701 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.102+0000 7fc948a75640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9441e51b0 0x7fc9441e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.102+0000 7fc949276640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9441e4890 0x7fc9441e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.105+0000 7fc949a77640 1 -- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9441e4890 msgr2=0x7fc9441e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.105+0000 7fc949a77640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9441e4890 0x7fc9441e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.105+0000 7fc949a77640 1 -- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9441e51b0 msgr2=0x7fc9441e1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.105+0000 7fc949a77640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9441e51b0 0x7fc9441e1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.105+0000 7fc949a77640 1 -- 172.21.15.57:0/1138938701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9440bf2c0 con 0x7fc9440bfd20 2023-10-16T20:10:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.105+0000 7fc948a75640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9441e51b0 0x7fc9441e1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:10:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.108+0000 7fc949a77640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 0x7fc9441e1550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc93c037040 tx=0x7fc93c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:23.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.113+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c02c710 con 0x7fc9440bfd20 2023-10-16T20:10:23.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.113+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c003810 con 0x7fc9440bfd20 2023-10-16T20:10:23.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.113+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c003bc0 con 0x7fc9440bfd20 2023-10-16T20:10:23.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.113+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9440bf5a0 con 0x7fc9440bfd20 2023-10-16T20:10:23.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.114+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9440c9ab0 con 0x7fc9440bfd20 2023-10-16T20:10:23.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.115+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9440c7510 con 0x7fc9440bfd20 2023-10-16T20:10:23.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.141+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc93c003d20 con 0x7fc9440bfd20 2023-10-16T20:10:23.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.142+0000 7fc941ffb640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc93006aef0 0x7fc93006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:23.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.143+0000 7fc949276640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc93006aef0 0x7fc93006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:23.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.144+0000 7fc949276640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc93006aef0 0x7fc93006d3b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc934001d80 tx=0x7fc934009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:23.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.455+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc93c079b40 con 0x7fc9440bfd20 2023-10-16T20:10:23.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.456+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc93c075780 con 0x7fc9440bfd20 2023-10-16T20:10:23.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.671+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc944154a10 con 0x7fc9440bfd20 2023-10-16T20:10:23.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.770+0000 7fc941ffb640 1 -- 172.21.15.57:0/1138938701 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fc93c039020 con 0x7fc9440bfd20 2023-10-16T20:10:23.773 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:23.773 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:10:23.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.773+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc93006aef0 msgr2=0x7fc93006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.773+0000 7fc94b4da640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc93006aef0 0x7fc93006d3b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc934001d80 tx=0x7fc934009040 comp rx=0 tx=0).stop 2023-10-16T20:10:23.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.773+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 msgr2=0x7fc9441e1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:23.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.773+0000 7fc94b4da640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 0x7fc9441e1550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc93c037040 tx=0x7fc93c004730 comp rx=0 tx=0).stop 2023-10-16T20:10:23.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 shutdown_connections 2023-10-16T20:10:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc93006aef0 0x7fc93006d3b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9440bfd20 0x7fc9441e1550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9441e51b0 0x7fc9441e1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 --2- 172.21.15.57:0/1138938701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9441e4890 0x7fc9441e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 >> 172.21.15.57:0/1138938701 conn(0x7fc94406c430 msgr2=0x7fc944070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 shutdown_connections 2023-10-16T20:10:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:23.774+0000 7fc94b4da640 1 -- 172.21.15.57:0/1138938701 wait complete. 2023-10-16T20:10:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:40:38.255594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:40:53.908842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:40:56.364727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T20:10:23.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:10:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.030+0000 7f3b0b143640 1 Processor -- start 2023-10-16T20:10:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.031+0000 7f3b0b143640 1 -- start start 2023-10-16T20:10:24.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.032+0000 7f3b0b143640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b040c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.032+0000 7f3b0b143640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040c6190 con 0x7f3b040c7010 2023-10-16T20:10:24.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.032+0000 7f3b0b143640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b04153540 con 0x7f3b040b4310 2023-10-16T20:10:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.032+0000 7f3b0b143640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04159310 con 0x7f3b04153160 2023-10-16T20:10:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.033+0000 7f3b0a942640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3b040c7010 0x7f3b04163650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38548/0 (socket says 172.21.15.57:38548) 2023-10-16T20:10:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.033+0000 7f3b0a942640 1 -- 172.21.15.57:0/2955141266 learned_addr learned my addr 172.21.15.57:0/2955141266 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.034+0000 7f3b0a141640 1 --2- 172.21.15.57:0/2955141266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b040c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.037+0000 7f3b0913f640 1 -- 172.21.15.57:0/2955141266 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316287907 0 0) 0x7f3b040c6190 con 0x7f3b040c7010 2023-10-16T20:10:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.037+0000 7f3b0913f640 1 -- 172.21.15.57:0/2955141266 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af0003520 con 0x7f3b040c7010 2023-10-16T20:10:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.041+0000 7f3b0a141640 1 -- 172.21.15.57:0/2955141266 >> v1:172.21.15.110:6789/0 conn(0x7f3b040b4310 legacy=0x7f3b040c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.041+0000 7f3b0a141640 1 -- 172.21.15.57:0/2955141266 >> v1:172.21.15.57:6789/0 conn(0x7f3b040c7010 legacy=0x7f3b04163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.041+0000 7f3b0a141640 1 -- 172.21.15.57:0/2955141266 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b041595f0 con 0x7f3b04153160 2023-10-16T20:10:24.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.047+0000 7f3b0a141640 1 --2- 172.21.15.57:0/2955141266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b040c9330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009dc0 tx=0x7f3b0002bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b8b954a442a08 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.057+0000 7f3b0913f640 1 -- 172.21.15.57:0/2955141266 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0002ccc0 con 0x7f3b04153160 2023-10-16T20:10:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.057+0000 7f3b0913f640 1 -- 172.21.15.57:0/2955141266 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0002ce20 con 0x7f3b04153160 2023-10-16T20:10:24.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.057+0000 7f3b0913f640 1 -- 172.21.15.57:0/2955141266 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00034660 con 0x7f3b04153160 2023-10-16T20:10:24.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.058+0000 7f3b0b143640 1 -- 172.21.15.57:0/2955141266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 msgr2=0x7f3b040c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.058+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2955141266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b040c9330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009dc0 tx=0x7f3b0002bf10 comp rx=0 tx=0).stop 2023-10-16T20:10:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.058+0000 7f3b0b143640 1 -- 172.21.15.57:0/2955141266 shutdown_connections 2023-10-16T20:10:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.058+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2955141266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b040c9330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.058+0000 7f3b0b143640 1 -- 172.21.15.57:0/2955141266 >> 172.21.15.57:0/2955141266 conn(0x7f3b040ce5b0 msgr2=0x7f3b040ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.059+0000 7f3b0b143640 1 -- 172.21.15.57:0/2955141266 shutdown_connections 2023-10-16T20:10:24.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.059+0000 7f3b0b143640 1 -- 172.21.15.57:0/2955141266 wait complete. 2023-10-16T20:10:24.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.061+0000 7f3b0b143640 1 Processor -- start 2023-10-16T20:10:24.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.061+0000 7f3b0b143640 1 -- start start 2023-10-16T20:10:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.062+0000 7f3b0b143640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b040b4310 0x7f3b040c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.062+0000 7f3b0b143640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b040c7010 0x7f3b040c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.062+0000 7f3b0b143640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b04157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.062+0000 7f3b0b143640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041f24c0 con 0x7f3b040b4310 2023-10-16T20:10:24.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.062+0000 7f3b0b143640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c41f0 con 0x7f3b040c7010 2023-10-16T20:10:24.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.062+0000 7f3b0b143640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041f15c0 con 0x7f3b04153160 2023-10-16T20:10:24.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.064+0000 7f3b0a942640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b04157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.064+0000 7f3b0a942640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b04157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:49216/0 (socket says 172.21.15.57:49216) 2023-10-16T20:10:24.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.065+0000 7f3b0a942640 1 -- 172.21.15.57:0/2444977005 learned_addr learned my addr 172.21.15.57:0/2444977005 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:24.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.066+0000 7f3b09940640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b040c7010 0x7f3b040c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.075+0000 7f3b0a942640 1 -- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b040c7010 msgr2=0x7f3b040c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.075+0000 7f3b0a942640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b040c7010 0x7f3b040c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.075+0000 7f3b0a942640 1 -- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b040b4310 msgr2=0x7f3b040c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.075+0000 7f3b0a942640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b040b4310 0x7f3b040c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.075+0000 7f3b0a942640 1 -- 172.21.15.57:0/2444977005 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00009a70 con 0x7f3b04153160 2023-10-16T20:10:24.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.082+0000 7f3b0a942640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b04157eb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c430 tx=0x7f3afc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:24.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.092+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc005ce0 con 0x7f3b04153160 2023-10-16T20:10:24.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.092+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc005e40 con 0x7f3b04153160 2023-10-16T20:10:24.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.092+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc007310 con 0x7f3b04153160 2023-10-16T20:10:24.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.093+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040c4440 con 0x7f3b04153160 2023-10-16T20:10:24.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.093+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b041f1b20 con 0x7f3b04153160 2023-10-16T20:10:24.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.094+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b04068d50 con 0x7f3b04153160 2023-10-16T20:10:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.435+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3afc007470 con 0x7f3b04153160 2023-10-16T20:10:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.437+0000 7f3afaffd640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3ae806aec0 0x7f3ae806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.438+0000 7f3b0a141640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3ae806aec0 0x7f3ae806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.441+0000 7f3b0a141640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3ae806aec0 0x7f3ae806d380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b00036000 tx=0x7f3b0002cf90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:24.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.443+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3afc057e80 con 0x7f3b04153160 2023-10-16T20:10:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.475+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3afc0541c0 con 0x7f3b04153160 2023-10-16T20:10:24.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.704+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b0404e160 con 0x7f3b04153160 2023-10-16T20:10:24.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.719+0000 7f3afaffd640 1 -- 172.21.15.57:0/2444977005 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3afc017020 con 0x7f3b04153160 2023-10-16T20:10:24.722 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-16T20:10:24.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3ae806aec0 msgr2=0x7f3ae806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3ae806aec0 0x7f3ae806d380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b00036000 tx=0x7f3b0002cf90 comp rx=0 tx=0).stop 2023-10-16T20:10:24.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 msgr2=0x7f3b04157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b04157eb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c430 tx=0x7f3afc00c8f0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 shutdown_connections 2023-10-16T20:10:24.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3ae806aec0 0x7f3ae806d380 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b04153160 0x7f3b04157eb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b040c7010 0x7f3b040c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 --2- 172.21.15.57:0/2444977005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b040b4310 0x7f3b040c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 >> 172.21.15.57:0/2444977005 conn(0x7f3b040ce5b0 msgr2=0x7f3b040cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:24.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 shutdown_connections 2023-10-16T20:10:24.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.723+0000 7f3b0b143640 1 -- 172.21.15.57:0/2444977005 wait complete. 2023-10-16T20:10:24.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:10:24.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.964+0000 7f4fbdcb6640 1 Processor -- start 2023-10-16T20:10:24.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.964+0000 7f4fbdcb6640 1 -- start start 2023-10-16T20:10:24.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.966+0000 7f4fbdcb6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fb8153240 0x7f4fb8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.966+0000 7f4fbdcb6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 0x7f4fb806fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.966+0000 7f4fbdcb6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb806ba90 con 0x7f4fb8159b60 2023-10-16T20:10:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.966+0000 7f4fbdcb6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb80708e0 con 0x7f4fb8153240 2023-10-16T20:10:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.966+0000 7f4fbdcb6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8158ef0 con 0x7f4fb806f9f0 2023-10-16T20:10:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.967+0000 7f4fb7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4fb8159b60 0x7f4fb80c5710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38554/0 (socket says 172.21.15.57:38554) 2023-10-16T20:10:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.967+0000 7f4fb7fff640 1 -- 172.21.15.57:0/389448558 learned_addr learned my addr 172.21.15.57:0/389448558 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.968+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/389448558 >> v2:172.21.15.110:3300/0 conn(0x7f4fb8153240 0x7f4fb8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.968+0000 7f4fbd4b5640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 0x7f4fb806fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.970+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407818319 0 0) 0x7f4fb806ba90 con 0x7f4fb8159b60 2023-10-16T20:10:24.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.971+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa8003520 con 0x7f4fb8159b60 2023-10-16T20:10:24.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498687776 0 0) 0x7f4fa8003520 con 0x7f4fb8159b60 2023-10-16T20:10:24.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 msgr2=0x7f4fb806fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 0x7f4fb806fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 >> v2:172.21.15.110:3300/0 conn(0x7f4fb8153240 msgr2=0x7f4fb8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 --2- 172.21.15.57:0/389448558 >> v2:172.21.15.110:3300/0 conn(0x7f4fb8153240 0x7f4fb8159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8153620 con 0x7f4fb8159b60 2023-10-16T20:10:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f4fa4001670 con 0x7f4fb8159b60 2023-10-16T20:10:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 >> v1:172.21.15.57:6789/0 conn(0x7f4fb8159b60 legacy=0x7f4fb80c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fa8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 0x7f4fa80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fa8004d00 0x7f4fa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80708e0 con 0x7f4fa8003970 2023-10-16T20:10:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8158ef0 con 0x7f4fa8004d00 2023-10-16T20:10:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.976+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa800b980 con 0x7f4fb806f9f0 2023-10-16T20:10:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.981+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fa8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:24.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.985+0000 7f4fbccb4640 1 -- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 msgr2=0x7f4fa80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:24.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.985+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb806f9f0 0x7f4fa80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.985+0000 7f4fbccb4640 1 -- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fa8004d00 msgr2=0x7f4fa8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:24.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.985+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fa8004d00 0x7f4fa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:24.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.985+0000 7f4fbccb4640 1 -- 172.21.15.57:0/389448558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8003520 con 0x7f4fa8003970 2023-10-16T20:10:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.989+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fa8003d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009af0 tx=0x7f4fa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2d19bc7936ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.997+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac02c710 con 0x7f4fa8003970 2023-10-16T20:10:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.997+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac02c870 con 0x7f4fa8003970 2023-10-16T20:10:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.997+0000 7f4fb77fe640 1 -- 172.21.15.57:0/389448558 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac02cc00 con 0x7f4fa8003970 2023-10-16T20:10:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.998+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/389448558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 msgr2=0x7f4fa8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.998+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/389448558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fa8003d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009af0 tx=0x7f4fa80057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.998+0000 7f4fbd4b5640 1 -- 172.21.15.57:0/389448558 reap_dead start 2023-10-16T20:10:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.999+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/389448558 shutdown_connections 2023-10-16T20:10:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.999+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/389448558 >> 172.21.15.57:0/389448558 conn(0x7f4fb80ca380 msgr2=0x7f4fb80ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.999+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/389448558 shutdown_connections 2023-10-16T20:10:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:24.999+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/389448558 wait complete. 2023-10-16T20:10:25.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.002+0000 7f4fbdcb6640 1 Processor -- start 2023-10-16T20:10:25.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.002+0000 7f4fbdcb6640 1 -- start start 2023-10-16T20:10:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.004+0000 7f4fbdcb6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fb81537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.004+0000 7f4fbdcb6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb814cb40 0x7f4fb8146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.004+0000 7f4fbdcb6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb80c92e0 0x7f4fb80c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:25.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.004+0000 7f4fbdcb6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb814fbf0 con 0x7f4fa8003970 2023-10-16T20:10:25.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.004+0000 7f4fbdcb6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8156890 con 0x7f4fb814cb40 2023-10-16T20:10:25.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.004+0000 7f4fbdcb6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb81559c0 con 0x7f4fb80c92e0 2023-10-16T20:10:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.005+0000 7f4fbccb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fb81537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.006+0000 7f4fbccb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fb81537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45810/0 (socket says 172.21.15.57:45810) 2023-10-16T20:10:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.006+0000 7f4fbccb4640 1 -- 172.21.15.57:0/3079145526 learned_addr learned my addr 172.21.15.57:0/3079145526 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.006+0000 7f4fb7fff640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb814cb40 0x7f4fb8146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:25.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.006+0000 7f4fbd4b5640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb80c92e0 0x7f4fb80c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:25.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.013+0000 7f4fbccb4640 1 -- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb80c92e0 msgr2=0x7f4fb80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:25.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.013+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb80c92e0 0x7f4fb80c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.013+0000 7f4fbccb4640 1 -- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb814cb40 msgr2=0x7f4fb8146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:25.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.013+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb814cb40 0x7f4fb8146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.013+0000 7f4fbccb4640 1 -- 172.21.15.57:0/3079145526 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb81562d0 con 0x7f4fa8003970 2023-10-16T20:10:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.017+0000 7f4fbccb4640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fb81537e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009af0 tx=0x7f4fac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.021+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac003810 con 0x7f4fa8003970 2023-10-16T20:10:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.022+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac003990 con 0x7f4fa8003970 2023-10-16T20:10:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.022+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac003d40 con 0x7f4fa8003970 2023-10-16T20:10:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.022+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb81565b0 con 0x7f4fa8003970 2023-10-16T20:10:25.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.022+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb8155650 con 0x7f4fa8003970 2023-10-16T20:10:25.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.024+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb81551b0 con 0x7f4fa8003970 2023-10-16T20:10:25.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.054+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4fac03b070 con 0x7f4fa8003970 2023-10-16T20:10:25.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.056+0000 7f4fb57fa640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4f9c06ae70 0x7f4f9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:25.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.056+0000 7f4fb7fff640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4f9c06ae70 0x7f4f9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.058+0000 7f4fb7fff640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4f9c06ae70 0x7f4f9c06d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4001eb0 tx=0x7f4fa4000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:25.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.344+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4fac07a4a0 con 0x7f4fa8003970 2023-10-16T20:10:25.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.345+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4fac0767e0 con 0x7f4fa8003970 2023-10-16T20:10:25.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:25.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:25.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.571+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fb80c6730 con 0x7f4fa8003970 2023-10-16T20:10:25.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.711+0000 7f4fb57fa640 1 -- 172.21.15.57:0/3079145526 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fac0390a0 con 0x7f4fa8003970 2023-10-16T20:10:25.714 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-16T20:10:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.714+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4f9c06ae70 msgr2=0x7f4f9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.714+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4f9c06ae70 0x7f4f9c06d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4001eb0 tx=0x7f4fa4000bc0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.714+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 msgr2=0x7f4fb81537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:25.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.714+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fb81537e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009af0 tx=0x7f4fac004730 comp rx=0 tx=0).stop 2023-10-16T20:10:25.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 shutdown_connections 2023-10-16T20:10:25.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f4f9c06ae70 0x7f4f9c06d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4fb80c92e0 0x7f4fb80c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fb814cb40 0x7f4fb8146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 --2- 172.21.15.57:0/3079145526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fa8003970 0x7f4fb81537e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 >> 172.21.15.57:0/3079145526 conn(0x7f4fb80ca380 msgr2=0x7f4fb80ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:25.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 shutdown_connections 2023-10-16T20:10:25.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.715+0000 7f4fbdcb6640 1 -- 172.21.15.57:0/3079145526 wait complete. 2023-10-16T20:10:25.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:10:25.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.974+0000 7fa4ae456640 1 Processor -- start 2023-10-16T20:10:25.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.974+0000 7fa4ae456640 1 -- start start 2023-10-16T20:10:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.975+0000 7fa4ae456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.975+0000 7fa4ae456640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa4a806a7f0 0x7fa4a80c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.976+0000 7fa4ae456640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a8159460 con 0x7fa4a806fc20 2023-10-16T20:10:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.976+0000 7fa4ae456640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a806d220 con 0x7fa4a806a7f0 2023-10-16T20:10:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.976+0000 7fa4ae456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8071700 con 0x7fa4a814f1d0 2023-10-16T20:10:25.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.976+0000 7fa4ac9f3640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa4a806fc20 0x7fa4a8154ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54100/0 (socket says 172.21.15.57:54100) 2023-10-16T20:10:25.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.977+0000 7fa4ac9f3640 1 -- 172.21.15.57:0/762791075 learned_addr learned my addr 172.21.15.57:0/762791075 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:25.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.978+0000 7fa4a7fff640 1 --2- 172.21.15.57:0/762791075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:25.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.978+0000 7fa4a77fe640 1 --2- 172.21.15.57:0/762791075 >> v2:172.21.15.110:3300/0 conn(0x7fa4a806a7f0 0x7fa4a80c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:25.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.981+0000 7fa4a6ffd640 1 -- 172.21.15.57:0/762791075 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515492318 0 0) 0x7fa4a8159460 con 0x7fa4a806fc20 2023-10-16T20:10:25.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.981+0000 7fa4a6ffd640 1 -- 172.21.15.57:0/762791075 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa490005730 con 0x7fa4a806fc20 2023-10-16T20:10:25.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.987+0000 7fa4a7fff640 1 -- 172.21.15.57:0/762791075 >> v2:172.21.15.110:3300/0 conn(0x7fa4a806a7f0 msgr2=0x7fa4a80c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:25.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.987+0000 7fa4a7fff640 1 --2- 172.21.15.57:0/762791075 >> v2:172.21.15.110:3300/0 conn(0x7fa4a806a7f0 0x7fa4a80c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:25.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.987+0000 7fa4a7fff640 1 -- 172.21.15.57:0/762791075 >> v1:172.21.15.57:6789/0 conn(0x7fa4a806fc20 legacy=0x7fa4a8154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.987+0000 7fa4a7fff640 1 -- 172.21.15.57:0/762791075 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a81588e0 con 0x7fa4a814f1d0 2023-10-16T20:10:25.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:25.995+0000 7fa4a7fff640 1 --2- 172.21.15.57:0/762791075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c4da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95e3a8a4d3496de server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:26.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.006+0000 7fa4a6ffd640 1 -- 172.21.15.57:0/762791075 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498031780 con 0x7fa4a814f1d0 2023-10-16T20:10:26.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.006+0000 7fa4a6ffd640 1 -- 172.21.15.57:0/762791075 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4980318e0 con 0x7fa4a814f1d0 2023-10-16T20:10:26.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.006+0000 7fa4a6ffd640 1 -- 172.21.15.57:0/762791075 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498031c70 con 0x7fa4a814f1d0 2023-10-16T20:10:26.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 -- 172.21.15.57:0/762791075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 msgr2=0x7fa4a80c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:26.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 --2- 172.21.15.57:0/762791075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c4da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802b820 comp rx=0 tx=0).stop 2023-10-16T20:10:26.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 -- 172.21.15.57:0/762791075 shutdown_connections 2023-10-16T20:10:26.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 --2- 172.21.15.57:0/762791075 >> v2:172.21.15.110:3300/0 conn(0x7fa4a806a7f0 0x7fa4a80c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 --2- 172.21.15.57:0/762791075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c4da0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 -- 172.21.15.57:0/762791075 >> 172.21.15.57:0/762791075 conn(0x7fa4a80c6ea0 msgr2=0x7fa4a80c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:26.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 -- 172.21.15.57:0/762791075 shutdown_connections 2023-10-16T20:10:26.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.007+0000 7fa4ae456640 1 -- 172.21.15.57:0/762791075 wait complete. 2023-10-16T20:10:26.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.010+0000 7fa4ae456640 1 Processor -- start 2023-10-16T20:10:26.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.010+0000 7fa4ae456640 1 -- start start 2023-10-16T20:10:26.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.012+0000 7fa4ae456640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 0x7fa4a81ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:26.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.012+0000 7fa4ae456640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a806fc20 0x7fa4a80c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:26.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.012+0000 7fa4ae456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:26.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.012+0000 7fa4ae456640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c63f0 con 0x7fa4a806a7f0 2023-10-16T20:10:26.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.012+0000 7fa4ae456640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c8bb0 con 0x7fa4a806fc20 2023-10-16T20:10:26.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.012+0000 7fa4ae456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c8e50 con 0x7fa4a814f1d0 2023-10-16T20:10:26.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.013+0000 7fa4a7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 0x7fa4a81ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:26.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.014+0000 7fa4a7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 0x7fa4a81ee400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37748/0 (socket says 172.21.15.57:37748) 2023-10-16T20:10:26.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.014+0000 7fa4a7fff640 1 -- 172.21.15.57:0/2657007288 learned_addr learned my addr 172.21.15.57:0/2657007288 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:26.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.015+0000 7fa4ac9f3640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:26.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.015+0000 7fa4a77fe640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a806fc20 0x7fa4a80c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.019+0000 7fa4a7fff640 1 -- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 msgr2=0x7fa4a80c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.019+0000 7fa4a7fff640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.019+0000 7fa4a7fff640 1 -- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a806fc20 msgr2=0x7fa4a80c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.019+0000 7fa4a7fff640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a806fc20 0x7fa4a80c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.019+0000 7fa4a7fff640 1 -- 172.21.15.57:0/2657007288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498009400 con 0x7fa4a806a7f0 2023-10-16T20:10:26.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.022+0000 7fa4a7fff640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 0x7fa4a81ee400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa498034040 tx=0x7fa4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.028+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498032820 con 0x7fa4a806a7f0 2023-10-16T20:10:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.028+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498032980 con 0x7fa4a806a7f0 2023-10-16T20:10:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.028+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498032d30 con 0x7fa4a806a7f0 2023-10-16T20:10:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.028+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a80c6640 con 0x7fa4a806a7f0 2023-10-16T20:10:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.028+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a81edc00 con 0x7fa4a806a7f0 2023-10-16T20:10:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.030+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a814cf00 con 0x7fa4a806a7f0 2023-10-16T20:10:26.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.365+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa49804d3f0 con 0x7fa4a806a7f0 2023-10-16T20:10:26.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.367+0000 7fa4a4ff9640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa49406aec0 0x7fa49406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:26.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.368+0000 7fa4a77fe640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa49406aec0 0x7fa49406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.370+0000 7fa4a77fe640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa49406aec0 0x7fa49406d380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80c22f0 tx=0x7fa49c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:26.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.394+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa49807a150 con 0x7fa4a806a7f0 2023-10-16T20:10:26.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.395+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa498076490 con 0x7fa4a806a7f0 2023-10-16T20:10:26.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.608+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4a804e160 con 0x7fa4a806a7f0 2023-10-16T20:10:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.738+0000 7fa4a4ff9640 1 -- 172.21.15.57:0/2657007288 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa498079ab0 con 0x7fa4a806a7f0 2023-10-16T20:10:26.741 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-16T20:10:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.741+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa49406aec0 msgr2=0x7fa49406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.741+0000 7fa4ae456640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa49406aec0 0x7fa49406d380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80c22f0 tx=0x7fa49c009190 comp rx=0 tx=0).stop 2023-10-16T20:10:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.741+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 msgr2=0x7fa4a81ee400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.741+0000 7fa4ae456640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 0x7fa4a81ee400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa498034040 tx=0x7fa4980046c0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 shutdown_connections 2023-10-16T20:10:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa49406aec0 0x7fa49406d380 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4a814f1d0 0x7fa4a80c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a806fc20 0x7fa4a80c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 --2- 172.21.15.57:0/2657007288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4a806a7f0 0x7fa4a81ee400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 >> 172.21.15.57:0/2657007288 conn(0x7fa4a80c6ea0 msgr2=0x7fa4a814c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 shutdown_connections 2023-10-16T20:10:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:26.742+0000 7fa4ae456640 1 -- 172.21.15.57:0/2657007288 wait complete. 2023-10-16T20:10:26.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:10:27.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.002+0000 7fd06f2d0640 1 Processor -- start 2023-10-16T20:10:27.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.002+0000 7fd06f2d0640 1 -- start start 2023-10-16T20:10:27.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.003+0000 7fd06f2d0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd06806b060 0x7fd0680c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.003+0000 7fd06f2d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06806b440 0x7fd06815a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.004+0000 7fd06f2d0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680c6de0 con 0x7fd0680c8310 2023-10-16T20:10:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.004+0000 7fd06f2d0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0680c5110 con 0x7fd06806b060 2023-10-16T20:10:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.004+0000 7fd06f2d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd068065f50 con 0x7fd06806b440 2023-10-16T20:10:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.005+0000 7fd06d86d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd0680c8310 0x7fd068150a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:53546/0 (socket says 172.21.15.57:53546) 2023-10-16T20:10:27.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.005+0000 7fd06d86d640 1 -- 172.21.15.57:0/3024269920 learned_addr learned my addr 172.21.15.57:0/3024269920 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:27.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.006+0000 7fd06c86b640 1 --2- 172.21.15.57:0/3024269920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06806b440 0x7fd06815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:27.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.013+0000 7fd05ffff640 1 -- 172.21.15.57:0/3024269920 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414201640 0 0) 0x7fd060001490 con 0x7fd0680c8310 2023-10-16T20:10:27.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.013+0000 7fd05ffff640 1 -- 172.21.15.57:0/3024269920 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd054003520 con 0x7fd0680c8310 2023-10-16T20:10:27.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.013+0000 7fd06c86b640 1 -- 172.21.15.57:0/3024269920 >> v2:172.21.15.57:3300/0 conn(0x7fd06806b060 msgr2=0x7fd0680c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:27.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.013+0000 7fd06c86b640 1 --2- 172.21.15.57:0/3024269920 >> v2:172.21.15.57:3300/0 conn(0x7fd06806b060 0x7fd0680c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.013+0000 7fd06c86b640 1 -- 172.21.15.57:0/3024269920 >> v1:172.21.15.110:6789/0 conn(0x7fd0680c8310 legacy=0x7fd068150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.013+0000 7fd06c86b640 1 -- 172.21.15.57:0/3024269920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680c74e0 con 0x7fd06806b440 2023-10-16T20:10:27.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.019+0000 7fd06c86b640 1 --2- 172.21.15.57:0/3024269920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06806b440 0x7fd06815a350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0580097a0 tx=0x7fd05802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc3e87cae9d039f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:27.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.028+0000 7fd05ffff640 1 -- 172.21.15.57:0/3024269920 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05802d040 con 0x7fd06806b440 2023-10-16T20:10:27.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.028+0000 7fd05ffff640 1 -- 172.21.15.57:0/3024269920 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058031810 con 0x7fd06806b440 2023-10-16T20:10:27.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.028+0000 7fd05ffff640 1 -- 172.21.15.57:0/3024269920 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058031ba0 con 0x7fd06806b440 2023-10-16T20:10:27.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 -- 172.21.15.57:0/3024269920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06806b440 msgr2=0x7fd06815a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/3024269920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06806b440 0x7fd06815a350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0580097a0 tx=0x7fd05802b8b0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 -- 172.21.15.57:0/3024269920 shutdown_connections 2023-10-16T20:10:27.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/3024269920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06806b440 0x7fd06815a350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/3024269920 >> v2:172.21.15.57:3300/0 conn(0x7fd06806b060 0x7fd0680c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 -- 172.21.15.57:0/3024269920 >> 172.21.15.57:0/3024269920 conn(0x7fd0680c7780 msgr2=0x7fd0680c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:27.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 -- 172.21.15.57:0/3024269920 shutdown_connections 2023-10-16T20:10:27.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.029+0000 7fd06f2d0640 1 -- 172.21.15.57:0/3024269920 wait complete. 2023-10-16T20:10:27.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.031+0000 7fd06f2d0640 1 Processor -- start 2023-10-16T20:10:27.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.032+0000 7fd06f2d0640 1 -- start start 2023-10-16T20:10:27.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.033+0000 7fd06f2d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd06806b060 0x7fd0681f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.033+0000 7fd06f2d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 0x7fd06815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.033+0000 7fd06f2d0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0680c8310 0x7fd06815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.033+0000 7fd06f2d0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680c3cb0 con 0x7fd06806b060 2023-10-16T20:10:27.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.033+0000 7fd06f2d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0681ef7e0 con 0x7fd06806b440 2023-10-16T20:10:27.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.033+0000 7fd06f2d0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680c3f00 con 0x7fd0680c8310 2023-10-16T20:10:27.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.034+0000 7fd06c86b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 0x7fd06815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:27.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.035+0000 7fd06d86d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0680c8310 0x7fd06815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:27.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.035+0000 7fd06c86b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 0x7fd06815a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:44550/0 (socket says 172.21.15.57:44550) 2023-10-16T20:10:27.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.035+0000 7fd06c86b640 1 -- 172.21.15.57:0/2136077981 learned_addr learned my addr 172.21.15.57:0/2136077981 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:27.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.045+0000 7fd06c86b640 1 -- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0680c8310 msgr2=0x7fd06815ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.045+0000 7fd06c86b640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0680c8310 0x7fd06815ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.045+0000 7fd06c86b640 1 -- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd06806b060 msgr2=0x7fd0681f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.045+0000 7fd06c86b640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd06806b060 0x7fd0681f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.045+0000 7fd06c86b640 1 -- 172.21.15.57:0/2136077981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009400 con 0x7fd06806b440 2023-10-16T20:10:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.052+0000 7fd06c86b640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 0x7fd06815a8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0580098c0 tx=0x7fd0580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.064+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058006e10 con 0x7fd06806b440 2023-10-16T20:10:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.064+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05803ad60 con 0x7fd06806b440 2023-10-16T20:10:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.064+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058044630 con 0x7fd06806b440 2023-10-16T20:10:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.064+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0681f2320 con 0x7fd06806b440 2023-10-16T20:10:27.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.065+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd068158100 con 0x7fd06806b440 2023-10-16T20:10:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.067+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0681f2560 con 0x7fd06806b440 2023-10-16T20:10:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.387+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd058044790 con 0x7fd06806b440 2023-10-16T20:10:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.389+0000 7fd05dffb640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd04c06aef0 0x7fd04c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.389+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd0580abf50 con 0x7fd06806b440 2023-10-16T20:10:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.390+0000 7fd06d06c640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd04c06aef0 0x7fd04c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:27.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.391+0000 7fd06d06c640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd04c06aef0 0x7fd04c06d3b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd064009710 tx=0x7fd064006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:27.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.398+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0580771c0 con 0x7fd06806b440 2023-10-16T20:10:27.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.628+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd068158100 con 0x7fd06806b440 2023-10-16T20:10:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.643+0000 7fd05dffb640 1 -- 172.21.15.57:0/2136077981 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd068158100 con 0x7fd06806b440 2023-10-16T20:10:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-10-16T20:10:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd04c06aef0 msgr2=0x7fd04c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd04c06aef0 0x7fd04c06d3b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd064009710 tx=0x7fd064006c90 comp rx=0 tx=0).stop 2023-10-16T20:10:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 msgr2=0x7fd06815a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 0x7fd06815a8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0580098c0 tx=0x7fd0580046c0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 shutdown_connections 2023-10-16T20:10:27.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd04c06aef0 0x7fd04c06d3b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0680c8310 0x7fd06815ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06806b440 0x7fd06815a8d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 --2- 172.21.15.57:0/2136077981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd06806b060 0x7fd0681f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.645+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 >> 172.21.15.57:0/2136077981 conn(0x7fd0680c7780 msgr2=0x7fd068155250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:27.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.646+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 shutdown_connections 2023-10-16T20:10:27.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.646+0000 7fd06f2d0640 1 -- 172.21.15.57:0/2136077981 wait complete. 2023-10-16T20:10:27.667 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-16T20:10:27.667 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:10:27.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:10:27.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.978+0000 7f82d5c21640 1 Processor -- start 2023-10-16T20:10:27.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.978+0000 7f82d5c21640 1 -- start start 2023-10-16T20:10:27.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.980+0000 7f82d5c21640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f82d006ff60 0x7f82d00c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.980+0000 7f82d5c21640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d0156a00 0x7f82d015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.980+0000 7f82d5c21640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d006c4b0 con 0x7f82d00c8ce0 2023-10-16T20:10:27.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.980+0000 7f82d5c21640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d006c970 con 0x7f82d006ff60 2023-10-16T20:10:27.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.980+0000 7f82d5c21640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d006b690 con 0x7f82d0156a00 2023-10-16T20:10:27.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.982+0000 7f82c7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f82d00c8ce0 0x7f82d01562f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54110/0 (socket says 172.21.15.57:54110) 2023-10-16T20:10:27.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.982+0000 7f82c7fff640 1 -- 172.21.15.57:0/140139140 learned_addr learned my addr 172.21.15.57:0/140139140 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:27.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.986+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750338969 0 0) 0x7f82d006c4b0 con 0x7f82d00c8ce0 2023-10-16T20:10:27.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.986+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82bc003520 con 0x7f82d00c8ce0 2023-10-16T20:10:27.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286079321 0 0) 0x7f82bc003520 con 0x7f82d00c8ce0 2023-10-16T20:10:27.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d0156a00 msgr2=0x7f82d015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:27.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d0156a00 0x7f82d015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 >> v2:172.21.15.110:3300/0 conn(0x7f82d006ff60 msgr2=0x7f82d00c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:27.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 --2- 172.21.15.57:0/140139140 >> v2:172.21.15.110:3300/0 conn(0x7f82d006ff60 0x7f82d00c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:27.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d006b8a0 con 0x7f82d00c8ce0 2023-10-16T20:10:27.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f82b8001670 con 0x7f82d00c8ce0 2023-10-16T20:10:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.992+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 >> v1:172.21.15.57:6789/0 conn(0x7f82d00c8ce0 legacy=0x7f82d01562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.993+0000 7f82ceffd640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d0156a00 0x7f82bc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.993+0000 7f82ceffd640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0040d0 0x7f82bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.993+0000 7f82ceffd640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc004e20 0x7f82bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.993+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d006b690 con 0x7f82bc0040d0 2023-10-16T20:10:27.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.993+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0055b0 con 0x7f82bc004e20 2023-10-16T20:10:27.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.993+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc00bec0 con 0x7f82d0156a00 2023-10-16T20:10:27.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:27.996+0000 7f82c7fff640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0040d0 0x7f82bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.003+0000 7f82c7fff640 1 -- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d0156a00 msgr2=0x7f82bc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.003+0000 7f82c7fff640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d0156a00 0x7f82bc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.003+0000 7f82c7fff640 1 -- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc004e20 msgr2=0x7f82bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.003+0000 7f82c7fff640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc004e20 0x7f82bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.003+0000 7f82c7fff640 1 -- 172.21.15.57:0/140139140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc003520 con 0x7f82bc0040d0 2023-10-16T20:10:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.009+0000 7f82c7fff640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0040d0 0x7f82bc0047c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f82b800c110 tx=0x7f82bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad1a9692a4c6292 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.015+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8005ad0 con 0x7f82bc0040d0 2023-10-16T20:10:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.015+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8005c50 con 0x7f82bc0040d0 2023-10-16T20:10:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.015+0000 7f82ceffd640 1 -- 172.21.15.57:0/140139140 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b802c810 con 0x7f82bc0040d0 2023-10-16T20:10:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82d5c21640 1 -- 172.21.15.57:0/140139140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0040d0 msgr2=0x7f82bc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82d5c21640 1 --2- 172.21.15.57:0/140139140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0040d0 0x7f82bc0047c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f82b800c110 tx=0x7f82bc0057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82cffff640 1 -- 172.21.15.57:0/140139140 reap_dead start 2023-10-16T20:10:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82d5c21640 1 -- 172.21.15.57:0/140139140 shutdown_connections 2023-10-16T20:10:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82d5c21640 1 -- 172.21.15.57:0/140139140 >> 172.21.15.57:0/140139140 conn(0x7f82d006eb50 msgr2=0x7f82d006ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:28.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82d5c21640 1 -- 172.21.15.57:0/140139140 shutdown_connections 2023-10-16T20:10:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.016+0000 7f82d5c21640 1 -- 172.21.15.57:0/140139140 wait complete. 2023-10-16T20:10:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.019+0000 7f82d5c21640 1 Processor -- start 2023-10-16T20:10:28.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.020+0000 7f82d5c21640 1 -- start start 2023-10-16T20:10:28.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.021+0000 7f82d5c21640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc0040d0 0x7f82d00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:28.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.021+0000 7f82d5c21640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 0x7f82d0159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:28.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.021+0000 7f82d5c21640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d014c5e0 0x7f82d014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:28.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.021+0000 7f82d5c21640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00acfd0 con 0x7f82d0152780 2023-10-16T20:10:28.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.021+0000 7f82d5c21640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0154620 con 0x7f82bc0040d0 2023-10-16T20:10:28.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.021+0000 7f82d5c21640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d01548e0 con 0x7f82d014c5e0 2023-10-16T20:10:28.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.022+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 0x7f82d0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:28.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.022+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 0x7f82d0159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37778/0 (socket says 172.21.15.57:37778) 2023-10-16T20:10:28.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.022+0000 7f82c7fff640 1 -- 172.21.15.57:0/2174060697 learned_addr learned my addr 172.21.15.57:0/2174060697 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:28.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.022+0000 7f82cffff640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d014c5e0 0x7f82d014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:28.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.026+0000 7f82c7fff640 1 -- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d014c5e0 msgr2=0x7f82d014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:28.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.026+0000 7f82c7fff640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d014c5e0 0x7f82d014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.026+0000 7f82c7fff640 1 -- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc0040d0 msgr2=0x7f82d00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:28.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.026+0000 7f82c7fff640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc0040d0 0x7f82d00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.026+0000 7f82c7fff640 1 -- 172.21.15.57:0/2174060697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00ac980 con 0x7f82d0152780 2023-10-16T20:10:28.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.030+0000 7f82c7fff640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 0x7f82d0159730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f82b802c410 tx=0x7f82b8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:28.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.034+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b803c040 con 0x7f82d0152780 2023-10-16T20:10:28.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.035+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b802dcb0 con 0x7f82d0152780 2023-10-16T20:10:28.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.035+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80072b0 con 0x7f82d0152780 2023-10-16T20:10:28.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.035+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d00acc60 con 0x7f82d0152780 2023-10-16T20:10:28.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.035+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d014cfa0 con 0x7f82d0152780 2023-10-16T20:10:28.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.036+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d00ace20 con 0x7f82d0152780 2023-10-16T20:10:28.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.352+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82b8032070 con 0x7f82d0152780 2023-10-16T20:10:28.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.353+0000 7f82ccff9640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f82b006aec0 0x7f82b006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:28.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.354+0000 7f82cf7fe640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f82b006aec0 0x7f82b006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.355+0000 7f82cf7fe640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f82b006aec0 0x7f82b006d380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009770 tx=0x7f82c0006d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:28.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.390+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f82b802de20 con 0x7f82d0152780 2023-10-16T20:10:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.390+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82b8076830 con 0x7f82d0152780 2023-10-16T20:10:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.619+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82d006b400 con 0x7f82d0152780 2023-10-16T20:10:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.735+0000 7f82ccff9640 1 -- 172.21.15.57:0/2174060697 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f82b8079e50 con 0x7f82d0152780 2023-10-16T20:10:28.738 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:28.738 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:10:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.738+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f82b006aec0 msgr2=0x7f82b006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.738+0000 7f82d5c21640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f82b006aec0 0x7f82b006d380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009770 tx=0x7f82c0006d70 comp rx=0 tx=0).stop 2023-10-16T20:10:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.738+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 msgr2=0x7f82d0159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.738+0000 7f82d5c21640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 0x7f82d0159730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f82b802c410 tx=0x7f82b8001930 comp rx=0 tx=0).stop 2023-10-16T20:10:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.738+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 shutdown_connections 2023-10-16T20:10:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f82b006aec0 0x7f82b006d380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82d014c5e0 0x7f82d014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82d0152780 0x7f82d0159730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 --2- 172.21.15.57:0/2174060697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82bc0040d0 0x7f82d00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 >> 172.21.15.57:0/2174060697 conn(0x7f82d006eb50 msgr2=0x7f82d015c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 shutdown_connections 2023-10-16T20:10:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.739+0000 7f82d5c21640 1 -- 172.21.15.57:0/2174060697 wait complete. 2023-10-16T20:10:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:40:38.255594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:40:53.908842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:40:56.364727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T20:10:28.768 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:10:28.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.984+0000 7fc765010640 1 Processor -- start 2023-10-16T20:10:28.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.984+0000 7fc765010640 1 -- start start 2023-10-16T20:10:28.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.985+0000 7fc765010640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7600ae730 0x7fc76006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:28.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.985+0000 7fc765010640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc76006e900 0x7fc76006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:28.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.985+0000 7fc765010640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7600aeb10 con 0x7fc7600c8460 2023-10-16T20:10:28.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.985+0000 7fc765010640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76015cf60 con 0x7fc76006e900 2023-10-16T20:10:28.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.985+0000 7fc765010640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76006dd60 con 0x7fc7600ae730 2023-10-16T20:10:28.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.987+0000 7fc75ed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7600ae730 0x7fc76006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:28.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.988+0000 7fc75ed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7600ae730 0x7fc76006b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:44570/0 (socket says 172.21.15.57:44570) 2023-10-16T20:10:28.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.988+0000 7fc75ed9d640 1 -- 172.21.15.57:0/1764093602 learned_addr learned my addr 172.21.15.57:0/1764093602 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.994+0000 7fc75ed9d640 1 -- 172.21.15.57:0/1764093602 >> v2:172.21.15.57:3300/0 conn(0x7fc76006e900 msgr2=0x7fc76006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.994+0000 7fc75ed9d640 1 --2- 172.21.15.57:0/1764093602 >> v2:172.21.15.57:3300/0 conn(0x7fc76006e900 0x7fc76006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.994+0000 7fc75ed9d640 1 -- 172.21.15.57:0/1764093602 >> v1:172.21.15.57:6789/0 conn(0x7fc7600c8460 legacy=0x7fc76006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:28.994+0000 7fc75ed9d640 1 -- 172.21.15.57:0/1764093602 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76015d450 con 0x7fc7600ae730 2023-10-16T20:10:29.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.000+0000 7fc75ed9d640 1 --2- 172.21.15.57:0/1764093602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc76006b6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7600719b0 tx=0x7fc75002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f946834b267149 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.011+0000 7fc75dd9b640 1 -- 172.21.15.57:0/1764093602 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750004230 con 0x7fc7600ae730 2023-10-16T20:10:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.011+0000 7fc75dd9b640 1 -- 172.21.15.57:0/1764093602 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750004390 con 0x7fc7600ae730 2023-10-16T20:10:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.011+0000 7fc75dd9b640 1 -- 172.21.15.57:0/1764093602 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750003810 con 0x7fc7600ae730 2023-10-16T20:10:29.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 -- 172.21.15.57:0/1764093602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 msgr2=0x7fc76006b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 --2- 172.21.15.57:0/1764093602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc76006b6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7600719b0 tx=0x7fc75002b8f0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 -- 172.21.15.57:0/1764093602 shutdown_connections 2023-10-16T20:10:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 --2- 172.21.15.57:0/1764093602 >> v2:172.21.15.57:3300/0 conn(0x7fc76006e900 0x7fc76006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 --2- 172.21.15.57:0/1764093602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc76006b6f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 -- 172.21.15.57:0/1764093602 >> 172.21.15.57:0/1764093602 conn(0x7fc76006f940 msgr2=0x7fc76006fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 -- 172.21.15.57:0/1764093602 shutdown_connections 2023-10-16T20:10:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.012+0000 7fc765010640 1 -- 172.21.15.57:0/1764093602 wait complete. 2023-10-16T20:10:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.015+0000 7fc765010640 1 Processor -- start 2023-10-16T20:10:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.015+0000 7fc765010640 1 -- start start 2023-10-16T20:10:29.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.017+0000 7fc765010640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc76006e900 0x7fc7600cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:29.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.017+0000 7fc765010640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc7600c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:29.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.017+0000 7fc765010640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7600c8460 0x7fc7601f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.017+0000 7fc765010640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600cb2c0 con 0x7fc76006e900 2023-10-16T20:10:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.017+0000 7fc765010640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600c4300 con 0x7fc7600ae730 2023-10-16T20:10:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.017+0000 7fc765010640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600cb4b0 con 0x7fc7600c8460 2023-10-16T20:10:29.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.019+0000 7fc75f59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7600c8460 0x7fc7601f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:29.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.019+0000 7fc75e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc7600c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:29.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.020+0000 7fc75e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc7600c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:44576/0 (socket says 172.21.15.57:44576) 2023-10-16T20:10:29.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.020+0000 7fc75e59c640 1 -- 172.21.15.57:0/21895902 learned_addr learned my addr 172.21.15.57:0/21895902 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.029+0000 7fc75f59e640 1 -- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 msgr2=0x7fc7600c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.029+0000 7fc75f59e640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc7600c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.029+0000 7fc75f59e640 1 -- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc76006e900 msgr2=0x7fc7600cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.029+0000 7fc75f59e640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc76006e900 0x7fc7600cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.029+0000 7fc75f59e640 1 -- 172.21.15.57:0/21895902 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750009460 con 0x7fc7600c8460 2023-10-16T20:10:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.041+0000 7fc75f59e640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7600c8460 0x7fc7601f1760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc75800be20 tx=0x7fc75800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:29.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.153+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800ce70 con 0x7fc7600c8460 2023-10-16T20:10:29.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.154+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758014440 con 0x7fc7600c8460 2023-10-16T20:10:29.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.154+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758014810 con 0x7fc7600c8460 2023-10-16T20:10:29.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.154+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7601f2370 con 0x7fc7600c8460 2023-10-16T20:10:29.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.154+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7600c3f90 con 0x7fc7600c8460 2023-10-16T20:10:29.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.156+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7600c4150 con 0x7fc7600c8460 2023-10-16T20:10:29.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.216+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc75801d3b0 con 0x7fc7600c8460 2023-10-16T20:10:29.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.218+0000 7fc7477fe640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc74c06aec0 0x7fc74c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:29.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.219+0000 7fc75ed9d640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc74c06aec0 0x7fc74c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:29.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.220+0000 7fc75ed9d640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc74c06aec0 0x7fc74c06d380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc750035000 tx=0x7fc750030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:29.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.229+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc7580589f0 con 0x7fc7600c8460 2023-10-16T20:10:29.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.587+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc758054d30 con 0x7fc7600c8460 2023-10-16T20:10:29.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.805+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc76004e1d0 con 0x7fc7600c8460 2023-10-16T20:10:29.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.815+0000 7fc7477fe640 1 -- 172.21.15.57:0/21895902 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc758019070 con 0x7fc7600c8460 2023-10-16T20:10:29.817 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-16T20:10:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.817+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc74c06aec0 msgr2=0x7fc74c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.817+0000 7fc765010640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc74c06aec0 0x7fc74c06d380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc750035000 tx=0x7fc750030000 comp rx=0 tx=0).stop 2023-10-16T20:10:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.817+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7600c8460 msgr2=0x7fc7601f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.817+0000 7fc765010640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7600c8460 0x7fc7601f1760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc75800be20 tx=0x7fc75800bf10 comp rx=0 tx=0).stop 2023-10-16T20:10:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 shutdown_connections 2023-10-16T20:10:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc74c06aec0 0x7fc74c06d380 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7600c8460 0x7fc7601f1760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7600ae730 0x7fc7600c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 --2- 172.21.15.57:0/21895902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc76006e900 0x7fc7600cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 >> 172.21.15.57:0/21895902 conn(0x7fc76006f940 msgr2=0x7fc7600ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 shutdown_connections 2023-10-16T20:10:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:29.818+0000 7fc765010640 1 -- 172.21.15.57:0/21895902 wait complete. 2023-10-16T20:10:29.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:10:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.055+0000 7f0213fd7640 1 Processor -- start 2023-10-16T20:10:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.056+0000 7f0213fd7640 1 -- start start 2023-10-16T20:10:30.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.057+0000 7f0213fd7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f020c150da0 0x7f020c157750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.057+0000 7f0213fd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c06e150 0x7f020c0c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.057+0000 7f0213fd7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c06d460 con 0x7f020c0c3ff0 2023-10-16T20:10:30.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.057+0000 7f0213fd7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c06d690 con 0x7f020c150da0 2023-10-16T20:10:30.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.057+0000 7f0213fd7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0c4e40 con 0x7f020c06e150 2023-10-16T20:10:30.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.058+0000 7f0212574640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f020c0c3ff0 0x7f020c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54126/0 (socket says 172.21.15.57:54126) 2023-10-16T20:10:30.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.058+0000 7f0212574640 1 -- 172.21.15.57:0/2867992619 learned_addr learned my addr 172.21.15.57:0/2867992619 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:30.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.059+0000 7f0211d73640 1 --2- 172.21.15.57:0/2867992619 >> v2:172.21.15.110:3300/0 conn(0x7f020c150da0 0x7f020c157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.059+0000 7f0211572640 1 --2- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c06e150 0x7f020c0c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.062+0000 7f0210d71640 1 -- 172.21.15.57:0/2867992619 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538998315 0 0) 0x7f020c06d460 con 0x7f020c0c3ff0 2023-10-16T20:10:30.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.062+0000 7f0210d71640 1 -- 172.21.15.57:0/2867992619 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc003520 con 0x7f020c0c3ff0 2023-10-16T20:10:30.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.066+0000 7f0211d73640 1 -- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c06e150 msgr2=0x7f020c0c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:30.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.066+0000 7f0211d73640 1 --2- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c06e150 0x7f020c0c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.066+0000 7f0210d71640 1 -- 172.21.15.57:0/2867992619 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2191371704 0 0) 0x7f01fc003520 con 0x7f020c0c3ff0 2023-10-16T20:10:30.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.066+0000 7f0211d73640 1 -- 172.21.15.57:0/2867992619 >> v1:172.21.15.57:6789/0 conn(0x7f020c0c3ff0 legacy=0x7f020c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.066+0000 7f0211d73640 1 -- 172.21.15.57:0/2867992619 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0c5490 con 0x7f020c150da0 2023-10-16T20:10:30.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.072+0000 7f0211d73640 1 --2- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c150da0 0x7f020c157750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0200009d90 tx=0x7f020002bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=750767529e04d5a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:30.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.084+0000 7f0210d71640 1 -- 172.21.15.57:0/2867992619 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204001670 con 0x7f020c150da0 2023-10-16T20:10:30.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.084+0000 7f0210d71640 1 -- 172.21.15.57:0/2867992619 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020002c8a0 con 0x7f020c150da0 2023-10-16T20:10:30.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.084+0000 7f0210d71640 1 -- 172.21.15.57:0/2867992619 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020002cc30 con 0x7f020c150da0 2023-10-16T20:10:30.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 -- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c150da0 msgr2=0x7f020c157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c150da0 0x7f020c157750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0200009d90 tx=0x7f020002bd70 comp rx=0 tx=0).stop 2023-10-16T20:10:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 -- 172.21.15.57:0/2867992619 shutdown_connections 2023-10-16T20:10:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c06e150 0x7f020c0c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2867992619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c150da0 0x7f020c157750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 -- 172.21.15.57:0/2867992619 >> 172.21.15.57:0/2867992619 conn(0x7f020c0c6ea0 msgr2=0x7f020c0c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 -- 172.21.15.57:0/2867992619 shutdown_connections 2023-10-16T20:10:30.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.085+0000 7f0213fd7640 1 -- 172.21.15.57:0/2867992619 wait complete. 2023-10-16T20:10:30.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.088+0000 7f0213fd7640 1 Processor -- start 2023-10-16T20:10:30.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.088+0000 7f0213fd7640 1 -- start start 2023-10-16T20:10:30.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.090+0000 7f0213fd7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 0x7f020c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.090+0000 7f0213fd7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c0c3ff0 0x7f020c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.090+0000 7f0213fd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c150da0 0x7f020c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.090+0000 7f0213fd7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1516b0 con 0x7f020c06e150 2023-10-16T20:10:30.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.090+0000 7f0213fd7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c157460 con 0x7f020c0c3ff0 2023-10-16T20:10:30.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.090+0000 7f0213fd7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c157740 con 0x7f020c150da0 2023-10-16T20:10:30.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.091+0000 7f0211d73640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 0x7f020c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.091+0000 7f0211d73640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 0x7f020c1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37796/0 (socket says 172.21.15.57:37796) 2023-10-16T20:10:30.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.091+0000 7f0211d73640 1 -- 172.21.15.57:0/2907687854 learned_addr learned my addr 172.21.15.57:0/2907687854 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:30.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.092+0000 7f0212574640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c150da0 0x7f020c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.092+0000 7f0211572640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c0c3ff0 0x7f020c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.095+0000 7f0211d73640 1 -- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c150da0 msgr2=0x7f020c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.095+0000 7f0211d73640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c150da0 0x7f020c152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.095+0000 7f0211d73640 1 -- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c0c3ff0 msgr2=0x7f020c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.095+0000 7f0211d73640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c0c3ff0 0x7f020c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.095+0000 7f0211d73640 1 -- 172.21.15.57:0/2907687854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009a70 con 0x7f020c06e150 2023-10-16T20:10:30.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.098+0000 7f0211d73640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 0x7f020c1598c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0200009d90 tx=0x7f0200004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:30.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.103+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200035de0 con 0x7f020c06e150 2023-10-16T20:10:30.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.103+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020002ce90 con 0x7f020c06e150 2023-10-16T20:10:30.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.103+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020003e630 con 0x7f020c06e150 2023-10-16T20:10:30.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.103+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c151950 con 0x7f020c06e150 2023-10-16T20:10:30.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.104+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c157a20 con 0x7f020c06e150 2023-10-16T20:10:30.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.105+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c06dc10 con 0x7f020c06e150 2023-10-16T20:10:30.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.126+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f020003b050 con 0x7f020c06e150 2023-10-16T20:10:30.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.127+0000 7f020a7fc640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01f006aef0 0x7f01f006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.128+0000 7f0211572640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01f006aef0 0x7f01f006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.129+0000 7f0211572640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01f006aef0 0x7f01f006d3b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f020c1f67e0 tx=0x7f01f8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:30.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.129+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f020007ad70 con 0x7f020c06e150 2023-10-16T20:10:30.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.424+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02000770b0 con 0x7f020c06e150 2023-10-16T20:10:30.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.642+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f020c04e160 con 0x7f020c06e150 2023-10-16T20:10:30.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.657+0000 7f020a7fc640 1 -- 172.21.15.57:0/2907687854 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f020004e020 con 0x7f020c06e150 2023-10-16T20:10:30.659 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-16T20:10:30.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01f006aef0 msgr2=0x7f01f006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01f006aef0 0x7f01f006d3b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f020c1f67e0 tx=0x7f01f8009190 comp rx=0 tx=0).stop 2023-10-16T20:10:30.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 msgr2=0x7f020c1598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 0x7f020c1598c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0200009d90 tx=0x7f0200004a40 comp rx=0 tx=0).stop 2023-10-16T20:10:30.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 shutdown_connections 2023-10-16T20:10:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01f006aef0 0x7f01f006d3b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f020c150da0 0x7f020c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f020c0c3ff0 0x7f020c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 --2- 172.21.15.57:0/2907687854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c06e150 0x7f020c1598c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 >> 172.21.15.57:0/2907687854 conn(0x7f020c0c6ea0 msgr2=0x7f020c158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:30.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 shutdown_connections 2023-10-16T20:10:30.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.660+0000 7f0213fd7640 1 -- 172.21.15.57:0/2907687854 wait complete. 2023-10-16T20:10:30.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:10:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.894+0000 7f0790e4f640 1 Processor -- start 2023-10-16T20:10:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.894+0000 7f0790e4f640 1 -- start start 2023-10-16T20:10:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.896+0000 7f0790e4f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f078c153210 0x7f078c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.896+0000 7f0790e4f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.896+0000 7f0790e4f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c1535f0 con 0x7f078c0c9710 2023-10-16T20:10:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.896+0000 7f0790e4f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c0c4420 con 0x7f078c153210 2023-10-16T20:10:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.896+0000 7f0790e4f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c159680 con 0x7f078c0ce800 2023-10-16T20:10:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.897+0000 7f078a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f078c153210 0x7f078c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.897+0000 7f078a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f078c153210 0x7f078c158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37804/0 (socket says 172.21.15.57:37804) 2023-10-16T20:10:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.897+0000 7f078a59c640 1 -- 172.21.15.57:0/2151284076 learned_addr learned my addr 172.21.15.57:0/2151284076 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.898+0000 7f078ad9d640 1 --2- 172.21.15.57:0/2151284076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.900+0000 7f078a59c640 1 -- 172.21.15.57:0/2151284076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 msgr2=0x7f078c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.900+0000 7f078a59c640 1 --2- 172.21.15.57:0/2151284076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.900+0000 7f078a59c640 1 -- 172.21.15.57:0/2151284076 >> v1:172.21.15.57:6789/0 conn(0x7f078c0c9710 legacy=0x7f078c0c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.900+0000 7f078a59c640 1 -- 172.21.15.57:0/2151284076 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c159960 con 0x7f078c153210 2023-10-16T20:10:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.903+0000 7f078a59c640 1 --2- 172.21.15.57:0/2151284076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c158e60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f077c009870 tx=0x7f077c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62f2f5baee23a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:30.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.946+0000 7f078959a640 1 -- 172.21.15.57:0/2151284076 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c031640 con 0x7f078c153210 2023-10-16T20:10:30.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.946+0000 7f078959a640 1 -- 172.21.15.57:0/2151284076 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c0317a0 con 0x7f078c153210 2023-10-16T20:10:30.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.946+0000 7f078959a640 1 -- 172.21.15.57:0/2151284076 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c031b30 con 0x7f078c153210 2023-10-16T20:10:30.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 -- 172.21.15.57:0/2151284076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 msgr2=0x7f078c158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 --2- 172.21.15.57:0/2151284076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c158e60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f077c009870 tx=0x7f077c02b8f0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 -- 172.21.15.57:0/2151284076 shutdown_connections 2023-10-16T20:10:30.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 --2- 172.21.15.57:0/2151284076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 --2- 172.21.15.57:0/2151284076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c158e60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 -- 172.21.15.57:0/2151284076 >> 172.21.15.57:0/2151284076 conn(0x7f078c06ac80 msgr2=0x7f078c06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:30.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 -- 172.21.15.57:0/2151284076 shutdown_connections 2023-10-16T20:10:30.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.948+0000 7f0790e4f640 1 -- 172.21.15.57:0/2151284076 wait complete. 2023-10-16T20:10:30.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.954+0000 7f0790e4f640 1 Processor -- start 2023-10-16T20:10:30.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.954+0000 7f0790e4f640 1 -- start start 2023-10-16T20:10:30.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.956+0000 7f0790e4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c0c9710 0x7f078c1ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.956+0000 7f0790e4f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.956+0000 7f0790e4f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:30.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.956+0000 7f0790e4f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c15a960 con 0x7f078c153210 2023-10-16T20:10:30.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.956+0000 7f0790e4f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1eeef0 con 0x7f078c0c9710 2023-10-16T20:10:30.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.956+0000 7f0790e4f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0c8990 con 0x7f078c0ce800 2023-10-16T20:10:30.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.958+0000 7f0789d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.959+0000 7f0789d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:52870/0 (socket says 172.21.15.57:52870) 2023-10-16T20:10:30.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.959+0000 7f0789d9b640 1 -- 172.21.15.57:0/192816324 learned_addr learned my addr 172.21.15.57:0/192816324 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:30.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.960+0000 7f078ad9d640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.961+0000 7f078a59c640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c0c9710 0x7f078c1ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:30.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.966+0000 7f078ad9d640 1 -- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 msgr2=0x7f078c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.966+0000 7f078ad9d640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.966+0000 7f078ad9d640 1 -- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c0c9710 msgr2=0x7f078c1ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:30.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.966+0000 7f078ad9d640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c0c9710 0x7f078c1ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:30.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.966+0000 7f078ad9d640 1 -- 172.21.15.57:0/192816324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0094d0 con 0x7f078c153210 2023-10-16T20:10:30.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.969+0000 7f078ad9d640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c155730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0784007dc0 tx=0x7f078400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:30.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.976+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784018070 con 0x7f078c153210 2023-10-16T20:10:30.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.976+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400edd0 con 0x7f078c153210 2023-10-16T20:10:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.976+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784003bb0 con 0x7f078c153210 2023-10-16T20:10:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.976+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c1f14d0 con 0x7f078c153210 2023-10-16T20:10:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.977+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c1f1a90 con 0x7f078c153210 2023-10-16T20:10:30.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:30.979+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c04e160 con 0x7f078c153210 2023-10-16T20:10:31.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.259+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0784003d10 con 0x7f078c153210 2023-10-16T20:10:31.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.260+0000 7f077affd640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f076c06aec0 0x7f076c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.261+0000 7f078a59c640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f076c06aec0 0x7f076c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:31.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.262+0000 7f078a59c640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f076c06aec0 0x7f076c06d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f077c036000 tx=0x7f077c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:31.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.296+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0784059080 con 0x7f078c153210 2023-10-16T20:10:31.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.297+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07840553c0 con 0x7f078c153210 2023-10-16T20:10:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.516+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f078c0ca250 con 0x7f078c153210 2023-10-16T20:10:31.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.649+0000 7f077affd640 1 -- 172.21.15.57:0/192816324 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f078405de60 con 0x7f078c153210 2023-10-16T20:10:31.652 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-16T20:10:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f076c06aec0 msgr2=0x7f076c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f076c06aec0 0x7f076c06d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f077c036000 tx=0x7f077c03c040 comp rx=0 tx=0).stop 2023-10-16T20:10:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 msgr2=0x7f078c155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c155730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0784007dc0 tx=0x7f078400e4b0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 shutdown_connections 2023-10-16T20:10:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f076c06aec0 0x7f076c06d380 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f078c153210 0x7f078c155730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0ce800 0x7f078c0c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 --2- 172.21.15.57:0/192816324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c0c9710 0x7f078c1ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 >> 172.21.15.57:0/192816324 conn(0x7f078c06ac80 msgr2=0x7f078c158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:31.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 shutdown_connections 2023-10-16T20:10:31.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.653+0000 7f0790e4f640 1 -- 172.21.15.57:0/192816324 wait complete. 2023-10-16T20:10:31.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:10:31.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.906+0000 7f78f3c0e640 1 Processor -- start 2023-10-16T20:10:31.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.906+0000 7f78f3c0e640 1 -- start start 2023-10-16T20:10:31.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.907+0000 7f78f3c0e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f78ec15d1c0 0x7f78ec159a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.907+0000 7f78f3c0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 0x7f78ec0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.907+0000 7f78f3c0e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec15cd30 con 0x7f78ec153110 2023-10-16T20:10:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.907+0000 7f78f3c0e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec0c6250 con 0x7f78ec15d1c0 2023-10-16T20:10:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.907+0000 7f78f3c0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c78f0 con 0x7f78ec0c52e0 2023-10-16T20:10:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.908+0000 7f78f19aa640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f78ec153110 0x7f78ec0bc190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54134/0 (socket says 172.21.15.57:54134) 2023-10-16T20:10:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.908+0000 7f78f19aa640 1 -- 172.21.15.57:0/1928259292 learned_addr learned my addr 172.21.15.57:0/1928259292 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.909+0000 7f78f21ab640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 0x7f78ec0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:31.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.911+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873627209 0 0) 0x7f78ec15cd30 con 0x7f78ec153110 2023-10-16T20:10:31.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.911+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d8003520 con 0x7f78ec153110 2023-10-16T20:10:31.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.915+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4024258510 0 0) 0x7f78d8003520 con 0x7f78ec153110 2023-10-16T20:10:31.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 msgr2=0x7f78ec0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:31.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 0x7f78ec0c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 >> v2:172.21.15.110:3300/0 conn(0x7f78ec15d1c0 msgr2=0x7f78ec159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 --2- 172.21.15.57:0/1928259292 >> v2:172.21.15.110:3300/0 conn(0x7f78ec15d1c0 0x7f78ec159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0c5c90 con 0x7f78ec153110 2023-10-16T20:10:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f78e8001670 con 0x7f78ec153110 2023-10-16T20:10:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 >> v1:172.21.15.57:6789/0 conn(0x7f78ec153110 legacy=0x7f78ec0bc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78d8003970 0x7f78d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 0x7f78d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78d8004d00 0x7f78d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c6250 con 0x7f78d8003970 2023-10-16T20:10:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c78f0 con 0x7f78d8004d00 2023-10-16T20:10:31.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.916+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d800bb70 con 0x7f78ec0c52e0 2023-10-16T20:10:31.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.919+0000 7f78f19aa640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78d8003970 0x7f78d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:31.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.923+0000 7f78f19aa640 1 -- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 msgr2=0x7f78d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:31.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.923+0000 7f78f19aa640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78ec0c52e0 0x7f78d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.923+0000 7f78f19aa640 1 -- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78d8004d00 msgr2=0x7f78d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:31.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.923+0000 7f78f19aa640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78d8004d00 0x7f78d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.923+0000 7f78f19aa640 1 -- 172.21.15.57:0/1928259292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8003520 con 0x7f78d8003970 2023-10-16T20:10:31.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.926+0000 7f78f19aa640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78d8003970 0x7f78d8003d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f78e800c160 tx=0x7f78d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cd767e47076378 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:31.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.934+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8005ad0 con 0x7f78d8003970 2023-10-16T20:10:31.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.934+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e8005c30 con 0x7f78d8003970 2023-10-16T20:10:31.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.934+0000 7f78f09a8640 1 -- 172.21.15.57:0/1928259292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e802c7e0 con 0x7f78d8003970 2023-10-16T20:10:31.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.935+0000 7f78f3c0e640 1 -- 172.21.15.57:0/1928259292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78d8003970 msgr2=0x7f78d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:31.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.935+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/1928259292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78d8003970 0x7f78d8003d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f78e800c160 tx=0x7f78d80057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.935+0000 7f78f21ab640 1 -- 172.21.15.57:0/1928259292 reap_dead start 2023-10-16T20:10:31.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.935+0000 7f78f3c0e640 1 -- 172.21.15.57:0/1928259292 shutdown_connections 2023-10-16T20:10:31.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.935+0000 7f78f3c0e640 1 -- 172.21.15.57:0/1928259292 >> 172.21.15.57:0/1928259292 conn(0x7f78ec06c430 msgr2=0x7f78ec069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:31.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.936+0000 7f78f3c0e640 1 -- 172.21.15.57:0/1928259292 shutdown_connections 2023-10-16T20:10:31.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.936+0000 7f78f3c0e640 1 -- 172.21.15.57:0/1928259292 wait complete. 2023-10-16T20:10:31.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.939+0000 7f78f3c0e640 1 Processor -- start 2023-10-16T20:10:31.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.939+0000 7f78f3c0e640 1 -- start start 2023-10-16T20:10:31.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.941+0000 7f78f3c0e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78d8003970 0x7f78ec1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.941+0000 7f78f3c0e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 0x7f78ec15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.941+0000 7f78f3c0e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78ec15c020 0x7f78ec1ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:31.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.941+0000 7f78f3c0e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1ef6c0 con 0x7f78ec159be0 2023-10-16T20:10:31.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.941+0000 7f78f3c0e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec15bbe0 con 0x7f78ec15c020 2023-10-16T20:10:31.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.941+0000 7f78f3c0e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec157560 con 0x7f78d8003970 2023-10-16T20:10:31.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.942+0000 7f78f11a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 0x7f78ec15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:31.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.943+0000 7f78f19aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78d8003970 0x7f78ec1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:31.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.943+0000 7f78f11a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 0x7f78ec15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37830/0 (socket says 172.21.15.57:37830) 2023-10-16T20:10:31.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.943+0000 7f78f11a9640 1 -- 172.21.15.57:0/206192822 learned_addr learned my addr 172.21.15.57:0/206192822 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:31.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.949+0000 7f78f11a9640 1 -- 172.21.15.57:0/206192822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78d8003970 msgr2=0x7f78ec1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:31.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.949+0000 7f78f11a9640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78d8003970 0x7f78ec1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.949+0000 7f78f11a9640 1 -- 172.21.15.57:0/206192822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78ec15c020 msgr2=0x7f78ec1ef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:31.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.949+0000 7f78f11a9640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78ec15c020 0x7f78ec1ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:31.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.949+0000 7f78f11a9640 1 -- 172.21.15.57:0/206192822 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec15b660 con 0x7f78ec159be0 2023-10-16T20:10:31.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.953+0000 7f78f11a9640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 0x7f78ec15a130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00b580 tx=0x7f78dc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.960+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc010610 con 0x7f78ec159be0 2023-10-16T20:10:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.960+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc010790 con 0x7f78ec159be0 2023-10-16T20:10:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.960+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec15b900 con 0x7f78ec159be0 2023-10-16T20:10:31.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.960+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc010b40 con 0x7f78ec159be0 2023-10-16T20:10:31.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.960+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec1571f0 con 0x7f78ec159be0 2023-10-16T20:10:31.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:31.961+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec1573b0 con 0x7f78ec159be0 2023-10-16T20:10:32.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.331+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78dc010ca0 con 0x7f78ec159be0 2023-10-16T20:10:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.333+0000 7f78e27fc640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78d006aef0 0x7f78d006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.334+0000 7f78f19aa640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78d006aef0 0x7f78d006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:32.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.336+0000 7f78f19aa640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78d006aef0 0x7f78d006d3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78e8034000 tx=0x7f78e8007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:32.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.367+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78dc0583d0 con 0x7f78ec159be0 2023-10-16T20:10:32.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.386+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78dc054710 con 0x7f78ec159be0 2023-10-16T20:10:32.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.628+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78ec0710b0 con 0x7f78ec159be0 2023-10-16T20:10:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.684+0000 7f78e27fc640 1 -- 172.21.15.57:0/206192822 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f78dc01e080 con 0x7f78ec159be0 2023-10-16T20:10:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-10-16T20:10:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.687+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78d006aef0 msgr2=0x7f78d006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.687+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78d006aef0 0x7f78d006d3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78e8034000 tx=0x7f78e8007000 comp rx=0 tx=0).stop 2023-10-16T20:10:32.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.687+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 msgr2=0x7f78ec15a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:32.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.687+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 0x7f78ec15a130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00b580 tx=0x7f78dc00ba40 comp rx=0 tx=0).stop 2023-10-16T20:10:32.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 shutdown_connections 2023-10-16T20:10:32.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f78d006aef0 0x7f78d006d3b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:32.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78ec15c020 0x7f78ec1ef180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78ec159be0 0x7f78ec15a130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 --2- 172.21.15.57:0/206192822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78d8003970 0x7f78ec1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 >> 172.21.15.57:0/206192822 conn(0x7f78ec06c430 msgr2=0x7f78ec0bc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:32.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 shutdown_connections 2023-10-16T20:10:32.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:32.688+0000 7f78f3c0e640 1 -- 172.21.15.57:0/206192822 wait complete. 2023-10-16T20:10:32.711 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2023-10-16T20:10:32.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:10:32.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-16T20:10:32.815 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:10:32.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[94693]: fuse finished with error 0 and tester_r 0 2023-10-16T20:10:33.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:==00:00:28:47.204 94693== 2023-10-16T20:10:33.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:==00:00:28:47.204 94693== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:10:34.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:10:38.917 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:10:38.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T20:10:38.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:10:38.919 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T20:10:38.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:10:38.995 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-16T20:10:39.050 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T20:10:39.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:10:39.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T20:10:39.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:10:39.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-10-16T20:10:39.274 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T20:10:39.285 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T20:10:39.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.482+0000 7fcbc8821640 1 Processor -- start 2023-10-16T20:10:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.482+0000 7fcbc8821640 1 -- start start 2023-10-16T20:10:39.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.484+0000 7fcbc8821640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbc40711f0 0x7fcbc40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:39.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.484+0000 7fcbc8821640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:39.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.484+0000 7fcbc8821640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc4150330 con 0x7fcbc414ff50 2023-10-16T20:10:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.484+0000 7fcbc8821640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc40c2b80 con 0x7fcbc40711f0 2023-10-16T20:10:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.484+0000 7fcbc8821640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c66d0 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.486+0000 7fcbc2d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.486+0000 7fcbbbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbc40711f0 0x7fcbc40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.487+0000 7fcbc2d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc4155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:47810/0 (socket says 172.21.15.57:47810) 2023-10-16T20:10:39.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.487+0000 7fcbc2d9d640 1 -- 172.21.15.57:0/2106392424 learned_addr learned my addr 172.21.15.57:0/2106392424 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:39.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.493+0000 7fcbbbfff640 1 -- 172.21.15.57:0/2106392424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 msgr2=0x7fcbc4155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:39.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.493+0000 7fcbbbfff640 1 --2- 172.21.15.57:0/2106392424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc4155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:39.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.493+0000 7fcbbbfff640 1 -- 172.21.15.57:0/2106392424 >> v1:172.21.15.57:6789/0 conn(0x7fcbc414ff50 legacy=0x7fcbc4071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:39.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.493+0000 7fcbbbfff640 1 -- 172.21.15.57:0/2106392424 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc415a110 con 0x7fcbc40711f0 2023-10-16T20:10:39.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.499+0000 7fcbbbfff640 1 --2- 172.21.15.57:0/2106392424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc40c1880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097a0 tx=0x7fcbac02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5e6323ac06e0c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.511+0000 7fcbc1d9b640 1 -- 172.21.15.57:0/2106392424 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac030800 con 0x7fcbc40711f0 2023-10-16T20:10:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.511+0000 7fcbc1d9b640 1 -- 172.21.15.57:0/2106392424 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac030960 con 0x7fcbc40711f0 2023-10-16T20:10:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.511+0000 7fcbc1d9b640 1 -- 172.21.15.57:0/2106392424 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac030cf0 con 0x7fcbc40711f0 2023-10-16T20:10:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 -- 172.21.15.57:0/2106392424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 msgr2=0x7fcbc40c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 --2- 172.21.15.57:0/2106392424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc40c1880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097a0 tx=0x7fcbac02b940 comp rx=0 tx=0).stop 2023-10-16T20:10:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 -- 172.21.15.57:0/2106392424 shutdown_connections 2023-10-16T20:10:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 --2- 172.21.15.57:0/2106392424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc4155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 --2- 172.21.15.57:0/2106392424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc40c1880 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 -- 172.21.15.57:0/2106392424 >> 172.21.15.57:0/2106392424 conn(0x7fcbc406c430 msgr2=0x7fcbc4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 -- 172.21.15.57:0/2106392424 shutdown_connections 2023-10-16T20:10:39.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.512+0000 7fcbc8821640 1 -- 172.21.15.57:0/2106392424 wait complete. 2023-10-16T20:10:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.517+0000 7fcbc8821640 1 Processor -- start 2023-10-16T20:10:39.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.517+0000 7fcbc8821640 1 -- start start 2023-10-16T20:10:39.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.519+0000 7fcbc8821640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:39.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.519+0000 7fcbc8821640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:39.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.519+0000 7fcbc8821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbc414ff50 0x7fcbc41410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:39.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.519+0000 7fcbc8821640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc414f170 con 0x7fcbc40711f0 2023-10-16T20:10:39.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.519+0000 7fcbc8821640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41ed510 con 0x7fcbc414ff50 2023-10-16T20:10:39.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.519+0000 7fcbc8821640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41ee290 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.521+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:39.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.521+0000 7fcbc2d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbc414ff50 0x7fcbc41410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:39.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.521+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc414e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:47812/0 (socket says 172.21.15.57:47812) 2023-10-16T20:10:39.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.521+0000 7fcbbbfff640 1 -- 172.21.15.57:0/1491398193 learned_addr learned my addr 172.21.15.57:0/1491398193 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:39.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.527+0000 7fcbc259c640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.531+0000 7fcbbbfff640 1 -- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbc414ff50 msgr2=0x7fcbc41410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.531+0000 7fcbbbfff640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbc414ff50 0x7fcbc41410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.531+0000 7fcbbbfff640 1 -- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 msgr2=0x7fcbc414c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.531+0000 7fcbbbfff640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc414c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.532+0000 7fcbbbfff640 1 -- 172.21.15.57:0/1491398193 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009400 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.545+0000 7fcbbbfff640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc414e7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcbac02bf50 tx=0x7fcbac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.661+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac03e070 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.661+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac039a10 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.661+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac039da0 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.661+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc414ee90 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.661+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc41eda90 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.663+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4153640 con 0x7fcbc40c1dc0 2023-10-16T20:10:39.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.996+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbac055430 con 0x7fcbc40c1dc0 2023-10-16T20:10:40.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.998+0000 7fcbbaffd640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcba406ae70 0x7fcba406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:39.999+0000 7fcbc259c640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcba406ae70 0x7fcba406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:40.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.001+0000 7fcbc259c640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcba406ae70 0x7fcba406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4000f60 tx=0x7fcbb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:40.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.005+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcbac07b2b0 con 0x7fcbc40c1dc0 2023-10-16T20:10:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.034+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbac0775f0 con 0x7fcbc40c1dc0 2023-10-16T20:10:40.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.242+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbc41592b0 con 0x7fcba406ae70 2023-10-16T20:10:40.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.256+0000 7fcbbaffd640 1 -- 172.21.15.57:0/1491398193 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287765 (secure 0 0 0) 0x7fcbb40014a0 con 0x7fcba406ae70 2023-10-16T20:10:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:40.265 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:10:40.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcba406ae70 msgr2=0x7fcba406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:40.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcba406ae70 0x7fcba406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4000f60 tx=0x7fcbb4009040 comp rx=0 tx=0).stop 2023-10-16T20:10:40.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 msgr2=0x7fcbc414e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:40.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc414e7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcbac02bf50 tx=0x7fcbac0046c0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 shutdown_connections 2023-10-16T20:10:40.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fcba406ae70 0x7fcba406d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbc414ff50 0x7fcbc41410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbc40c1dc0 0x7fcbc414e7a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 --2- 172.21.15.57:0/1491398193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc40711f0 0x7fcbc414c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 >> 172.21.15.57:0/1491398193 conn(0x7fcbc406c430 msgr2=0x7fcbc406d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:40.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 shutdown_connections 2023-10-16T20:10:40.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.264+0000 7fcbc8821640 1 -- 172.21.15.57:0/1491398193 wait complete. 2023-10-16T20:10:40.293 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":923,"stamp":"2023-10-16T20:10:40.230354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12826,"ondisk_log_size":12826,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8915,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410265+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T20:10:33.410265+0000","last_peered":"2023-10-16T20:10:33.410265+0000","last_clean":"2023-10-16T20:10:33.410265+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:10:33.410265+0000","last_undegraded":"2023-10-16T20:10:33.410265+0000","last_fullsized":"2023-10-16T20:10:33.410265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.484463+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T20:10:33.484463+0000","last_peered":"2023-10-16T20:10:33.484463+0000","last_clean":"2023-10-16T20:10:33.484463+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:10:33.484463+0000","last_undegraded":"2023-10-16T20:10:33.484463+0000","last_fullsized":"2023-10-16T20:10:33.484463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580051+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T20:10:33.580051+0000","last_peered":"2023-10-16T20:10:33.580051+0000","last_clean":"2023-10-16T20:10:33.580051+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:33.580051+0000","last_undegraded":"2023-10-16T20:10:33.580051+0000","last_fullsized":"2023-10-16T20:10:33.580051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587881+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T20:10:33.587881+0000","last_peered":"2023-10-16T20:10:33.587881+0000","last_clean":"2023-10-16T20:10:33.587881+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:10:33.587881+0000","last_undegraded":"2023-10-16T20:10:33.587881+0000","last_fullsized":"2023-10-16T20:10:33.587881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.386106+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T20:10:33.386106+0000","last_peered":"2023-10-16T20:10:33.386106+0000","last_clean":"2023-10-16T20:10:33.386106+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:10:33.386106+0000","last_undegraded":"2023-10-16T20:10:33.386106+0000","last_fullsized":"2023-10-16T20:10:33.386106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.588335+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T20:10:33.588335+0000","last_peered":"2023-10-16T20:10:33.588335+0000","last_clean":"2023-10-16T20:10:33.588335+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:10:33.588335+0000","last_undegraded":"2023-10-16T20:10:33.588335+0000","last_fullsized":"2023-10-16T20:10:33.588335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.477708+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T20:10:33.477708+0000","last_peered":"2023-10-16T20:10:33.477708+0000","last_clean":"2023-10-16T20:10:33.477708+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:33.477708+0000","last_undegraded":"2023-10-16T20:10:33.477708+0000","last_fullsized":"2023-10-16T20:10:33.477708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504184+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T20:10:33.504184+0000","last_peered":"2023-10-16T20:10:33.504184+0000","last_clean":"2023-10-16T20:10:33.504184+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:10:33.504184+0000","last_undegraded":"2023-10-16T20:10:33.504184+0000","last_fullsized":"2023-10-16T20:10:33.504184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413486+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413486+0000","last_peered":"2023-10-16T20:10:33.413486+0000","last_clean":"2023-10-16T20:10:33.413486+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413486+0000","last_undegraded":"2023-10-16T20:10:33.413486+0000","last_fullsized":"2023-10-16T20:10:33.413486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:19:30.948426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.605626+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T20:10:33.605626+0000","last_peered":"2023-10-16T20:10:33.605626+0000","last_clean":"2023-10-16T20:10:33.605626+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:10:33.605626+0000","last_undegraded":"2023-10-16T20:10:33.605626+0000","last_fullsized":"2023-10-16T20:10:33.605626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.559967+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T20:10:33.559967+0000","last_peered":"2023-10-16T20:10:33.559967+0000","last_clean":"2023-10-16T20:10:33.559967+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:10:33.559967+0000","last_undegraded":"2023-10-16T20:10:33.559967+0000","last_fullsized":"2023-10-16T20:10:33.559967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.594073+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T20:10:33.594073+0000","last_peered":"2023-10-16T20:10:33.594073+0000","last_clean":"2023-10-16T20:10:33.594073+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:10:33.594073+0000","last_undegraded":"2023-10-16T20:10:33.594073+0000","last_fullsized":"2023-10-16T20:10:33.594073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504336+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T20:10:33.504336+0000","last_peered":"2023-10-16T20:10:33.504336+0000","last_clean":"2023-10-16T20:10:33.504336+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:10:33.504336+0000","last_undegraded":"2023-10-16T20:10:33.504336+0000","last_fullsized":"2023-10-16T20:10:33.504336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584390+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T20:10:33.584390+0000","last_peered":"2023-10-16T20:10:33.584390+0000","last_clean":"2023-10-16T20:10:33.584390+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:10:33.584390+0000","last_undegraded":"2023-10-16T20:10:33.584390+0000","last_fullsized":"2023-10-16T20:10:33.584390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.398973+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T20:10:33.398973+0000","last_peered":"2023-10-16T20:10:33.398973+0000","last_clean":"2023-10-16T20:10:33.398973+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:10:33.398973+0000","last_undegraded":"2023-10-16T20:10:33.398973+0000","last_fullsized":"2023-10-16T20:10:33.398973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586214+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T20:10:33.586214+0000","last_peered":"2023-10-16T20:10:33.586214+0000","last_clean":"2023-10-16T20:10:33.586214+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:10:33.586214+0000","last_undegraded":"2023-10-16T20:10:33.586214+0000","last_fullsized":"2023-10-16T20:10:33.586214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.570822+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T20:10:33.570822+0000","last_peered":"2023-10-16T20:10:33.570822+0000","last_clean":"2023-10-16T20:10:33.570822+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:10:33.570822+0000","last_undegraded":"2023-10-16T20:10:33.570822+0000","last_fullsized":"2023-10-16T20:10:33.570822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.627120+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T20:10:33.627120+0000","last_peered":"2023-10-16T20:10:33.627120+0000","last_clean":"2023-10-16T20:10:33.627120+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:33.627120+0000","last_undegraded":"2023-10-16T20:10:33.627120+0000","last_fullsized":"2023-10-16T20:10:33.627120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.416579+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T20:10:33.416579+0000","last_peered":"2023-10-16T20:10:33.416579+0000","last_clean":"2023-10-16T20:10:33.416579+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:10:33.416579+0000","last_undegraded":"2023-10-16T20:10:33.416579+0000","last_fullsized":"2023-10-16T20:10:33.416579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.589018+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T20:10:33.589018+0000","last_peered":"2023-10-16T20:10:33.589018+0000","last_clean":"2023-10-16T20:10:33.589018+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:10:33.589018+0000","last_undegraded":"2023-10-16T20:10:33.589018+0000","last_fullsized":"2023-10-16T20:10:33.589018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580533+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T20:10:33.580533+0000","last_peered":"2023-10-16T20:10:33.580533+0000","last_clean":"2023-10-16T20:10:33.580533+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:10:33.580533+0000","last_undegraded":"2023-10-16T20:10:33.580533+0000","last_fullsized":"2023-10-16T20:10:33.580533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587275+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T20:10:33.587275+0000","last_peered":"2023-10-16T20:10:33.587275+0000","last_clean":"2023-10-16T20:10:33.587275+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:10:33.587275+0000","last_undegraded":"2023-10-16T20:10:33.587275+0000","last_fullsized":"2023-10-16T20:10:33.587275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.421682+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T20:10:33.421682+0000","last_peered":"2023-10-16T20:10:33.421682+0000","last_clean":"2023-10-16T20:10:33.421682+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:33.421682+0000","last_undegraded":"2023-10-16T20:10:33.421682+0000","last_fullsized":"2023-10-16T20:10:33.421682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587450+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T20:10:33.587450+0000","last_peered":"2023-10-16T20:10:33.587450+0000","last_clean":"2023-10-16T20:10:33.587450+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:10:33.587450+0000","last_undegraded":"2023-10-16T20:10:33.587450+0000","last_fullsized":"2023-10-16T20:10:33.587450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.408954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T20:10:33.408954+0000","last_peered":"2023-10-16T20:10:33.408954+0000","last_clean":"2023-10-16T20:10:33.408954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:10:33.408954+0000","last_undegraded":"2023-10-16T20:10:33.408954+0000","last_fullsized":"2023-10-16T20:10:33.408954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590410+0000","last_change":"2023-10-16T19:41:25.495312+0000","last_active":"2023-10-16T20:10:33.590410+0000","last_peered":"2023-10-16T20:10:33.590410+0000","last_clean":"2023-10-16T20:10:33.590410+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:10:33.590410+0000","last_undegraded":"2023-10-16T20:10:33.590410+0000","last_fullsized":"2023-10-16T20:10:33.590410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.445781+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T20:10:33.445781+0000","last_peered":"2023-10-16T20:10:33.445781+0000","last_clean":"2023-10-16T20:10:33.445781+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:10:33.445781+0000","last_undegraded":"2023-10-16T20:10:33.445781+0000","last_fullsized":"2023-10-16T20:10:33.445781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451146+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T20:10:33.451146+0000","last_peered":"2023-10-16T20:10:33.451146+0000","last_clean":"2023-10-16T20:10:33.451146+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:10:33.451146+0000","last_undegraded":"2023-10-16T20:10:33.451146+0000","last_fullsized":"2023-10-16T20:10:33.451146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583441+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T20:10:33.583441+0000","last_peered":"2023-10-16T20:10:33.583441+0000","last_clean":"2023-10-16T20:10:33.583441+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:10:33.583441+0000","last_undegraded":"2023-10-16T20:10:33.583441+0000","last_fullsized":"2023-10-16T20:10:33.583441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.585861+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T20:10:33.585861+0000","last_peered":"2023-10-16T20:10:33.585861+0000","last_clean":"2023-10-16T20:10:33.585861+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:10:33.585861+0000","last_undegraded":"2023-10-16T20:10:33.585861+0000","last_fullsized":"2023-10-16T20:10:33.585861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.626070+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T20:10:33.626070+0000","last_peered":"2023-10-16T20:10:33.626070+0000","last_clean":"2023-10-16T20:10:33.626070+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:33.626070+0000","last_undegraded":"2023-10-16T20:10:33.626070+0000","last_fullsized":"2023-10-16T20:10:33.626070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590788+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T20:10:33.590788+0000","last_peered":"2023-10-16T20:10:33.590788+0000","last_clean":"2023-10-16T20:10:33.590788+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:10:33.590788+0000","last_undegraded":"2023-10-16T20:10:33.590788+0000","last_fullsized":"2023-10-16T20:10:33.590788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.595432+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T20:10:33.595432+0000","last_peered":"2023-10-16T20:10:33.595432+0000","last_clean":"2023-10-16T20:10:33.595432+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:10:33.595432+0000","last_undegraded":"2023-10-16T20:10:33.595432+0000","last_fullsized":"2023-10-16T20:10:33.595432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2224","reported_seq":2252,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.666044+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T20:10:33.666044+0000","last_peered":"2023-10-16T20:10:33.666044+0000","last_clean":"2023-10-16T20:10:33.666044+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:33.666044+0000","last_undegraded":"2023-10-16T20:10:33.666044+0000","last_fullsized":"2023-10-16T20:10:33.666044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584389+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T20:10:33.584389+0000","last_peered":"2023-10-16T20:10:33.584389+0000","last_clean":"2023-10-16T20:10:33.584389+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:10:33.584389+0000","last_undegraded":"2023-10-16T20:10:33.584389+0000","last_fullsized":"2023-10-16T20:10:33.584389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'121","reported_seq":258,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:30.057629+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T20:09:30.057629+0000","last_peered":"2023-10-16T20:09:30.057629+0000","last_clean":"2023-10-16T20:09:30.057629+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:09:30.057629+0000","last_undegraded":"2023-10-16T20:09:30.057629+0000","last_fullsized":"2023-10-16T20:09:30.057629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'203","reported_seq":426,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.633215+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T20:10:13.633215+0000","last_peered":"2023-10-16T20:10:13.633215+0000","last_clean":"2023-10-16T20:10:13.633215+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:13.633215+0000","last_undegraded":"2023-10-16T20:10:13.633215+0000","last_fullsized":"2023-10-16T20:10:13.633215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.502464+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T20:10:33.502464+0000","last_peered":"2023-10-16T20:10:33.502464+0000","last_clean":"2023-10-16T20:10:33.502464+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:10:33.502464+0000","last_undegraded":"2023-10-16T20:10:33.502464+0000","last_fullsized":"2023-10-16T20:10:33.502464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'7","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:56.062806+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T20:09:56.062806+0000","last_peered":"2023-10-16T20:09:56.062806+0000","last_clean":"2023-10-16T20:09:56.062806+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:09:56.062806+0000","last_undegraded":"2023-10-16T20:09:56.062806+0000","last_fullsized":"2023-10-16T20:09:56.062806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.447539+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T20:10:33.447539+0000","last_peered":"2023-10-16T20:10:33.447539+0000","last_clean":"2023-10-16T20:10:33.447539+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:10:33.447539+0000","last_undegraded":"2023-10-16T20:10:33.447539+0000","last_fullsized":"2023-10-16T20:10:33.447539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'169","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.942089+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T20:10:32.942089+0000","last_peered":"2023-10-16T20:10:32.942089+0000","last_clean":"2023-10-16T20:10:32.942089+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:10:32.942089+0000","last_undegraded":"2023-10-16T20:10:32.942089+0000","last_fullsized":"2023-10-16T20:10:32.942089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583115+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T20:10:33.583115+0000","last_peered":"2023-10-16T20:10:33.583115+0000","last_clean":"2023-10-16T20:10:33.583115+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:10:33.583115+0000","last_undegraded":"2023-10-16T20:10:33.583115+0000","last_fullsized":"2023-10-16T20:10:33.583115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'80","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:44.535041+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T20:09:44.535041+0000","last_peered":"2023-10-16T20:09:44.535041+0000","last_clean":"2023-10-16T20:09:44.535041+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:09:44.535041+0000","last_undegraded":"2023-10-16T20:09:44.535041+0000","last_fullsized":"2023-10-16T20:09:44.535041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581935+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T20:10:33.581935+0000","last_peered":"2023-10-16T20:10:33.581935+0000","last_clean":"2023-10-16T20:10:33.581935+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:10:33.581935+0000","last_undegraded":"2023-10-16T20:10:33.581935+0000","last_fullsized":"2023-10-16T20:10:33.581935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'84","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:24.530946+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T20:10:24.530946+0000","last_peered":"2023-10-16T20:10:24.530946+0000","last_clean":"2023-10-16T20:10:24.530946+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:24.530946+0000","last_undegraded":"2023-10-16T20:10:24.530946+0000","last_fullsized":"2023-10-16T20:10:24.530946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.342447+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T20:10:33.342447+0000","last_peered":"2023-10-16T20:10:33.342447+0000","last_clean":"2023-10-16T20:10:33.342447+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:10:33.342447+0000","last_undegraded":"2023-10-16T20:10:33.342447+0000","last_fullsized":"2023-10-16T20:10:33.342447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1226","reported_seq":1255,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.798808+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T20:10:11.798808+0000","last_peered":"2023-10-16T20:10:11.798808+0000","last_clean":"2023-10-16T20:10:11.798808+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:10:11.798808+0000","last_undegraded":"2023-10-16T20:10:11.798808+0000","last_fullsized":"2023-10-16T20:10:11.798808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451956+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T20:10:33.451956+0000","last_peered":"2023-10-16T20:10:33.451956+0000","last_clean":"2023-10-16T20:10:33.451956+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:10:33.451956+0000","last_undegraded":"2023-10-16T20:10:33.451956+0000","last_fullsized":"2023-10-16T20:10:33.451956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'116","reported_seq":247,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.012976+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T20:10:20.012976+0000","last_peered":"2023-10-16T20:10:20.012976+0000","last_clean":"2023-10-16T20:10:20.012976+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:20.012976+0000","last_undegraded":"2023-10-16T20:10:20.012976+0000","last_fullsized":"2023-10-16T20:10:20.012976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579846+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T20:10:33.579846+0000","last_peered":"2023-10-16T20:10:33.579846+0000","last_clean":"2023-10-16T20:10:33.579846+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:10:33.579846+0000","last_undegraded":"2023-10-16T20:10:33.579846+0000","last_fullsized":"2023-10-16T20:10:33.579846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'94","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.112139+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T20:10:20.112139+0000","last_peered":"2023-10-16T20:10:20.112139+0000","last_clean":"2023-10-16T20:10:20.112139+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:10:20.112139+0000","last_undegraded":"2023-10-16T20:10:20.112139+0000","last_fullsized":"2023-10-16T20:10:20.112139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.405427+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T20:10:33.405427+0000","last_peered":"2023-10-16T20:10:33.405427+0000","last_clean":"2023-10-16T20:10:33.405427+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:10:33.405427+0000","last_undegraded":"2023-10-16T20:10:33.405427+0000","last_fullsized":"2023-10-16T20:10:33.405427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'915","reported_seq":944,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.946659+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T20:10:32.946659+0000","last_peered":"2023-10-16T20:10:32.946659+0000","last_clean":"2023-10-16T20:10:32.946659+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:10:32.946659+0000","last_undegraded":"2023-10-16T20:10:32.946659+0000","last_fullsized":"2023-10-16T20:10:32.946659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.522059+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T20:10:33.522059+0000","last_peered":"2023-10-16T20:10:33.522059+0000","last_clean":"2023-10-16T20:10:33.522059+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:10:33.522059+0000","last_undegraded":"2023-10-16T20:10:33.522059+0000","last_fullsized":"2023-10-16T20:10:33.522059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'112","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:51.891715+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T20:09:51.891715+0000","last_peered":"2023-10-16T20:09:51.891715+0000","last_clean":"2023-10-16T20:09:51.891715+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:09:51.891715+0000","last_undegraded":"2023-10-16T20:09:51.891715+0000","last_fullsized":"2023-10-16T20:09:51.891715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.411939+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T20:10:33.411939+0000","last_peered":"2023-10-16T20:10:33.411939+0000","last_clean":"2023-10-16T20:10:33.411939+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:33.411939+0000","last_undegraded":"2023-10-16T20:10:33.411939+0000","last_fullsized":"2023-10-16T20:10:33.411939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'191","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:14.234893+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T20:10:14.234893+0000","last_peered":"2023-10-16T20:10:14.234893+0000","last_clean":"2023-10-16T20:10:14.234893+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:14.234893+0000","last_undegraded":"2023-10-16T20:10:14.234893+0000","last_fullsized":"2023-10-16T20:10:14.234893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.360807+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T20:10:33.360807+0000","last_peered":"2023-10-16T20:10:33.360807+0000","last_clean":"2023-10-16T20:10:33.360807+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:10:33.360807+0000","last_undegraded":"2023-10-16T20:10:33.360807+0000","last_fullsized":"2023-10-16T20:10:33.360807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'9","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.666624+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T20:10:13.666624+0000","last_peered":"2023-10-16T20:10:13.666624+0000","last_clean":"2023-10-16T20:10:13.666624+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:13.666624+0000","last_undegraded":"2023-10-16T20:10:13.666624+0000","last_fullsized":"2023-10-16T20:10:13.666624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410999+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T20:10:33.410999+0000","last_peered":"2023-10-16T20:10:33.410999+0000","last_clean":"2023-10-16T20:10:33.410999+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:10:33.410999+0000","last_undegraded":"2023-10-16T20:10:33.410999+0000","last_fullsized":"2023-10-16T20:10:33.410999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.267853+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T20:10:13.267853+0000","last_peered":"2023-10-16T20:10:13.267853+0000","last_clean":"2023-10-16T20:10:13.267853+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:10:13.267853+0000","last_undegraded":"2023-10-16T20:10:13.267853+0000","last_fullsized":"2023-10-16T20:10:13.267853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.624110+0000","last_change":"2023-10-16T19:41:25.728395+0000","last_active":"2023-10-16T20:10:33.624110+0000","last_peered":"2023-10-16T20:10:33.624110+0000","last_clean":"2023-10-16T20:10:33.624110+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:10:33.624110+0000","last_undegraded":"2023-10-16T20:10:33.624110+0000","last_fullsized":"2023-10-16T20:10:33.624110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:29.023300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'593","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.941718+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T20:10:32.941718+0000","last_peered":"2023-10-16T20:10:32.941718+0000","last_clean":"2023-10-16T20:10:32.941718+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:32.941718+0000","last_undegraded":"2023-10-16T20:10:32.941718+0000","last_fullsized":"2023-10-16T20:10:32.941718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.439287+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T20:10:33.439287+0000","last_peered":"2023-10-16T20:10:33.439287+0000","last_clean":"2023-10-16T20:10:33.439287+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:10:33.439287+0000","last_undegraded":"2023-10-16T20:10:33.439287+0000","last_fullsized":"2023-10-16T20:10:33.439287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:41.265191+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T20:06:41.265191+0000","last_peered":"2023-10-16T20:06:41.265191+0000","last_clean":"2023-10-16T20:06:41.265191+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:06:41.265191+0000","last_undegraded":"2023-10-16T20:06:41.265191+0000","last_fullsized":"2023-10-16T20:06:41.265191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:08:01.239242+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T20:08:01.239242+0000","last_peered":"2023-10-16T20:08:01.239242+0000","last_clean":"2023-10-16T20:08:01.239242+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:08:01.239242+0000","last_undegraded":"2023-10-16T20:08:01.239242+0000","last_fullsized":"2023-10-16T20:08:01.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.501193+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T20:10:33.501193+0000","last_peered":"2023-10-16T20:10:33.501193+0000","last_clean":"2023-10-16T20:10:33.501193+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:10:33.501193+0000","last_undegraded":"2023-10-16T20:10:33.501193+0000","last_fullsized":"2023-10-16T20:10:33.501193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'10","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.421795+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T20:10:13.421795+0000","last_peered":"2023-10-16T20:10:13.421795+0000","last_clean":"2023-10-16T20:10:13.421795+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:10:13.421795+0000","last_undegraded":"2023-10-16T20:10:13.421795+0000","last_fullsized":"2023-10-16T20:10:13.421795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579847+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T20:10:33.579847+0000","last_peered":"2023-10-16T20:10:33.579847+0000","last_clean":"2023-10-16T20:10:33.579847+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:10:33.579847+0000","last_undegraded":"2023-10-16T20:10:33.579847+0000","last_fullsized":"2023-10-16T20:10:33.579847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'180","reported_seq":299,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:29.575973+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T20:10:29.575973+0000","last_peered":"2023-10-16T20:10:29.575973+0000","last_clean":"2023-10-16T20:10:29.575973+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:29.575973+0000","last_undegraded":"2023-10-16T20:10:29.575973+0000","last_fullsized":"2023-10-16T20:10:29.575973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.375187+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T20:10:33.375187+0000","last_peered":"2023-10-16T20:10:33.375187+0000","last_clean":"2023-10-16T20:10:33.375187+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:10:33.375187+0000","last_undegraded":"2023-10-16T20:10:33.375187+0000","last_fullsized":"2023-10-16T20:10:33.375187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'439","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.949381+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T20:10:32.949381+0000","last_peered":"2023-10-16T20:10:32.949381+0000","last_clean":"2023-10-16T20:10:32.949381+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:10:32.949381+0000","last_undegraded":"2023-10-16T20:10:32.949381+0000","last_fullsized":"2023-10-16T20:10:32.949381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596484+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T20:10:33.596484+0000","last_peered":"2023-10-16T20:10:33.596484+0000","last_clean":"2023-10-16T20:10:33.596484+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:10:33.596484+0000","last_undegraded":"2023-10-16T20:10:33.596484+0000","last_fullsized":"2023-10-16T20:10:33.596484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.266788+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T20:10:08.266788+0000","last_peered":"2023-10-16T20:10:08.266788+0000","last_clean":"2023-10-16T20:10:08.266788+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:08.266788+0000","last_undegraded":"2023-10-16T20:10:08.266788+0000","last_fullsized":"2023-10-16T20:10:08.266788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586134+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T20:10:33.586134+0000","last_peered":"2023-10-16T20:10:33.586134+0000","last_clean":"2023-10-16T20:10:33.586134+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:10:33.586134+0000","last_undegraded":"2023-10-16T20:10:33.586134+0000","last_fullsized":"2023-10-16T20:10:33.586134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'72","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.061284+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T20:10:08.061284+0000","last_peered":"2023-10-16T20:10:08.061284+0000","last_clean":"2023-10-16T20:10:08.061284+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:10:08.061284+0000","last_undegraded":"2023-10-16T20:10:08.061284+0000","last_fullsized":"2023-10-16T20:10:08.061284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.384254+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T20:10:33.384254+0000","last_peered":"2023-10-16T20:10:33.384254+0000","last_clean":"2023-10-16T20:10:33.384254+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:10:33.384254+0000","last_undegraded":"2023-10-16T20:10:33.384254+0000","last_fullsized":"2023-10-16T20:10:33.384254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'179","reported_seq":209,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:26.801226+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T20:10:26.801226+0000","last_peered":"2023-10-16T20:10:26.801226+0000","last_clean":"2023-10-16T20:10:26.801226+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:26.801226+0000","last_undegraded":"2023-10-16T20:10:26.801226+0000","last_fullsized":"2023-10-16T20:10:26.801226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.622595+0000","last_change":"2023-10-16T19:41:25.493927+0000","last_active":"2023-10-16T20:10:33.622595+0000","last_peered":"2023-10-16T20:10:33.622595+0000","last_clean":"2023-10-16T20:10:33.622595+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:10:33.622595+0000","last_undegraded":"2023-10-16T20:10:33.622595+0000","last_fullsized":"2023-10-16T20:10:33.622595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.153861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'15","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.432292+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T20:10:13.432292+0000","last_peered":"2023-10-16T20:10:13.432292+0000","last_clean":"2023-10-16T20:10:13.432292+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:10:13.432292+0000","last_undegraded":"2023-10-16T20:10:13.432292+0000","last_fullsized":"2023-10-16T20:10:13.432292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":76,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580103+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T20:10:33.580103+0000","last_peered":"2023-10-16T20:10:33.580103+0000","last_clean":"2023-10-16T20:10:33.580103+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:10:33.580103+0000","last_undegraded":"2023-10-16T20:10:33.580103+0000","last_fullsized":"2023-10-16T20:10:33.580103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:03.895071+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T20:10:03.895071+0000","last_peered":"2023-10-16T20:10:03.895071+0000","last_clean":"2023-10-16T20:10:03.895071+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:10:03.895071+0000","last_undegraded":"2023-10-16T20:10:03.895071+0000","last_fullsized":"2023-10-16T20:10:03.895071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596571+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T20:10:33.596571+0000","last_peered":"2023-10-16T20:10:33.596571+0000","last_clean":"2023-10-16T20:10:33.596571+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:33.596571+0000","last_undegraded":"2023-10-16T20:10:33.596571+0000","last_fullsized":"2023-10-16T20:10:33.596571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'174","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.509000+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T20:10:13.509000+0000","last_peered":"2023-10-16T20:10:13.509000+0000","last_clean":"2023-10-16T20:10:13.509000+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:13.509000+0000","last_undegraded":"2023-10-16T20:10:13.509000+0000","last_fullsized":"2023-10-16T20:10:13.509000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.493529+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T20:10:33.493529+0000","last_peered":"2023-10-16T20:10:33.493529+0000","last_clean":"2023-10-16T20:10:33.493529+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:10:33.493529+0000","last_undegraded":"2023-10-16T20:10:33.493529+0000","last_fullsized":"2023-10-16T20:10:33.493529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'427","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:15.339991+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T20:10:15.339991+0000","last_peered":"2023-10-16T20:10:15.339991+0000","last_clean":"2023-10-16T20:10:15.339991+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:15.339991+0000","last_undegraded":"2023-10-16T20:10:15.339991+0000","last_fullsized":"2023-10-16T20:10:15.339991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504071+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T20:10:33.504071+0000","last_peered":"2023-10-16T20:10:33.504071+0000","last_clean":"2023-10-16T20:10:33.504071+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:10:33.504071+0000","last_undegraded":"2023-10-16T20:10:33.504071+0000","last_fullsized":"2023-10-16T20:10:33.504071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'12","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.310375+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T20:10:11.310375+0000","last_peered":"2023-10-16T20:10:11.310375+0000","last_clean":"2023-10-16T20:10:11.310375+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:10:11.310375+0000","last_undegraded":"2023-10-16T20:10:11.310375+0000","last_fullsized":"2023-10-16T20:10:11.310375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.606147+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T20:10:33.606147+0000","last_peered":"2023-10-16T20:10:33.606147+0000","last_clean":"2023-10-16T20:10:33.606147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:10:33.606147+0000","last_undegraded":"2023-10-16T20:10:33.606147+0000","last_fullsized":"2023-10-16T20:10:33.606147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590732+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T20:10:33.590732+0000","last_peered":"2023-10-16T20:10:33.590732+0000","last_clean":"2023-10-16T20:10:33.590732+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:10:33.590732+0000","last_undegraded":"2023-10-16T20:10:33.590732+0000","last_fullsized":"2023-10-16T20:10:33.590732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'10","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.665125+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T20:10:13.665125+0000","last_peered":"2023-10-16T20:10:13.665125+0000","last_clean":"2023-10-16T20:10:13.665125+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:10:13.665125+0000","last_undegraded":"2023-10-16T20:10:13.665125+0000","last_fullsized":"2023-10-16T20:10:13.665125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580795+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T20:10:33.580795+0000","last_peered":"2023-10-16T20:10:33.580795+0000","last_clean":"2023-10-16T20:10:33.580795+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:10:33.580795+0000","last_undegraded":"2023-10-16T20:10:33.580795+0000","last_fullsized":"2023-10-16T20:10:33.580795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'149","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.159611+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T20:10:06.159611+0000","last_peered":"2023-10-16T20:10:06.159611+0000","last_clean":"2023-10-16T20:10:06.159611+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:10:06.159611+0000","last_undegraded":"2023-10-16T20:10:06.159611+0000","last_fullsized":"2023-10-16T20:10:06.159611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.582049+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T20:10:33.582049+0000","last_peered":"2023-10-16T20:10:33.582049+0000","last_clean":"2023-10-16T20:10:33.582049+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:10:33.582049+0000","last_undegraded":"2023-10-16T20:10:33.582049+0000","last_fullsized":"2023-10-16T20:10:33.582049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:42.552748+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T20:09:42.552748+0000","last_peered":"2023-10-16T20:09:42.552748+0000","last_clean":"2023-10-16T20:09:42.552748+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:09:42.552748+0000","last_undegraded":"2023-10-16T20:09:42.552748+0000","last_fullsized":"2023-10-16T20:09:42.552748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.407183+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T20:10:33.407183+0000","last_peered":"2023-10-16T20:10:33.407183+0000","last_clean":"2023-10-16T20:10:33.407183+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:10:33.407183+0000","last_undegraded":"2023-10-16T20:10:33.407183+0000","last_fullsized":"2023-10-16T20:10:33.407183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'70","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.298762+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T20:10:06.298762+0000","last_peered":"2023-10-16T20:10:06.298762+0000","last_clean":"2023-10-16T20:10:06.298762+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:06.298762+0000","last_undegraded":"2023-10-16T20:10:06.298762+0000","last_fullsized":"2023-10-16T20:10:06.298762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":7912,"ondisk_log_size":7912,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509803,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2270000000000001,"15min":1.1899999999999999},"min":{"1min":0.755,"5min":0.71299999999999997,"15min":0.55300000000000005},"max":{"1min":1.738,"5min":2.0569999999999999,"15min":2.085},"last":1.55},{"interface":"front","average":{"1min":1.167,"5min":1.242,"15min":1.3},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.905,"5min":1.9510000000000001,"15min":2.1520000000000001},"last":1.206}]},{"osd":1,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.21,"15min":1.2350000000000001},"min":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.72,"5min":1.996,"15min":2.3050000000000002},"last":1.335},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2549999999999999,"15min":1.325},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8320000000000001,"5min":2.177,"15min":2.27},"last":1.3799999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2889999999999999,"15min":1.3280000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.726,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.401,"15min":1.4239999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.9750000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.97199999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.365,"15min":1.413},"min":{"1min":0.746,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8460000000000001,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.365},{"interface":"front","average":{"1min":1.466,"5min":1.4870000000000001,"15min":1.502},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.0379999999999998,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.4450000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.325,"15min":1.304},"min":{"1min":0.72499999999999998,"5min":0.626,"15min":0.624},"max":{"1min":1.863,"5min":2.254,"15min":2.375},"last":1.097},{"interface":"front","average":{"1min":1.421,"5min":1.3899999999999999,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.849,"5min":2.298,"15min":2.5459999999999998},"last":1.0449999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4570000000000001,"15min":1.4510000000000001},"min":{"1min":0.92400000000000004,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.845,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.163},{"interface":"front","average":{"1min":1.583,"5min":1.5149999999999999,"15min":1.5089999999999999},"min":{"1min":0.91400000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.9770000000000001,"5min":2.3109999999999999,"15min":2.4750000000000001},"last":1.272}]},{"osd":6,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.585,"15min":1.595},"min":{"1min":0.83699999999999997,"5min":0.82599999999999996,"15min":0.80500000000000005},"max":{"1min":2.081,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.496},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5700000000000001,"15min":1.5629999999999999},"min":{"1min":0.89500000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1960000000000002,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.3049999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509803,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.8069999999999999,"5min":1.931,"15min":2.4380000000000002},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.359,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.4630000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2290000000000001,"15min":1.2529999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.339,"5min":1.3819999999999999,"15min":1.3560000000000001},"min":{"1min":0.89600000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2069999999999999,"5min":2.2349999999999999,"15min":2.6680000000000001},"last":1.0409999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3939999999999999,"15min":1.419},"min":{"1min":0.98399999999999999,"5min":0.92100000000000004,"15min":0.82299999999999995},"max":{"1min":2.3180000000000001,"5min":2.367,"15min":2.367},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4079999999999999,"15min":1.4099999999999999},"min":{"1min":1.123,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.999}]},{"osd":3,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.514,"15min":1.486},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.071},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4950000000000001,"15min":1.4530000000000001},"min":{"1min":1.175,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.1240000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3620000000000001},"min":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.77000000000000002},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.427},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.462,"15min":1.421},"min":{"1min":0.93999999999999995,"5min":0.81699999999999995,"15min":0.68999999999999995},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.429,"15min":1.385},"min":{"1min":1,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.643,"5min":1.5960000000000001,"15min":1.5529999999999999},"min":{"1min":1.2450000000000001,"5min":0.95399999999999996,"15min":0.68300000000000005},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.175}]},{"osd":7,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.5980000000000001,"15min":1.5820000000000001},"min":{"1min":1.137,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":1.377},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.633,"15min":1.5760000000000001},"min":{"1min":1.224,"5min":1.044,"15min":0.96199999999999997},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.55}]}]},{"osd":5,"up_from":15,"seq":64424509804,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":1.117},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82599999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8700000000000001,"5min":1.954,"15min":2.3839999999999999},"last":1.2150000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.7250000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.087},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":0.97799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0169999999999999,"5min":2.677,"15min":2.677},"last":1.3779999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.397,"15min":1.347},"min":{"1min":1.026,"5min":0.83599999999999997,"15min":0.69699999999999995},"max":{"1min":1.9690000000000001,"5min":2.177,"15min":2.448},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4470000000000001,"15min":1.4510000000000001},"min":{"1min":1.1200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.9039999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.167}]},{"osd":3,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4570000000000001,"15min":1.4610000000000001},"min":{"1min":1.073,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.8140000000000001,"5min":2.3370000000000002,"15min":2.3650000000000002},"last":1.304},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5449999999999999,"15min":1.526},"min":{"1min":1.3049999999999999,"5min":1.048,"15min":0.77000000000000002},"max":{"1min":1.899,"5min":2.71,"15min":2.71},"last":1.423}]},{"osd":4,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.347,"15min":1.3460000000000001},"min":{"1min":0.88400000000000001,"5min":0.628,"15min":0.628},"max":{"1min":2.149,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.026},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.95799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1080000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.405}]},{"osd":6,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5149999999999999,"15min":1.4790000000000001},"min":{"1min":1.0169999999999999,"5min":0.80500000000000005,"15min":0.79000000000000004},"max":{"1min":2.375,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5389999999999999,"15min":1.5149999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.169,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.2709999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.5920000000000001,"15min":1.597},"min":{"1min":1.153,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":1.9350000000000001,"5min":2.6819999999999999,"15min":2.7629999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.673,"15min":1.659},"min":{"1min":1.1839999999999999,"5min":1.097,"15min":0.91900000000000004},"max":{"1min":2.452,"5min":2.5979999999999999,"15min":2.867},"last":1.3240000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509803,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.206,"15min":1.1950000000000001},"min":{"1min":0.80500000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":2.2410000000000001,"5min":2.5800000000000001,"15min":2.7069999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2509999999999999,"15min":1.278},"min":{"1min":0.80200000000000005,"5min":0.67900000000000005,"15min":0.52100000000000002},"max":{"1min":1.7410000000000001,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":1.0649999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.419,"15min":1.3839999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.44500000000000001},"max":{"1min":2.964,"5min":2.964,"15min":2.964},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.6559999999999999,"15min":1.5820000000000001},"min":{"1min":1.0609999999999999,"5min":0.61399999999999999,"15min":0.57299999999999995},"max":{"1min":2.4990000000000001,"5min":3.056,"15min":3.1779999999999999},"last":1.46}]},{"osd":2,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.6850000000000001,"15min":1.679},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.52700000000000002},"max":{"1min":2.645,"5min":2.996,"15min":3.5310000000000001},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.762,"15min":1.7509999999999999},"min":{"1min":1.0700000000000001,"5min":0.79900000000000004,"15min":0.69499999999999995},"max":{"1min":2.407,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":1.5760000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.5489999999999999,"15min":1.575},"min":{"1min":0.90700000000000003,"5min":0.82399999999999995,"15min":0.71399999999999997},"max":{"1min":2.7559999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.6719999999999999,"15min":1.6579999999999999},"min":{"1min":1.073,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":2.3439999999999999,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.9319999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.7370000000000001,"15min":1.748},"min":{"1min":1.0600000000000001,"5min":0.97299999999999998,"15min":0.68999999999999995},"max":{"1min":2.403,"5min":3.52,"15min":3.52},"last":1.268},{"interface":"front","average":{"1min":1.607,"5min":1.6930000000000001,"15min":1.6890000000000001},"min":{"1min":1.159,"5min":1.077,"15min":0.64600000000000002},"max":{"1min":2.1619999999999999,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.6160000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.8280000000000001,"15min":1.8009999999999999},"min":{"1min":1.2649999999999999,"5min":1.153,"15min":0.72199999999999998},"max":{"1min":2.46,"5min":2.887,"15min":3.1000000000000001},"last":1.675},{"interface":"front","average":{"1min":1.766,"5min":1.831,"15min":1.8680000000000001},"min":{"1min":0.98999999999999999,"5min":0.85799999999999998,"15min":0.73099999999999998},"max":{"1min":2.4060000000000001,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.7390000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":1.24,"5min":1.02,"15min":0.75},"max":{"1min":2.6440000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.921,"5min":1.974,"15min":1.944},"min":{"1min":1.3580000000000001,"5min":1.278,"15min":0.66800000000000004},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":3.2330000000000001},"last":1.875}]}]},{"osd":2,"up_from":15,"seq":64424509804,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.071,"15min":1.0740000000000001},"min":{"1min":0.60799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.7130000000000001,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4239999999999999,"15min":1.3799999999999999},"min":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.702},"last":0.85599999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.5149999999999999,"15min":1.48},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2120000000000002,"5min":2.4889999999999999,"15min":2.738},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.585,"15min":1.5589999999999999},"min":{"1min":1.0209999999999999,"5min":0.81200000000000006,"15min":0.71199999999999997},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.2350000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.625,"15min":1.5740000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.61799999999999999},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.046},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7090000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":2.29,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.4690000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.702,"15min":1.665},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2370000000000001,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.669,"15min":1.6439999999999999},"min":{"1min":1.04,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.363,"5min":2.6669999999999998,"15min":3.54},"last":1.3580000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.706,"15min":1.639},"min":{"1min":1.095,"5min":1.095,"15min":0.71199999999999997},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.8029999999999999,"15min":1.7869999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4020000000000001,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.181}]},{"osd":6,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.7649999999999999,"5min":1.8109999999999999,"15min":1.806},"min":{"1min":1.167,"5min":1.167,"15min":1.1020000000000001},"max":{"1min":2.5209999999999999,"5min":3.1720000000000002,"15min":3.6259999999999999},"last":1.613},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.8260000000000001,"15min":1.78},"min":{"1min":1.147,"5min":1.147,"15min":0.877},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.296}]},{"osd":7,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.873,"15min":1.875},"min":{"1min":1.218,"5min":1.163,"15min":1.0109999999999999},"max":{"1min":2.6829999999999998,"5min":3.012,"15min":3.7839999999999998},"last":1.518},{"interface":"front","average":{"1min":1.839,"5min":1.917,"15min":1.8680000000000001},"min":{"1min":1.4319999999999999,"5min":1.359,"15min":0.89200000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.5489999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509804,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.125,"15min":1.1339999999999999},"min":{"1min":0.746,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":2.6509999999999998,"15min":3.1960000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4139999999999999,"15min":1.371},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.66500000000000004},"max":{"1min":2.7789999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.458}]},{"osd":2,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.444,"15min":1.52},"min":{"1min":0.80100000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0590000000000002,"5min":2.8330000000000002,"15min":2.8359999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.5589999999999999,"15min":1.573},"min":{"1min":1.0069999999999999,"5min":0.82499999999999996,"15min":0.621},"max":{"1min":2.8769999999999998,"5min":3.1320000000000001,"15min":3.3450000000000002},"last":1.71}]},{"osd":3,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4770000000000001,"15min":1.587},"min":{"1min":0.876,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1219999999999999,"5min":2.7839999999999998,"15min":4.6660000000000004},"last":1.798},{"interface":"front","average":{"1min":1.615,"5min":1.7110000000000001,"15min":1.802},"min":{"1min":1.081,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":2.4319999999999999,"5min":2.9359999999999999,"15min":3.2829999999999999},"last":1.5349999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.621,"15min":1.6830000000000001},"min":{"1min":1.1619999999999999,"5min":1.0049999999999999,"15min":0.98999999999999999},"max":{"1min":2.2109999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.675,"15min":1.7150000000000001},"min":{"1min":1.1160000000000001,"5min":0.92600000000000005,"15min":0.79700000000000004},"max":{"1min":2.2290000000000001,"5min":2.544,"15min":3.1890000000000001},"last":1.288}]},{"osd":5,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.75,"15min":1.7370000000000001},"min":{"1min":1.1839999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.718,"15min":1.7709999999999999},"min":{"1min":1.163,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.4140000000000001,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.631}]},{"osd":6,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.792,"5min":1.8089999999999999,"15min":1.8620000000000001},"min":{"1min":1.147,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.4900000000000002,"5min":2.8290000000000002,"15min":3.399},"last":1.429},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.853,"15min":1.8460000000000001},"min":{"1min":1.375,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.46},"last":2.532}]},{"osd":7,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.9530000000000001,"15min":1.96},"min":{"1min":1.2270000000000001,"5min":1.1899999999999999,"15min":1.1000000000000001},"max":{"1min":3.21,"5min":3.21,"15min":3.6160000000000001},"last":2.6160000000000001},{"interface":"front","average":{"1min":1.762,"5min":1.8169999999999999,"15min":1.909},"min":{"1min":1.3540000000000001,"5min":1.121,"15min":1.121},"max":{"1min":2.1850000000000001,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.9119999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542508,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.82899999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6419999999999999,"5min":1.804,"15min":2.5649999999999999},"last":1.972},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2030000000000001,"15min":1.2829999999999999},"min":{"1min":0.76800000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.77,"5min":1.968,"15min":3.3769999999999998},"last":9.0700000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.319,"15min":1.3029999999999999},"min":{"1min":0.94599999999999995,"5min":0.77200000000000002,"15min":0.747},"max":{"1min":1.9370000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":9.1120000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.254,"15min":1.298},"min":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.7709999999999999,"5min":2.1179999999999999,"15min":3.3410000000000002},"last":17.715}]},{"osd":2,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.397,"15min":1.3999999999999999},"min":{"1min":1.02,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7989999999999999,"5min":1.962,"15min":2.7229999999999999},"last":3.1890000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3700000000000001,"15min":1.3720000000000001},"min":{"1min":1.0649999999999999,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.7010000000000001,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.873}]},{"osd":3,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4430000000000001,"15min":1.4590000000000001},"min":{"1min":1.02,"5min":0.90400000000000003,"15min":0.81200000000000006},"max":{"1min":2.177,"5min":2.177,"15min":2.2629999999999999},"last":8.2469999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.5029999999999999,"15min":1.5189999999999999},"min":{"1min":1.0820000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.9330000000000001,"5min":2.2869999999999999,"15min":2.6040000000000001},"last":8.2769999999999992}]},{"osd":5,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.351,"15min":1.323},"min":{"1min":0.96599999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9670000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":2.0249999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.4530000000000001,"15min":1.4410000000000001},"min":{"1min":1.056,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":2.0649999999999999,"5min":2.2690000000000001,"15min":3.0499999999999998},"last":8.1869999999999994}]},{"osd":6,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.472,"15min":1.4319999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.869,"5min":2.3879999999999999,"15min":2.9300000000000002},"last":3.0880000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5329999999999999,"15min":1.52},"min":{"1min":1.038,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":1.835,"5min":2.512,"15min":2.601},"last":1.9159999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.583,"15min":1.5549999999999999},"min":{"1min":1.2290000000000001,"5min":0.92600000000000005,"15min":0.86299999999999999},"max":{"1min":2.484,"5min":2.5449999999999999,"15min":3.1829999999999998},"last":8.7769999999999992},{"interface":"front","average":{"1min":1.752,"5min":1.643,"15min":1.613},"min":{"1min":1.3779999999999999,"5min":1.0449999999999999,"15min":0.999},"max":{"1min":2.4199999999999999,"5min":2.6080000000000001,"15min":3.23},"last":8.4290000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2,"15min":1.1850000000000001},"min":{"1min":0.78500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":2.2959999999999998,"5min":2.944,"15min":2.944},"last":1.417},{"interface":"front","average":{"1min":1.254,"5min":1.2210000000000001,"15min":1.3120000000000001},"min":{"1min":0.88800000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.077}]},{"osd":2,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.431,"15min":1.421},"min":{"1min":0.69299999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.0289999999999999,"5min":2.835,"15min":3.585},"last":1.661},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.5549999999999999,"15min":1.583},"min":{"1min":0.98099999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.4180000000000001,"5min":2.75,"15min":2.8719999999999999},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":1.76,"15min":1.728},"min":{"1min":0.98299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":2.5379999999999998,"5min":2.964,"15min":3.3740000000000001},"last":1.28},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.573,"15min":1.5840000000000001},"min":{"1min":0.76600000000000001,"5min":0.66000000000000003,"15min":0.51200000000000001},"max":{"1min":2.3530000000000002,"5min":2.8370000000000002,"15min":3.234},"last":1.351}]},{"osd":4,"last update":"Mon Oct 16 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.593,"15min":1.573},"min":{"1min":1.1160000000000001,"5min":0.81000000000000005,"15min":0.71499999999999997},"max":{"1min":2.2450000000000001,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.462},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":1.2050000000000001,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":2.371,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.179}]},{"osd":5,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.6299999999999999,"15min":1.6519999999999999},"min":{"1min":1.0720000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.02,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.796,"15min":1.75},"min":{"1min":1.3180000000000001,"5min":1.022,"15min":0.77400000000000002},"max":{"1min":2.4340000000000002,"5min":3.2170000000000001,"15min":3.819},"last":1.714}]},{"osd":6,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8260000000000001},"min":{"1min":1.1160000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.3130000000000002,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.859,"15min":1.8460000000000001},"min":{"1min":1.3,"5min":0.92000000000000004,"15min":0.746},"max":{"1min":2.6499999999999999,"5min":2.698,"15min":3.3210000000000002},"last":1.534}]},{"osd":7,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.804,"15min":1.825},"min":{"1min":1.113,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.7829999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.764},{"interface":"front","average":{"1min":1.923,"5min":2,"15min":1.964},"min":{"1min":1.401,"5min":1.1599999999999999,"15min":0.96299999999999997},"max":{"1min":2.536,"5min":3.3239999999999998,"15min":3.923},"last":1.802}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:40.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:40.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.565+0000 7f602f59e640 1 Processor -- start 2023-10-16T20:10:40.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.565+0000 7f602f59e640 1 -- start start 2023-10-16T20:10:40.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.567+0000 7f602f59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60300c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.567+0000 7f602f59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60300c68a0 0x7f6030070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.567+0000 7f602f59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f603006e070 0x7f603015c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.567+0000 7f602f59e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603006bbe0 con 0x7f603006e070 2023-10-16T20:10:40.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.567+0000 7f602f59e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6030159990 con 0x7f60300c68a0 2023-10-16T20:10:40.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.567+0000 7f602f59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60300701d0 con 0x7f6030153240 2023-10-16T20:10:40.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.568+0000 7f602e59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60300c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:40.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.569+0000 7f602e59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60300c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:47814/0 (socket says 172.21.15.57:47814) 2023-10-16T20:10:40.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.569+0000 7f602e59c640 1 -- 172.21.15.57:0/3129104779 learned_addr learned my addr 172.21.15.57:0/3129104779 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:40.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.576+0000 7f602e59c640 1 -- 172.21.15.57:0/3129104779 >> v2:172.21.15.110:3300/0 conn(0x7f60300c68a0 msgr2=0x7f6030070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:40.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.576+0000 7f602e59c640 1 --2- 172.21.15.57:0/3129104779 >> v2:172.21.15.110:3300/0 conn(0x7f60300c68a0 0x7f6030070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.576+0000 7f602e59c640 1 -- 172.21.15.57:0/3129104779 >> v2:172.21.15.57:3300/0 conn(0x7f603006e070 msgr2=0x7f603015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:40.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.576+0000 7f602e59c640 1 --2- 172.21.15.57:0/3129104779 >> v2:172.21.15.57:3300/0 conn(0x7f603006e070 0x7f603015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.576+0000 7f602e59c640 1 -- 172.21.15.57:0/3129104779 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300704b0 con 0x7f6030153240 2023-10-16T20:10:40.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.582+0000 7f602e59c640 1 --2- 172.21.15.57:0/3129104779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60300c4e00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f603006cd00 tx=0x7f602002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2753c01b39b74e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:40.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.601+0000 7f602d59a640 1 -- 172.21.15.57:0/3129104779 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020030860 con 0x7f6030153240 2023-10-16T20:10:40.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.602+0000 7f602d59a640 1 -- 172.21.15.57:0/3129104779 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60200309c0 con 0x7f6030153240 2023-10-16T20:10:40.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.602+0000 7f602d59a640 1 -- 172.21.15.57:0/3129104779 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020030d50 con 0x7f6030153240 2023-10-16T20:10:40.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 -- 172.21.15.57:0/3129104779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 msgr2=0x7f60300c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:40.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 --2- 172.21.15.57:0/3129104779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60300c4e00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f603006cd00 tx=0x7f602002b9a0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 -- 172.21.15.57:0/3129104779 shutdown_connections 2023-10-16T20:10:40.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 --2- 172.21.15.57:0/3129104779 >> v2:172.21.15.110:3300/0 conn(0x7f60300c68a0 0x7f6030070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 --2- 172.21.15.57:0/3129104779 >> v2:172.21.15.57:3300/0 conn(0x7f603006e070 0x7f603015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 --2- 172.21.15.57:0/3129104779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60300c4e00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 -- 172.21.15.57:0/3129104779 >> 172.21.15.57:0/3129104779 conn(0x7f60300c6f00 msgr2=0x7f60300c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:40.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 -- 172.21.15.57:0/3129104779 shutdown_connections 2023-10-16T20:10:40.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.603+0000 7f602f59e640 1 -- 172.21.15.57:0/3129104779 wait complete. 2023-10-16T20:10:40.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.605+0000 7f602f59e640 1 Processor -- start 2023-10-16T20:10:40.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.605+0000 7f602f59e640 1 -- start start 2023-10-16T20:10:40.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.606+0000 7f602f59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 0x7f603014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.606+0000 7f602f59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60300c68a0 0x7f603014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.607+0000 7f602f59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60301ee430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.607+0000 7f602f59e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603014fa30 con 0x7f603006e070 2023-10-16T20:10:40.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.607+0000 7f602f59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603014f6a0 con 0x7f60300c68a0 2023-10-16T20:10:40.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.607+0000 7f602f59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603014fc80 con 0x7f6030153240 2023-10-16T20:10:40.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.665+0000 7f602dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60300c68a0 0x7f603014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.679+0000 7f602e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 0x7f603014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.681+0000 7f602e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 0x7f603014bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54186/0 (socket says 172.21.15.57:54186) 2023-10-16T20:10:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.681+0000 7f602e59c640 1 -- 172.21.15.57:0/2348610775 learned_addr learned my addr 172.21.15.57:0/2348610775 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.698+0000 7f602e59c640 1 -- 172.21.15.57:0/2348610775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 msgr2=0x7f60301ee430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.698+0000 7f602e59c640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60301ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.698+0000 7f602e59c640 1 -- 172.21.15.57:0/2348610775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60300c68a0 msgr2=0x7f603014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.698+0000 7f602e59c640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60300c68a0 0x7f603014ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.698+0000 7f602e59c640 1 -- 172.21.15.57:0/2348610775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200094d0 con 0x7f603006e070 2023-10-16T20:10:40.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.711+0000 7f602e59c640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 0x7f603014bf20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f60200090b0 tx=0x7f6020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:40.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.728+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602003e040 con 0x7f603006e070 2023-10-16T20:10:40.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.728+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020030810 con 0x7f603006e070 2023-10-16T20:10:40.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.729+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020044630 con 0x7f603006e070 2023-10-16T20:10:40.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.729+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603014ff60 con 0x7f603006e070 2023-10-16T20:10:40.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.729+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6030150520 con 0x7f603006e070 2023-10-16T20:10:40.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.731+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030150740 con 0x7f603006e070 2023-10-16T20:10:40.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.778+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f602004d3b0 con 0x7f603006e070 2023-10-16T20:10:40.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.781+0000 7f601effd640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f601006aec0 0x7f601006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:40.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.782+0000 7f602dd9b640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f601006aec0 0x7f601006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:40.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:40.783+0000 7f602dd9b640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f601006aec0 0x7f601006d380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6030158760 tx=0x7f6024008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:41.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.097+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f602007b860 con 0x7f603006e070 2023-10-16T20:10:41.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.097+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60200774a0 con 0x7f603006e070 2023-10-16T20:10:41.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.296+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f603014fdf0 con 0x7f601006aec0 2023-10-16T20:10:41.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.309+0000 7f601effd640 1 -- 172.21.15.57:0/2348610775 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287765 (secure 0 0 0) 0x7f603014fdf0 con 0x7f601006aec0 2023-10-16T20:10:41.315 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:41.317 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:10:41.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f601006aec0 msgr2=0x7f601006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:41.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f601006aec0 0x7f601006d380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6030158760 tx=0x7f6024008040 comp rx=0 tx=0).stop 2023-10-16T20:10:41.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 msgr2=0x7f603014bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:41.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 0x7f603014bf20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f60200090b0 tx=0x7f6020004730 comp rx=0 tx=0).stop 2023-10-16T20:10:41.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 shutdown_connections 2023-10-16T20:10:41.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f601006aec0 0x7f601006d380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6030153240 0x7f60301ee430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60300c68a0 0x7f603014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 --2- 172.21.15.57:0/2348610775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f603006e070 0x7f603014bf20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 >> 172.21.15.57:0/2348610775 conn(0x7f60300c6f00 msgr2=0x7f603014e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:41.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 shutdown_connections 2023-10-16T20:10:41.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.316+0000 7f602f59e640 1 -- 172.21.15.57:0/2348610775 wait complete. 2023-10-16T20:10:41.339 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":923,"stamp":"2023-10-16T20:10:40.230354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12826,"ondisk_log_size":12826,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8915,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410265+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T20:10:33.410265+0000","last_peered":"2023-10-16T20:10:33.410265+0000","last_clean":"2023-10-16T20:10:33.410265+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:10:33.410265+0000","last_undegraded":"2023-10-16T20:10:33.410265+0000","last_fullsized":"2023-10-16T20:10:33.410265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.484463+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T20:10:33.484463+0000","last_peered":"2023-10-16T20:10:33.484463+0000","last_clean":"2023-10-16T20:10:33.484463+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:10:33.484463+0000","last_undegraded":"2023-10-16T20:10:33.484463+0000","last_fullsized":"2023-10-16T20:10:33.484463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580051+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T20:10:33.580051+0000","last_peered":"2023-10-16T20:10:33.580051+0000","last_clean":"2023-10-16T20:10:33.580051+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:33.580051+0000","last_undegraded":"2023-10-16T20:10:33.580051+0000","last_fullsized":"2023-10-16T20:10:33.580051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587881+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T20:10:33.587881+0000","last_peered":"2023-10-16T20:10:33.587881+0000","last_clean":"2023-10-16T20:10:33.587881+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:10:33.587881+0000","last_undegraded":"2023-10-16T20:10:33.587881+0000","last_fullsized":"2023-10-16T20:10:33.587881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.386106+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T20:10:33.386106+0000","last_peered":"2023-10-16T20:10:33.386106+0000","last_clean":"2023-10-16T20:10:33.386106+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:10:33.386106+0000","last_undegraded":"2023-10-16T20:10:33.386106+0000","last_fullsized":"2023-10-16T20:10:33.386106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.588335+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T20:10:33.588335+0000","last_peered":"2023-10-16T20:10:33.588335+0000","last_clean":"2023-10-16T20:10:33.588335+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:10:33.588335+0000","last_undegraded":"2023-10-16T20:10:33.588335+0000","last_fullsized":"2023-10-16T20:10:33.588335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.477708+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T20:10:33.477708+0000","last_peered":"2023-10-16T20:10:33.477708+0000","last_clean":"2023-10-16T20:10:33.477708+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:33.477708+0000","last_undegraded":"2023-10-16T20:10:33.477708+0000","last_fullsized":"2023-10-16T20:10:33.477708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504184+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T20:10:33.504184+0000","last_peered":"2023-10-16T20:10:33.504184+0000","last_clean":"2023-10-16T20:10:33.504184+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:10:33.504184+0000","last_undegraded":"2023-10-16T20:10:33.504184+0000","last_fullsized":"2023-10-16T20:10:33.504184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413486+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413486+0000","last_peered":"2023-10-16T20:10:33.413486+0000","last_clean":"2023-10-16T20:10:33.413486+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413486+0000","last_undegraded":"2023-10-16T20:10:33.413486+0000","last_fullsized":"2023-10-16T20:10:33.413486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:19:30.948426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.605626+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T20:10:33.605626+0000","last_peered":"2023-10-16T20:10:33.605626+0000","last_clean":"2023-10-16T20:10:33.605626+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:10:33.605626+0000","last_undegraded":"2023-10-16T20:10:33.605626+0000","last_fullsized":"2023-10-16T20:10:33.605626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.559967+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T20:10:33.559967+0000","last_peered":"2023-10-16T20:10:33.559967+0000","last_clean":"2023-10-16T20:10:33.559967+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:10:33.559967+0000","last_undegraded":"2023-10-16T20:10:33.559967+0000","last_fullsized":"2023-10-16T20:10:33.559967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.594073+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T20:10:33.594073+0000","last_peered":"2023-10-16T20:10:33.594073+0000","last_clean":"2023-10-16T20:10:33.594073+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:10:33.594073+0000","last_undegraded":"2023-10-16T20:10:33.594073+0000","last_fullsized":"2023-10-16T20:10:33.594073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504336+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T20:10:33.504336+0000","last_peered":"2023-10-16T20:10:33.504336+0000","last_clean":"2023-10-16T20:10:33.504336+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:10:33.504336+0000","last_undegraded":"2023-10-16T20:10:33.504336+0000","last_fullsized":"2023-10-16T20:10:33.504336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584390+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T20:10:33.584390+0000","last_peered":"2023-10-16T20:10:33.584390+0000","last_clean":"2023-10-16T20:10:33.584390+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:10:33.584390+0000","last_undegraded":"2023-10-16T20:10:33.584390+0000","last_fullsized":"2023-10-16T20:10:33.584390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.398973+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T20:10:33.398973+0000","last_peered":"2023-10-16T20:10:33.398973+0000","last_clean":"2023-10-16T20:10:33.398973+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:10:33.398973+0000","last_undegraded":"2023-10-16T20:10:33.398973+0000","last_fullsized":"2023-10-16T20:10:33.398973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586214+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T20:10:33.586214+0000","last_peered":"2023-10-16T20:10:33.586214+0000","last_clean":"2023-10-16T20:10:33.586214+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:10:33.586214+0000","last_undegraded":"2023-10-16T20:10:33.586214+0000","last_fullsized":"2023-10-16T20:10:33.586214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.570822+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T20:10:33.570822+0000","last_peered":"2023-10-16T20:10:33.570822+0000","last_clean":"2023-10-16T20:10:33.570822+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:10:33.570822+0000","last_undegraded":"2023-10-16T20:10:33.570822+0000","last_fullsized":"2023-10-16T20:10:33.570822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.627120+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T20:10:33.627120+0000","last_peered":"2023-10-16T20:10:33.627120+0000","last_clean":"2023-10-16T20:10:33.627120+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:33.627120+0000","last_undegraded":"2023-10-16T20:10:33.627120+0000","last_fullsized":"2023-10-16T20:10:33.627120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.416579+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T20:10:33.416579+0000","last_peered":"2023-10-16T20:10:33.416579+0000","last_clean":"2023-10-16T20:10:33.416579+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:10:33.416579+0000","last_undegraded":"2023-10-16T20:10:33.416579+0000","last_fullsized":"2023-10-16T20:10:33.416579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.589018+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T20:10:33.589018+0000","last_peered":"2023-10-16T20:10:33.589018+0000","last_clean":"2023-10-16T20:10:33.589018+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:10:33.589018+0000","last_undegraded":"2023-10-16T20:10:33.589018+0000","last_fullsized":"2023-10-16T20:10:33.589018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580533+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T20:10:33.580533+0000","last_peered":"2023-10-16T20:10:33.580533+0000","last_clean":"2023-10-16T20:10:33.580533+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:10:33.580533+0000","last_undegraded":"2023-10-16T20:10:33.580533+0000","last_fullsized":"2023-10-16T20:10:33.580533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587275+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T20:10:33.587275+0000","last_peered":"2023-10-16T20:10:33.587275+0000","last_clean":"2023-10-16T20:10:33.587275+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:10:33.587275+0000","last_undegraded":"2023-10-16T20:10:33.587275+0000","last_fullsized":"2023-10-16T20:10:33.587275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.421682+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T20:10:33.421682+0000","last_peered":"2023-10-16T20:10:33.421682+0000","last_clean":"2023-10-16T20:10:33.421682+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:33.421682+0000","last_undegraded":"2023-10-16T20:10:33.421682+0000","last_fullsized":"2023-10-16T20:10:33.421682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587450+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T20:10:33.587450+0000","last_peered":"2023-10-16T20:10:33.587450+0000","last_clean":"2023-10-16T20:10:33.587450+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:10:33.587450+0000","last_undegraded":"2023-10-16T20:10:33.587450+0000","last_fullsized":"2023-10-16T20:10:33.587450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.408954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T20:10:33.408954+0000","last_peered":"2023-10-16T20:10:33.408954+0000","last_clean":"2023-10-16T20:10:33.408954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:10:33.408954+0000","last_undegraded":"2023-10-16T20:10:33.408954+0000","last_fullsized":"2023-10-16T20:10:33.408954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590410+0000","last_change":"2023-10-16T19:41:25.495312+0000","last_active":"2023-10-16T20:10:33.590410+0000","last_peered":"2023-10-16T20:10:33.590410+0000","last_clean":"2023-10-16T20:10:33.590410+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:10:33.590410+0000","last_undegraded":"2023-10-16T20:10:33.590410+0000","last_fullsized":"2023-10-16T20:10:33.590410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.445781+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T20:10:33.445781+0000","last_peered":"2023-10-16T20:10:33.445781+0000","last_clean":"2023-10-16T20:10:33.445781+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:10:33.445781+0000","last_undegraded":"2023-10-16T20:10:33.445781+0000","last_fullsized":"2023-10-16T20:10:33.445781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451146+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T20:10:33.451146+0000","last_peered":"2023-10-16T20:10:33.451146+0000","last_clean":"2023-10-16T20:10:33.451146+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:10:33.451146+0000","last_undegraded":"2023-10-16T20:10:33.451146+0000","last_fullsized":"2023-10-16T20:10:33.451146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583441+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T20:10:33.583441+0000","last_peered":"2023-10-16T20:10:33.583441+0000","last_clean":"2023-10-16T20:10:33.583441+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:10:33.583441+0000","last_undegraded":"2023-10-16T20:10:33.583441+0000","last_fullsized":"2023-10-16T20:10:33.583441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.585861+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T20:10:33.585861+0000","last_peered":"2023-10-16T20:10:33.585861+0000","last_clean":"2023-10-16T20:10:33.585861+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:10:33.585861+0000","last_undegraded":"2023-10-16T20:10:33.585861+0000","last_fullsized":"2023-10-16T20:10:33.585861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.626070+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T20:10:33.626070+0000","last_peered":"2023-10-16T20:10:33.626070+0000","last_clean":"2023-10-16T20:10:33.626070+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:33.626070+0000","last_undegraded":"2023-10-16T20:10:33.626070+0000","last_fullsized":"2023-10-16T20:10:33.626070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590788+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T20:10:33.590788+0000","last_peered":"2023-10-16T20:10:33.590788+0000","last_clean":"2023-10-16T20:10:33.590788+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:10:33.590788+0000","last_undegraded":"2023-10-16T20:10:33.590788+0000","last_fullsized":"2023-10-16T20:10:33.590788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.595432+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T20:10:33.595432+0000","last_peered":"2023-10-16T20:10:33.595432+0000","last_clean":"2023-10-16T20:10:33.595432+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:10:33.595432+0000","last_undegraded":"2023-10-16T20:10:33.595432+0000","last_fullsized":"2023-10-16T20:10:33.595432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2224","reported_seq":2252,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.666044+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T20:10:33.666044+0000","last_peered":"2023-10-16T20:10:33.666044+0000","last_clean":"2023-10-16T20:10:33.666044+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:33.666044+0000","last_undegraded":"2023-10-16T20:10:33.666044+0000","last_fullsized":"2023-10-16T20:10:33.666044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584389+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T20:10:33.584389+0000","last_peered":"2023-10-16T20:10:33.584389+0000","last_clean":"2023-10-16T20:10:33.584389+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:10:33.584389+0000","last_undegraded":"2023-10-16T20:10:33.584389+0000","last_fullsized":"2023-10-16T20:10:33.584389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'121","reported_seq":258,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:30.057629+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T20:09:30.057629+0000","last_peered":"2023-10-16T20:09:30.057629+0000","last_clean":"2023-10-16T20:09:30.057629+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:09:30.057629+0000","last_undegraded":"2023-10-16T20:09:30.057629+0000","last_fullsized":"2023-10-16T20:09:30.057629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'203","reported_seq":426,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.633215+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T20:10:13.633215+0000","last_peered":"2023-10-16T20:10:13.633215+0000","last_clean":"2023-10-16T20:10:13.633215+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:13.633215+0000","last_undegraded":"2023-10-16T20:10:13.633215+0000","last_fullsized":"2023-10-16T20:10:13.633215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.502464+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T20:10:33.502464+0000","last_peered":"2023-10-16T20:10:33.502464+0000","last_clean":"2023-10-16T20:10:33.502464+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:10:33.502464+0000","last_undegraded":"2023-10-16T20:10:33.502464+0000","last_fullsized":"2023-10-16T20:10:33.502464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'7","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:56.062806+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T20:09:56.062806+0000","last_peered":"2023-10-16T20:09:56.062806+0000","last_clean":"2023-10-16T20:09:56.062806+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:09:56.062806+0000","last_undegraded":"2023-10-16T20:09:56.062806+0000","last_fullsized":"2023-10-16T20:09:56.062806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.447539+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T20:10:33.447539+0000","last_peered":"2023-10-16T20:10:33.447539+0000","last_clean":"2023-10-16T20:10:33.447539+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:10:33.447539+0000","last_undegraded":"2023-10-16T20:10:33.447539+0000","last_fullsized":"2023-10-16T20:10:33.447539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'169","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.942089+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T20:10:32.942089+0000","last_peered":"2023-10-16T20:10:32.942089+0000","last_clean":"2023-10-16T20:10:32.942089+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:10:32.942089+0000","last_undegraded":"2023-10-16T20:10:32.942089+0000","last_fullsized":"2023-10-16T20:10:32.942089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583115+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T20:10:33.583115+0000","last_peered":"2023-10-16T20:10:33.583115+0000","last_clean":"2023-10-16T20:10:33.583115+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:10:33.583115+0000","last_undegraded":"2023-10-16T20:10:33.583115+0000","last_fullsized":"2023-10-16T20:10:33.583115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'80","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:44.535041+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T20:09:44.535041+0000","last_peered":"2023-10-16T20:09:44.535041+0000","last_clean":"2023-10-16T20:09:44.535041+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:09:44.535041+0000","last_undegraded":"2023-10-16T20:09:44.535041+0000","last_fullsized":"2023-10-16T20:09:44.535041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581935+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T20:10:33.581935+0000","last_peered":"2023-10-16T20:10:33.581935+0000","last_clean":"2023-10-16T20:10:33.581935+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:10:33.581935+0000","last_undegraded":"2023-10-16T20:10:33.581935+0000","last_fullsized":"2023-10-16T20:10:33.581935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'84","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:24.530946+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T20:10:24.530946+0000","last_peered":"2023-10-16T20:10:24.530946+0000","last_clean":"2023-10-16T20:10:24.530946+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:24.530946+0000","last_undegraded":"2023-10-16T20:10:24.530946+0000","last_fullsized":"2023-10-16T20:10:24.530946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.342447+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T20:10:33.342447+0000","last_peered":"2023-10-16T20:10:33.342447+0000","last_clean":"2023-10-16T20:10:33.342447+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:10:33.342447+0000","last_undegraded":"2023-10-16T20:10:33.342447+0000","last_fullsized":"2023-10-16T20:10:33.342447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1226","reported_seq":1255,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.798808+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T20:10:11.798808+0000","last_peered":"2023-10-16T20:10:11.798808+0000","last_clean":"2023-10-16T20:10:11.798808+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:10:11.798808+0000","last_undegraded":"2023-10-16T20:10:11.798808+0000","last_fullsized":"2023-10-16T20:10:11.798808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451956+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T20:10:33.451956+0000","last_peered":"2023-10-16T20:10:33.451956+0000","last_clean":"2023-10-16T20:10:33.451956+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:10:33.451956+0000","last_undegraded":"2023-10-16T20:10:33.451956+0000","last_fullsized":"2023-10-16T20:10:33.451956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'116","reported_seq":247,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.012976+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T20:10:20.012976+0000","last_peered":"2023-10-16T20:10:20.012976+0000","last_clean":"2023-10-16T20:10:20.012976+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:20.012976+0000","last_undegraded":"2023-10-16T20:10:20.012976+0000","last_fullsized":"2023-10-16T20:10:20.012976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579846+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T20:10:33.579846+0000","last_peered":"2023-10-16T20:10:33.579846+0000","last_clean":"2023-10-16T20:10:33.579846+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:10:33.579846+0000","last_undegraded":"2023-10-16T20:10:33.579846+0000","last_fullsized":"2023-10-16T20:10:33.579846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'94","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.112139+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T20:10:20.112139+0000","last_peered":"2023-10-16T20:10:20.112139+0000","last_clean":"2023-10-16T20:10:20.112139+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:10:20.112139+0000","last_undegraded":"2023-10-16T20:10:20.112139+0000","last_fullsized":"2023-10-16T20:10:20.112139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.405427+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T20:10:33.405427+0000","last_peered":"2023-10-16T20:10:33.405427+0000","last_clean":"2023-10-16T20:10:33.405427+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:10:33.405427+0000","last_undegraded":"2023-10-16T20:10:33.405427+0000","last_fullsized":"2023-10-16T20:10:33.405427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'915","reported_seq":944,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.946659+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T20:10:32.946659+0000","last_peered":"2023-10-16T20:10:32.946659+0000","last_clean":"2023-10-16T20:10:32.946659+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:10:32.946659+0000","last_undegraded":"2023-10-16T20:10:32.946659+0000","last_fullsized":"2023-10-16T20:10:32.946659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.522059+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T20:10:33.522059+0000","last_peered":"2023-10-16T20:10:33.522059+0000","last_clean":"2023-10-16T20:10:33.522059+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:10:33.522059+0000","last_undegraded":"2023-10-16T20:10:33.522059+0000","last_fullsized":"2023-10-16T20:10:33.522059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'112","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:51.891715+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T20:09:51.891715+0000","last_peered":"2023-10-16T20:09:51.891715+0000","last_clean":"2023-10-16T20:09:51.891715+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:09:51.891715+0000","last_undegraded":"2023-10-16T20:09:51.891715+0000","last_fullsized":"2023-10-16T20:09:51.891715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.411939+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T20:10:33.411939+0000","last_peered":"2023-10-16T20:10:33.411939+0000","last_clean":"2023-10-16T20:10:33.411939+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:33.411939+0000","last_undegraded":"2023-10-16T20:10:33.411939+0000","last_fullsized":"2023-10-16T20:10:33.411939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'191","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:14.234893+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T20:10:14.234893+0000","last_peered":"2023-10-16T20:10:14.234893+0000","last_clean":"2023-10-16T20:10:14.234893+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:14.234893+0000","last_undegraded":"2023-10-16T20:10:14.234893+0000","last_fullsized":"2023-10-16T20:10:14.234893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.360807+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T20:10:33.360807+0000","last_peered":"2023-10-16T20:10:33.360807+0000","last_clean":"2023-10-16T20:10:33.360807+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:10:33.360807+0000","last_undegraded":"2023-10-16T20:10:33.360807+0000","last_fullsized":"2023-10-16T20:10:33.360807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'9","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.666624+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T20:10:13.666624+0000","last_peered":"2023-10-16T20:10:13.666624+0000","last_clean":"2023-10-16T20:10:13.666624+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:13.666624+0000","last_undegraded":"2023-10-16T20:10:13.666624+0000","last_fullsized":"2023-10-16T20:10:13.666624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410999+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T20:10:33.410999+0000","last_peered":"2023-10-16T20:10:33.410999+0000","last_clean":"2023-10-16T20:10:33.410999+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:10:33.410999+0000","last_undegraded":"2023-10-16T20:10:33.410999+0000","last_fullsized":"2023-10-16T20:10:33.410999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.267853+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T20:10:13.267853+0000","last_peered":"2023-10-16T20:10:13.267853+0000","last_clean":"2023-10-16T20:10:13.267853+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:10:13.267853+0000","last_undegraded":"2023-10-16T20:10:13.267853+0000","last_fullsized":"2023-10-16T20:10:13.267853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.624110+0000","last_change":"2023-10-16T19:41:25.728395+0000","last_active":"2023-10-16T20:10:33.624110+0000","last_peered":"2023-10-16T20:10:33.624110+0000","last_clean":"2023-10-16T20:10:33.624110+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:10:33.624110+0000","last_undegraded":"2023-10-16T20:10:33.624110+0000","last_fullsized":"2023-10-16T20:10:33.624110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:29.023300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'593","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.941718+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T20:10:32.941718+0000","last_peered":"2023-10-16T20:10:32.941718+0000","last_clean":"2023-10-16T20:10:32.941718+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:32.941718+0000","last_undegraded":"2023-10-16T20:10:32.941718+0000","last_fullsized":"2023-10-16T20:10:32.941718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.439287+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T20:10:33.439287+0000","last_peered":"2023-10-16T20:10:33.439287+0000","last_clean":"2023-10-16T20:10:33.439287+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:10:33.439287+0000","last_undegraded":"2023-10-16T20:10:33.439287+0000","last_fullsized":"2023-10-16T20:10:33.439287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:41.265191+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T20:06:41.265191+0000","last_peered":"2023-10-16T20:06:41.265191+0000","last_clean":"2023-10-16T20:06:41.265191+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:06:41.265191+0000","last_undegraded":"2023-10-16T20:06:41.265191+0000","last_fullsized":"2023-10-16T20:06:41.265191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:08:01.239242+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T20:08:01.239242+0000","last_peered":"2023-10-16T20:08:01.239242+0000","last_clean":"2023-10-16T20:08:01.239242+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:08:01.239242+0000","last_undegraded":"2023-10-16T20:08:01.239242+0000","last_fullsized":"2023-10-16T20:08:01.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.501193+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T20:10:33.501193+0000","last_peered":"2023-10-16T20:10:33.501193+0000","last_clean":"2023-10-16T20:10:33.501193+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:10:33.501193+0000","last_undegraded":"2023-10-16T20:10:33.501193+0000","last_fullsized":"2023-10-16T20:10:33.501193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'10","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.421795+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T20:10:13.421795+0000","last_peered":"2023-10-16T20:10:13.421795+0000","last_clean":"2023-10-16T20:10:13.421795+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:10:13.421795+0000","last_undegraded":"2023-10-16T20:10:13.421795+0000","last_fullsized":"2023-10-16T20:10:13.421795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579847+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T20:10:33.579847+0000","last_peered":"2023-10-16T20:10:33.579847+0000","last_clean":"2023-10-16T20:10:33.579847+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:10:33.579847+0000","last_undegraded":"2023-10-16T20:10:33.579847+0000","last_fullsized":"2023-10-16T20:10:33.579847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'180","reported_seq":299,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:29.575973+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T20:10:29.575973+0000","last_peered":"2023-10-16T20:10:29.575973+0000","last_clean":"2023-10-16T20:10:29.575973+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:29.575973+0000","last_undegraded":"2023-10-16T20:10:29.575973+0000","last_fullsized":"2023-10-16T20:10:29.575973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.375187+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T20:10:33.375187+0000","last_peered":"2023-10-16T20:10:33.375187+0000","last_clean":"2023-10-16T20:10:33.375187+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:10:33.375187+0000","last_undegraded":"2023-10-16T20:10:33.375187+0000","last_fullsized":"2023-10-16T20:10:33.375187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'439","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.949381+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T20:10:32.949381+0000","last_peered":"2023-10-16T20:10:32.949381+0000","last_clean":"2023-10-16T20:10:32.949381+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:10:32.949381+0000","last_undegraded":"2023-10-16T20:10:32.949381+0000","last_fullsized":"2023-10-16T20:10:32.949381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596484+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T20:10:33.596484+0000","last_peered":"2023-10-16T20:10:33.596484+0000","last_clean":"2023-10-16T20:10:33.596484+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:10:33.596484+0000","last_undegraded":"2023-10-16T20:10:33.596484+0000","last_fullsized":"2023-10-16T20:10:33.596484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.266788+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T20:10:08.266788+0000","last_peered":"2023-10-16T20:10:08.266788+0000","last_clean":"2023-10-16T20:10:08.266788+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:08.266788+0000","last_undegraded":"2023-10-16T20:10:08.266788+0000","last_fullsized":"2023-10-16T20:10:08.266788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586134+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T20:10:33.586134+0000","last_peered":"2023-10-16T20:10:33.586134+0000","last_clean":"2023-10-16T20:10:33.586134+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:10:33.586134+0000","last_undegraded":"2023-10-16T20:10:33.586134+0000","last_fullsized":"2023-10-16T20:10:33.586134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'72","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.061284+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T20:10:08.061284+0000","last_peered":"2023-10-16T20:10:08.061284+0000","last_clean":"2023-10-16T20:10:08.061284+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:10:08.061284+0000","last_undegraded":"2023-10-16T20:10:08.061284+0000","last_fullsized":"2023-10-16T20:10:08.061284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.384254+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T20:10:33.384254+0000","last_peered":"2023-10-16T20:10:33.384254+0000","last_clean":"2023-10-16T20:10:33.384254+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:10:33.384254+0000","last_undegraded":"2023-10-16T20:10:33.384254+0000","last_fullsized":"2023-10-16T20:10:33.384254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'179","reported_seq":209,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:26.801226+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T20:10:26.801226+0000","last_peered":"2023-10-16T20:10:26.801226+0000","last_clean":"2023-10-16T20:10:26.801226+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:26.801226+0000","last_undegraded":"2023-10-16T20:10:26.801226+0000","last_fullsized":"2023-10-16T20:10:26.801226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.622595+0000","last_change":"2023-10-16T19:41:25.493927+0000","last_active":"2023-10-16T20:10:33.622595+0000","last_peered":"2023-10-16T20:10:33.622595+0000","last_clean":"2023-10-16T20:10:33.622595+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:10:33.622595+0000","last_undegraded":"2023-10-16T20:10:33.622595+0000","last_fullsized":"2023-10-16T20:10:33.622595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.153861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'15","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.432292+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T20:10:13.432292+0000","last_peered":"2023-10-16T20:10:13.432292+0000","last_clean":"2023-10-16T20:10:13.432292+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:10:13.432292+0000","last_undegraded":"2023-10-16T20:10:13.432292+0000","last_fullsized":"2023-10-16T20:10:13.432292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":76,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580103+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T20:10:33.580103+0000","last_peered":"2023-10-16T20:10:33.580103+0000","last_clean":"2023-10-16T20:10:33.580103+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:10:33.580103+0000","last_undegraded":"2023-10-16T20:10:33.580103+0000","last_fullsized":"2023-10-16T20:10:33.580103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:03.895071+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T20:10:03.895071+0000","last_peered":"2023-10-16T20:10:03.895071+0000","last_clean":"2023-10-16T20:10:03.895071+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:10:03.895071+0000","last_undegraded":"2023-10-16T20:10:03.895071+0000","last_fullsized":"2023-10-16T20:10:03.895071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596571+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T20:10:33.596571+0000","last_peered":"2023-10-16T20:10:33.596571+0000","last_clean":"2023-10-16T20:10:33.596571+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:33.596571+0000","last_undegraded":"2023-10-16T20:10:33.596571+0000","last_fullsized":"2023-10-16T20:10:33.596571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'174","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.509000+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T20:10:13.509000+0000","last_peered":"2023-10-16T20:10:13.509000+0000","last_clean":"2023-10-16T20:10:13.509000+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:13.509000+0000","last_undegraded":"2023-10-16T20:10:13.509000+0000","last_fullsized":"2023-10-16T20:10:13.509000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.493529+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T20:10:33.493529+0000","last_peered":"2023-10-16T20:10:33.493529+0000","last_clean":"2023-10-16T20:10:33.493529+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:10:33.493529+0000","last_undegraded":"2023-10-16T20:10:33.493529+0000","last_fullsized":"2023-10-16T20:10:33.493529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'427","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:15.339991+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T20:10:15.339991+0000","last_peered":"2023-10-16T20:10:15.339991+0000","last_clean":"2023-10-16T20:10:15.339991+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:15.339991+0000","last_undegraded":"2023-10-16T20:10:15.339991+0000","last_fullsized":"2023-10-16T20:10:15.339991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504071+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T20:10:33.504071+0000","last_peered":"2023-10-16T20:10:33.504071+0000","last_clean":"2023-10-16T20:10:33.504071+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:10:33.504071+0000","last_undegraded":"2023-10-16T20:10:33.504071+0000","last_fullsized":"2023-10-16T20:10:33.504071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'12","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.310375+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T20:10:11.310375+0000","last_peered":"2023-10-16T20:10:11.310375+0000","last_clean":"2023-10-16T20:10:11.310375+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:10:11.310375+0000","last_undegraded":"2023-10-16T20:10:11.310375+0000","last_fullsized":"2023-10-16T20:10:11.310375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.606147+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T20:10:33.606147+0000","last_peered":"2023-10-16T20:10:33.606147+0000","last_clean":"2023-10-16T20:10:33.606147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:10:33.606147+0000","last_undegraded":"2023-10-16T20:10:33.606147+0000","last_fullsized":"2023-10-16T20:10:33.606147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590732+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T20:10:33.590732+0000","last_peered":"2023-10-16T20:10:33.590732+0000","last_clean":"2023-10-16T20:10:33.590732+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:10:33.590732+0000","last_undegraded":"2023-10-16T20:10:33.590732+0000","last_fullsized":"2023-10-16T20:10:33.590732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'10","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.665125+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T20:10:13.665125+0000","last_peered":"2023-10-16T20:10:13.665125+0000","last_clean":"2023-10-16T20:10:13.665125+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:10:13.665125+0000","last_undegraded":"2023-10-16T20:10:13.665125+0000","last_fullsized":"2023-10-16T20:10:13.665125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580795+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T20:10:33.580795+0000","last_peered":"2023-10-16T20:10:33.580795+0000","last_clean":"2023-10-16T20:10:33.580795+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:10:33.580795+0000","last_undegraded":"2023-10-16T20:10:33.580795+0000","last_fullsized":"2023-10-16T20:10:33.580795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'149","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.159611+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T20:10:06.159611+0000","last_peered":"2023-10-16T20:10:06.159611+0000","last_clean":"2023-10-16T20:10:06.159611+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:10:06.159611+0000","last_undegraded":"2023-10-16T20:10:06.159611+0000","last_fullsized":"2023-10-16T20:10:06.159611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.582049+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T20:10:33.582049+0000","last_peered":"2023-10-16T20:10:33.582049+0000","last_clean":"2023-10-16T20:10:33.582049+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:10:33.582049+0000","last_undegraded":"2023-10-16T20:10:33.582049+0000","last_fullsized":"2023-10-16T20:10:33.582049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:42.552748+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T20:09:42.552748+0000","last_peered":"2023-10-16T20:09:42.552748+0000","last_clean":"2023-10-16T20:09:42.552748+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:09:42.552748+0000","last_undegraded":"2023-10-16T20:09:42.552748+0000","last_fullsized":"2023-10-16T20:09:42.552748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.407183+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T20:10:33.407183+0000","last_peered":"2023-10-16T20:10:33.407183+0000","last_clean":"2023-10-16T20:10:33.407183+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:10:33.407183+0000","last_undegraded":"2023-10-16T20:10:33.407183+0000","last_fullsized":"2023-10-16T20:10:33.407183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'70","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.298762+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T20:10:06.298762+0000","last_peered":"2023-10-16T20:10:06.298762+0000","last_clean":"2023-10-16T20:10:06.298762+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:06.298762+0000","last_undegraded":"2023-10-16T20:10:06.298762+0000","last_fullsized":"2023-10-16T20:10:06.298762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":7912,"ondisk_log_size":7912,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509803,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2270000000000001,"15min":1.1899999999999999},"min":{"1min":0.755,"5min":0.71299999999999997,"15min":0.55300000000000005},"max":{"1min":1.738,"5min":2.0569999999999999,"15min":2.085},"last":1.55},{"interface":"front","average":{"1min":1.167,"5min":1.242,"15min":1.3},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.905,"5min":1.9510000000000001,"15min":2.1520000000000001},"last":1.206}]},{"osd":1,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.21,"15min":1.2350000000000001},"min":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.72,"5min":1.996,"15min":2.3050000000000002},"last":1.335},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2549999999999999,"15min":1.325},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8320000000000001,"5min":2.177,"15min":2.27},"last":1.3799999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2889999999999999,"15min":1.3280000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.726,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.401,"15min":1.4239999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.9750000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.97199999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.365,"15min":1.413},"min":{"1min":0.746,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8460000000000001,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.365},{"interface":"front","average":{"1min":1.466,"5min":1.4870000000000001,"15min":1.502},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.0379999999999998,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.4450000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.325,"15min":1.304},"min":{"1min":0.72499999999999998,"5min":0.626,"15min":0.624},"max":{"1min":1.863,"5min":2.254,"15min":2.375},"last":1.097},{"interface":"front","average":{"1min":1.421,"5min":1.3899999999999999,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.849,"5min":2.298,"15min":2.5459999999999998},"last":1.0449999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4570000000000001,"15min":1.4510000000000001},"min":{"1min":0.92400000000000004,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.845,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.163},{"interface":"front","average":{"1min":1.583,"5min":1.5149999999999999,"15min":1.5089999999999999},"min":{"1min":0.91400000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.9770000000000001,"5min":2.3109999999999999,"15min":2.4750000000000001},"last":1.272}]},{"osd":6,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.585,"15min":1.595},"min":{"1min":0.83699999999999997,"5min":0.82599999999999996,"15min":0.80500000000000005},"max":{"1min":2.081,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.496},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5700000000000001,"15min":1.5629999999999999},"min":{"1min":0.89500000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1960000000000002,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.3049999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509803,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1759999999999999,"15min":1.194},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.8069999999999999,"5min":1.931,"15min":2.4380000000000002},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.359,"5min":1.3140000000000001,"15min":1.278},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.4630000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2290000000000001,"15min":1.2529999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.339,"5min":1.3819999999999999,"15min":1.3560000000000001},"min":{"1min":0.89600000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2069999999999999,"5min":2.2349999999999999,"15min":2.6680000000000001},"last":1.0409999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3939999999999999,"15min":1.419},"min":{"1min":0.98399999999999999,"5min":0.92100000000000004,"15min":0.82299999999999995},"max":{"1min":2.3180000000000001,"5min":2.367,"15min":2.367},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4079999999999999,"15min":1.4099999999999999},"min":{"1min":1.123,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.999}]},{"osd":3,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.514,"15min":1.486},"min":{"1min":1,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.071},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4950000000000001,"15min":1.4530000000000001},"min":{"1min":1.175,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.1240000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.365,"15min":1.3620000000000001},"min":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.77000000000000002},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.427},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.462,"15min":1.421},"min":{"1min":0.93999999999999995,"5min":0.81699999999999995,"15min":0.68999999999999995},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.429,"15min":1.385},"min":{"1min":1,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.643,"5min":1.5960000000000001,"15min":1.5529999999999999},"min":{"1min":1.2450000000000001,"5min":0.95399999999999996,"15min":0.68300000000000005},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.175}]},{"osd":7,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.5980000000000001,"15min":1.5820000000000001},"min":{"1min":1.137,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":3.145,"5min":3.145,"15min":3.145},"last":1.377},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.633,"15min":1.5760000000000001},"min":{"1min":1.224,"5min":1.044,"15min":0.96199999999999997},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.55}]}]},{"osd":5,"up_from":15,"seq":64424509804,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":1.117},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82599999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8700000000000001,"5min":1.954,"15min":2.3839999999999999},"last":1.2150000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.7250000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.087},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":0.97799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0169999999999999,"5min":2.677,"15min":2.677},"last":1.3779999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.397,"15min":1.347},"min":{"1min":1.026,"5min":0.83599999999999997,"15min":0.69699999999999995},"max":{"1min":1.9690000000000001,"5min":2.177,"15min":2.448},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.4470000000000001,"15min":1.4510000000000001},"min":{"1min":1.1200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.9039999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.167}]},{"osd":3,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4570000000000001,"15min":1.4610000000000001},"min":{"1min":1.073,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.8140000000000001,"5min":2.3370000000000002,"15min":2.3650000000000002},"last":1.304},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5449999999999999,"15min":1.526},"min":{"1min":1.3049999999999999,"5min":1.048,"15min":0.77000000000000002},"max":{"1min":1.899,"5min":2.71,"15min":2.71},"last":1.423}]},{"osd":4,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.347,"15min":1.3460000000000001},"min":{"1min":0.88400000000000001,"5min":0.628,"15min":0.628},"max":{"1min":2.149,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.026},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.95799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1080000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.405}]},{"osd":6,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5149999999999999,"15min":1.4790000000000001},"min":{"1min":1.0169999999999999,"5min":0.80500000000000005,"15min":0.79000000000000004},"max":{"1min":2.375,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5389999999999999,"15min":1.5149999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.169,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.2709999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.5920000000000001,"15min":1.597},"min":{"1min":1.153,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":1.9350000000000001,"5min":2.6819999999999999,"15min":2.7629999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.673,"15min":1.659},"min":{"1min":1.1839999999999999,"5min":1.097,"15min":0.91900000000000004},"max":{"1min":2.452,"5min":2.5979999999999999,"15min":2.867},"last":1.3240000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509803,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.206,"15min":1.1950000000000001},"min":{"1min":0.80500000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":2.2410000000000001,"5min":2.5800000000000001,"15min":2.7069999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2509999999999999,"15min":1.278},"min":{"1min":0.80200000000000005,"5min":0.67900000000000005,"15min":0.52100000000000002},"max":{"1min":1.7410000000000001,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":1.0649999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.419,"15min":1.3839999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.44500000000000001},"max":{"1min":2.964,"5min":2.964,"15min":2.964},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.6559999999999999,"15min":1.5820000000000001},"min":{"1min":1.0609999999999999,"5min":0.61399999999999999,"15min":0.57299999999999995},"max":{"1min":2.4990000000000001,"5min":3.056,"15min":3.1779999999999999},"last":1.46}]},{"osd":2,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.6850000000000001,"15min":1.679},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.52700000000000002},"max":{"1min":2.645,"5min":2.996,"15min":3.5310000000000001},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.762,"15min":1.7509999999999999},"min":{"1min":1.0700000000000001,"5min":0.79900000000000004,"15min":0.69499999999999995},"max":{"1min":2.407,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":1.5760000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.5489999999999999,"15min":1.575},"min":{"1min":0.90700000000000003,"5min":0.82399999999999995,"15min":0.71399999999999997},"max":{"1min":2.7559999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.6719999999999999,"15min":1.6579999999999999},"min":{"1min":1.073,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":2.3439999999999999,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.9319999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.7370000000000001,"15min":1.748},"min":{"1min":1.0600000000000001,"5min":0.97299999999999998,"15min":0.68999999999999995},"max":{"1min":2.403,"5min":3.52,"15min":3.52},"last":1.268},{"interface":"front","average":{"1min":1.607,"5min":1.6930000000000001,"15min":1.6890000000000001},"min":{"1min":1.159,"5min":1.077,"15min":0.64600000000000002},"max":{"1min":2.1619999999999999,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.6160000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.8280000000000001,"15min":1.8009999999999999},"min":{"1min":1.2649999999999999,"5min":1.153,"15min":0.72199999999999998},"max":{"1min":2.46,"5min":2.887,"15min":3.1000000000000001},"last":1.675},{"interface":"front","average":{"1min":1.766,"5min":1.831,"15min":1.8680000000000001},"min":{"1min":0.98999999999999999,"5min":0.85799999999999998,"15min":0.73099999999999998},"max":{"1min":2.4060000000000001,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.7390000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":1.24,"5min":1.02,"15min":0.75},"max":{"1min":2.6440000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.921,"5min":1.974,"15min":1.944},"min":{"1min":1.3580000000000001,"5min":1.278,"15min":0.66800000000000004},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":3.2330000000000001},"last":1.875}]}]},{"osd":2,"up_from":15,"seq":64424509804,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.071,"15min":1.0740000000000001},"min":{"1min":0.60799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.7130000000000001,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4239999999999999,"15min":1.3799999999999999},"min":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.702},"last":0.85599999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.5149999999999999,"15min":1.48},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2120000000000002,"5min":2.4889999999999999,"15min":2.738},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.585,"15min":1.5589999999999999},"min":{"1min":1.0209999999999999,"5min":0.81200000000000006,"15min":0.71199999999999997},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.2350000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.625,"15min":1.5740000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.61799999999999999},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.046},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7090000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":2.29,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.4690000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.702,"15min":1.665},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2370000000000001,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.669,"15min":1.6439999999999999},"min":{"1min":1.04,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.363,"5min":2.6669999999999998,"15min":3.54},"last":1.3580000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.706,"15min":1.639},"min":{"1min":1.095,"5min":1.095,"15min":0.71199999999999997},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.8029999999999999,"15min":1.7869999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4020000000000001,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.181}]},{"osd":6,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.7649999999999999,"5min":1.8109999999999999,"15min":1.806},"min":{"1min":1.167,"5min":1.167,"15min":1.1020000000000001},"max":{"1min":2.5209999999999999,"5min":3.1720000000000002,"15min":3.6259999999999999},"last":1.613},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.8260000000000001,"15min":1.78},"min":{"1min":1.147,"5min":1.147,"15min":0.877},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.296}]},{"osd":7,"last update":"Mon Oct 16 20:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.873,"15min":1.875},"min":{"1min":1.218,"5min":1.163,"15min":1.0109999999999999},"max":{"1min":2.6829999999999998,"5min":3.012,"15min":3.7839999999999998},"last":1.518},{"interface":"front","average":{"1min":1.839,"5min":1.917,"15min":1.8680000000000001},"min":{"1min":1.4319999999999999,"5min":1.359,"15min":0.89200000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.5489999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509804,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.125,"15min":1.1339999999999999},"min":{"1min":0.746,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":2.6509999999999998,"15min":3.1960000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4139999999999999,"15min":1.371},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.66500000000000004},"max":{"1min":2.7789999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.458}]},{"osd":2,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.444,"15min":1.52},"min":{"1min":0.80100000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0590000000000002,"5min":2.8330000000000002,"15min":2.8359999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.5589999999999999,"15min":1.573},"min":{"1min":1.0069999999999999,"5min":0.82499999999999996,"15min":0.621},"max":{"1min":2.8769999999999998,"5min":3.1320000000000001,"15min":3.3450000000000002},"last":1.71}]},{"osd":3,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4770000000000001,"15min":1.587},"min":{"1min":0.876,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1219999999999999,"5min":2.7839999999999998,"15min":4.6660000000000004},"last":1.798},{"interface":"front","average":{"1min":1.615,"5min":1.7110000000000001,"15min":1.802},"min":{"1min":1.081,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":2.4319999999999999,"5min":2.9359999999999999,"15min":3.2829999999999999},"last":1.5349999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.621,"15min":1.6830000000000001},"min":{"1min":1.1619999999999999,"5min":1.0049999999999999,"15min":0.98999999999999999},"max":{"1min":2.2109999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.675,"15min":1.7150000000000001},"min":{"1min":1.1160000000000001,"5min":0.92600000000000005,"15min":0.79700000000000004},"max":{"1min":2.2290000000000001,"5min":2.544,"15min":3.1890000000000001},"last":1.288}]},{"osd":5,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.75,"15min":1.7370000000000001},"min":{"1min":1.1839999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.718,"15min":1.7709999999999999},"min":{"1min":1.163,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.4140000000000001,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.631}]},{"osd":6,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.792,"5min":1.8089999999999999,"15min":1.8620000000000001},"min":{"1min":1.147,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.4900000000000002,"5min":2.8290000000000002,"15min":3.399},"last":1.429},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.853,"15min":1.8460000000000001},"min":{"1min":1.375,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.46},"last":2.532}]},{"osd":7,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.9530000000000001,"15min":1.96},"min":{"1min":1.2270000000000001,"5min":1.1899999999999999,"15min":1.1000000000000001},"max":{"1min":3.21,"5min":3.21,"15min":3.6160000000000001},"last":2.6160000000000001},{"interface":"front","average":{"1min":1.762,"5min":1.8169999999999999,"15min":1.909},"min":{"1min":1.3540000000000001,"5min":1.121,"15min":1.121},"max":{"1min":2.1850000000000001,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.9119999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542508,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.82899999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6419999999999999,"5min":1.804,"15min":2.5649999999999999},"last":1.972},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2030000000000001,"15min":1.2829999999999999},"min":{"1min":0.76800000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.77,"5min":1.968,"15min":3.3769999999999998},"last":9.0700000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.319,"15min":1.3029999999999999},"min":{"1min":0.94599999999999995,"5min":0.77200000000000002,"15min":0.747},"max":{"1min":1.9370000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":9.1120000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.254,"15min":1.298},"min":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.7709999999999999,"5min":2.1179999999999999,"15min":3.3410000000000002},"last":17.715}]},{"osd":2,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.397,"15min":1.3999999999999999},"min":{"1min":1.02,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7989999999999999,"5min":1.962,"15min":2.7229999999999999},"last":3.1890000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3700000000000001,"15min":1.3720000000000001},"min":{"1min":1.0649999999999999,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.7010000000000001,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.873}]},{"osd":3,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4430000000000001,"15min":1.4590000000000001},"min":{"1min":1.02,"5min":0.90400000000000003,"15min":0.81200000000000006},"max":{"1min":2.177,"5min":2.177,"15min":2.2629999999999999},"last":8.2469999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.5029999999999999,"15min":1.5189999999999999},"min":{"1min":1.0820000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.9330000000000001,"5min":2.2869999999999999,"15min":2.6040000000000001},"last":8.2769999999999992}]},{"osd":5,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.351,"15min":1.323},"min":{"1min":0.96599999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9670000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":2.0249999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.4530000000000001,"15min":1.4410000000000001},"min":{"1min":1.056,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":2.0649999999999999,"5min":2.2690000000000001,"15min":3.0499999999999998},"last":8.1869999999999994}]},{"osd":6,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.472,"15min":1.4319999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.869,"5min":2.3879999999999999,"15min":2.9300000000000002},"last":3.0880000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5329999999999999,"15min":1.52},"min":{"1min":1.038,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":1.835,"5min":2.512,"15min":2.601},"last":1.9159999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.583,"15min":1.5549999999999999},"min":{"1min":1.2290000000000001,"5min":0.92600000000000005,"15min":0.86299999999999999},"max":{"1min":2.484,"5min":2.5449999999999999,"15min":3.1829999999999998},"last":8.7769999999999992},{"interface":"front","average":{"1min":1.752,"5min":1.643,"15min":1.613},"min":{"1min":1.3779999999999999,"5min":1.0449999999999999,"15min":0.999},"max":{"1min":2.4199999999999999,"5min":2.6080000000000001,"15min":3.23},"last":8.4290000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2,"15min":1.1850000000000001},"min":{"1min":0.78500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":2.2959999999999998,"5min":2.944,"15min":2.944},"last":1.417},{"interface":"front","average":{"1min":1.254,"5min":1.2210000000000001,"15min":1.3120000000000001},"min":{"1min":0.88800000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.077}]},{"osd":2,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.431,"15min":1.421},"min":{"1min":0.69299999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.0289999999999999,"5min":2.835,"15min":3.585},"last":1.661},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.5549999999999999,"15min":1.583},"min":{"1min":0.98099999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.4180000000000001,"5min":2.75,"15min":2.8719999999999999},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":1.76,"15min":1.728},"min":{"1min":0.98299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":2.5379999999999998,"5min":2.964,"15min":3.3740000000000001},"last":1.28},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.573,"15min":1.5840000000000001},"min":{"1min":0.76600000000000001,"5min":0.66000000000000003,"15min":0.51200000000000001},"max":{"1min":2.3530000000000002,"5min":2.8370000000000002,"15min":3.234},"last":1.351}]},{"osd":4,"last update":"Mon Oct 16 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.593,"15min":1.573},"min":{"1min":1.1160000000000001,"5min":0.81000000000000005,"15min":0.71499999999999997},"max":{"1min":2.2450000000000001,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.462},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":1.2050000000000001,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":2.371,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.179}]},{"osd":5,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.6299999999999999,"15min":1.6519999999999999},"min":{"1min":1.0720000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.02,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.796,"15min":1.75},"min":{"1min":1.3180000000000001,"5min":1.022,"15min":0.77400000000000002},"max":{"1min":2.4340000000000002,"5min":3.2170000000000001,"15min":3.819},"last":1.714}]},{"osd":6,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8260000000000001},"min":{"1min":1.1160000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.3130000000000002,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.859,"15min":1.8460000000000001},"min":{"1min":1.3,"5min":0.92000000000000004,"15min":0.746},"max":{"1min":2.6499999999999999,"5min":2.698,"15min":3.3210000000000002},"last":1.534}]},{"osd":7,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.804,"15min":1.825},"min":{"1min":1.113,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.7829999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.764},{"interface":"front","average":{"1min":1.923,"5min":2,"15min":1.964},"min":{"1min":1.401,"5min":1.1599999999999999,"15min":0.96299999999999997},"max":{"1min":2.536,"5min":3.3239999999999998,"15min":3.923},"last":1.802}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:41.345 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T20:10:41.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.606+0000 7f451bfff640 1 Processor -- start 2023-10-16T20:10:41.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.606+0000 7f451bfff640 1 -- start start 2023-10-16T20:10:41.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.608+0000 7f451bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cad90 0x7f451c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.608+0000 7f451bfff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0cef90 con 0x7f451c153180 2023-10-16T20:10:41.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.608+0000 7f451bfff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c159bb0 con 0x7f451c0c5c20 2023-10-16T20:10:41.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.608+0000 7f451bfff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c153560 con 0x7f451c0cad90 2023-10-16T20:10:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.677+0000 7f451affd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f451c153180 0x7f451c0ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50806/0 (socket says 172.21.15.57:50806) 2023-10-16T20:10:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.677+0000 7f451affd640 1 -- 172.21.15.57:0/159517313 learned_addr learned my addr 172.21.15.57:0/159517313 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.681+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881194182 0 0) 0x7f451c0cef90 con 0x7f451c153180 2023-10-16T20:10:41.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.682+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4508003520 con 0x7f451c153180 2023-10-16T20:10:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680172447 0 0) 0x7f4508003520 con 0x7f451c153180 2023-10-16T20:10:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cad90 msgr2=0x7f451c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cad90 0x7f451c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 >> v1:172.21.15.110:6789/0 conn(0x7f451c0c5c20 legacy=0x7f451c0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0cecd0 con 0x7f451c153180 2023-10-16T20:10:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f450c001670 con 0x7f451c153180 2023-10-16T20:10:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 >> v1:172.21.15.57:6789/0 conn(0x7f451c153180 legacy=0x7f451c0ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45080039a0 0x7f4508003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cad90 0x7f45080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4508004e20 0x7f450800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c153560 con 0x7f4508004e20 2023-10-16T20:10:41.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080054d0 con 0x7f45080039a0 2023-10-16T20:10:41.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.697+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508005690 con 0x7f451c0cad90 2023-10-16T20:10:41.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.704+0000 7f451b7fe640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4508004e20 0x7f450800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:41.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.712+0000 7f451b7fe640 1 -- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cad90 msgr2=0x7f45080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:41.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.712+0000 7f451b7fe640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cad90 0x7f45080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.712+0000 7f451b7fe640 1 -- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45080039a0 msgr2=0x7f4508003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:41.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.712+0000 7f451b7fe640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45080039a0 0x7f4508003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.712+0000 7f451b7fe640 1 -- 172.21.15.57:0/159517313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508003520 con 0x7f4508004e20 2023-10-16T20:10:41.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.737+0000 7f451b7fe640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4508004e20 0x7f450800b980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4514009e40 tx=0x7f45080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a244cc6a1e391c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:41.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.767+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451402cd90 con 0x7f4508004e20 2023-10-16T20:10:41.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.767+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514034440 con 0x7f4508004e20 2023-10-16T20:10:41.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.767+0000 7f451a7fc640 1 -- 172.21.15.57:0/159517313 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140347f0 con 0x7f4508004e20 2023-10-16T20:10:41.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.768+0000 7f451bfff640 1 -- 172.21.15.57:0/159517313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4508004e20 msgr2=0x7f450800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.768+0000 7f451bfff640 1 --2- 172.21.15.57:0/159517313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4508004e20 0x7f450800b980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4514009e40 tx=0x7f45080057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.768+0000 7f451b7fe640 1 -- 172.21.15.57:0/159517313 reap_dead start 2023-10-16T20:10:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.768+0000 7f451bfff640 1 -- 172.21.15.57:0/159517313 shutdown_connections 2023-10-16T20:10:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.768+0000 7f451bfff640 1 -- 172.21.15.57:0/159517313 >> 172.21.15.57:0/159517313 conn(0x7f451c06c760 msgr2=0x7f451c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.769+0000 7f451bfff640 1 -- 172.21.15.57:0/159517313 shutdown_connections 2023-10-16T20:10:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.769+0000 7f451bfff640 1 -- 172.21.15.57:0/159517313 wait complete. 2023-10-16T20:10:41.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.773+0000 7f451bfff640 1 Processor -- start 2023-10-16T20:10:41.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.773+0000 7f451bfff640 1 -- start start 2023-10-16T20:10:41.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.774+0000 7f451bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4508004e20 0x7f451c1ee830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.775+0000 7f451bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c1eddd0 0x7f451c1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.775+0000 7f451bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 0x7f451c1e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.775+0000 7f451bfff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c14a7b0 con 0x7f451c153770 2023-10-16T20:10:41.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.775+0000 7f451bfff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1f1750 con 0x7f451c1eddd0 2023-10-16T20:10:41.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.775+0000 7f451bfff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1eed70 con 0x7f4508004e20 2023-10-16T20:10:41.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.776+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 0x7f451c1e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:41.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.776+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 0x7f451c1e55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54206/0 (socket says 172.21.15.57:54206) 2023-10-16T20:10:41.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.776+0000 7f451b7fe640 1 -- 172.21.15.57:0/2520802894 learned_addr learned my addr 172.21.15.57:0/2520802894 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:41.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.776+0000 7f4513fff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c1eddd0 0x7f451c1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:41.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.776+0000 7f451affd640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4508004e20 0x7f451c1ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:41.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.780+0000 7f451b7fe640 1 -- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4508004e20 msgr2=0x7f451c1ee830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:41.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.780+0000 7f451b7fe640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4508004e20 0x7f451c1ee830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.780+0000 7f451b7fe640 1 -- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c1eddd0 msgr2=0x7f451c1f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:41.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.780+0000 7f451b7fe640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c1eddd0 0x7f451c1f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:41.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.780+0000 7f451b7fe640 1 -- 172.21.15.57:0/2520802894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c1544e0 con 0x7f451c153770 2023-10-16T20:10:41.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.783+0000 7f451b7fe640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 0x7f451c1e55d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4514037040 tx=0x7f4514004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:41.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.787+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451403e410 con 0x7f451c153770 2023-10-16T20:10:41.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.788+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451403e590 con 0x7f451c153770 2023-10-16T20:10:41.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.788+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451403e940 con 0x7f451c153770 2023-10-16T20:10:41.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.788+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c1547c0 con 0x7f451c153770 2023-10-16T20:10:41.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.788+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c154d80 con 0x7f451c153770 2023-10-16T20:10:41.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.789+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c1f1900 con 0x7f451c153770 2023-10-16T20:10:41.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.817+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f451403b050 con 0x7f451c153770 2023-10-16T20:10:41.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.818+0000 7f45137fe640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f44fc06aea0 0x7f44fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:41.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.819+0000 7f451affd640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f44fc06aea0 0x7f44fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:41.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:41.820+0000 7f451affd640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f44fc06aea0 0x7f44fc06d360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f450c004b60 tx=0x7f450c001a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.104+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f451407a040 con 0x7f451c153770 2023-10-16T20:10:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.106+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4514076380 con 0x7f451c153770 2023-10-16T20:10:42.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.330+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f451c159280 con 0x7f44fc06aea0 2023-10-16T20:10:42.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.357+0000 7f45137fe640 1 -- 172.21.15.57:0/2520802894 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287620 (secure 0 0 0) 0x7f450c00f9d0 con 0x7f44fc06aea0 2023-10-16T20:10:42.363 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:42.364 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:10:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f44fc06aea0 msgr2=0x7f44fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f44fc06aea0 0x7f44fc06d360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f450c004b60 tx=0x7f450c001a90 comp rx=0 tx=0).stop 2023-10-16T20:10:42.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 msgr2=0x7f451c1e55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:42.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 0x7f451c1e55d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4514037040 tx=0x7f4514004b50 comp rx=0 tx=0).stop 2023-10-16T20:10:42.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 shutdown_connections 2023-10-16T20:10:42.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f44fc06aea0 0x7f44fc06d360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f451c153770 0x7f451c1e55d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c1eddd0 0x7f451c1f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 --2- 172.21.15.57:0/2520802894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4508004e20 0x7f451c1ee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 >> 172.21.15.57:0/2520802894 conn(0x7f451c06c760 msgr2=0x7f451c0ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:42.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 shutdown_connections 2023-10-16T20:10:42.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.364+0000 7f451bfff640 1 -- 172.21.15.57:0/2520802894 wait complete. 2023-10-16T20:10:42.388 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":924,"stamp":"2023-10-16T20:10:42.230948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12826,"ondisk_log_size":12826,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8915,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005089"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410265+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T20:10:33.410265+0000","last_peered":"2023-10-16T20:10:33.410265+0000","last_clean":"2023-10-16T20:10:33.410265+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:10:33.410265+0000","last_undegraded":"2023-10-16T20:10:33.410265+0000","last_fullsized":"2023-10-16T20:10:33.410265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.484463+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T20:10:33.484463+0000","last_peered":"2023-10-16T20:10:33.484463+0000","last_clean":"2023-10-16T20:10:33.484463+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:10:33.484463+0000","last_undegraded":"2023-10-16T20:10:33.484463+0000","last_fullsized":"2023-10-16T20:10:33.484463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:07.659560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580051+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T20:10:33.580051+0000","last_peered":"2023-10-16T20:10:33.580051+0000","last_clean":"2023-10-16T20:10:33.580051+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:33.580051+0000","last_undegraded":"2023-10-16T20:10:33.580051+0000","last_fullsized":"2023-10-16T20:10:33.580051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587881+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T20:10:33.587881+0000","last_peered":"2023-10-16T20:10:33.587881+0000","last_clean":"2023-10-16T20:10:33.587881+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:10:33.587881+0000","last_undegraded":"2023-10-16T20:10:33.587881+0000","last_fullsized":"2023-10-16T20:10:33.587881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.386106+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T20:10:33.386106+0000","last_peered":"2023-10-16T20:10:33.386106+0000","last_clean":"2023-10-16T20:10:33.386106+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:10:33.386106+0000","last_undegraded":"2023-10-16T20:10:33.386106+0000","last_fullsized":"2023-10-16T20:10:33.386106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.588335+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T20:10:33.588335+0000","last_peered":"2023-10-16T20:10:33.588335+0000","last_clean":"2023-10-16T20:10:33.588335+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:10:33.588335+0000","last_undegraded":"2023-10-16T20:10:33.588335+0000","last_fullsized":"2023-10-16T20:10:33.588335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.477708+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T20:10:33.477708+0000","last_peered":"2023-10-16T20:10:33.477708+0000","last_clean":"2023-10-16T20:10:33.477708+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:33.477708+0000","last_undegraded":"2023-10-16T20:10:33.477708+0000","last_fullsized":"2023-10-16T20:10:33.477708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504184+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T20:10:33.504184+0000","last_peered":"2023-10-16T20:10:33.504184+0000","last_clean":"2023-10-16T20:10:33.504184+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:10:33.504184+0000","last_undegraded":"2023-10-16T20:10:33.504184+0000","last_fullsized":"2023-10-16T20:10:33.504184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413486+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413486+0000","last_peered":"2023-10-16T20:10:33.413486+0000","last_clean":"2023-10-16T20:10:33.413486+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413486+0000","last_undegraded":"2023-10-16T20:10:33.413486+0000","last_fullsized":"2023-10-16T20:10:33.413486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:19:30.948426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.605626+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T20:10:33.605626+0000","last_peered":"2023-10-16T20:10:33.605626+0000","last_clean":"2023-10-16T20:10:33.605626+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:10:33.605626+0000","last_undegraded":"2023-10-16T20:10:33.605626+0000","last_fullsized":"2023-10-16T20:10:33.605626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.559967+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T20:10:33.559967+0000","last_peered":"2023-10-16T20:10:33.559967+0000","last_clean":"2023-10-16T20:10:33.559967+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:10:33.559967+0000","last_undegraded":"2023-10-16T20:10:33.559967+0000","last_fullsized":"2023-10-16T20:10:33.559967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.594073+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T20:10:33.594073+0000","last_peered":"2023-10-16T20:10:33.594073+0000","last_clean":"2023-10-16T20:10:33.594073+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:10:33.594073+0000","last_undegraded":"2023-10-16T20:10:33.594073+0000","last_fullsized":"2023-10-16T20:10:33.594073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:06.015579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504336+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T20:10:33.504336+0000","last_peered":"2023-10-16T20:10:33.504336+0000","last_clean":"2023-10-16T20:10:33.504336+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:10:33.504336+0000","last_undegraded":"2023-10-16T20:10:33.504336+0000","last_fullsized":"2023-10-16T20:10:33.504336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584390+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T20:10:33.584390+0000","last_peered":"2023-10-16T20:10:33.584390+0000","last_clean":"2023-10-16T20:10:33.584390+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:10:33.584390+0000","last_undegraded":"2023-10-16T20:10:33.584390+0000","last_fullsized":"2023-10-16T20:10:33.584390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.398973+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T20:10:33.398973+0000","last_peered":"2023-10-16T20:10:33.398973+0000","last_clean":"2023-10-16T20:10:33.398973+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:10:33.398973+0000","last_undegraded":"2023-10-16T20:10:33.398973+0000","last_fullsized":"2023-10-16T20:10:33.398973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:39.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586214+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T20:10:33.586214+0000","last_peered":"2023-10-16T20:10:33.586214+0000","last_clean":"2023-10-16T20:10:33.586214+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:10:33.586214+0000","last_undegraded":"2023-10-16T20:10:33.586214+0000","last_fullsized":"2023-10-16T20:10:33.586214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.570822+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T20:10:33.570822+0000","last_peered":"2023-10-16T20:10:33.570822+0000","last_clean":"2023-10-16T20:10:33.570822+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:10:33.570822+0000","last_undegraded":"2023-10-16T20:10:33.570822+0000","last_fullsized":"2023-10-16T20:10:33.570822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.627120+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T20:10:33.627120+0000","last_peered":"2023-10-16T20:10:33.627120+0000","last_clean":"2023-10-16T20:10:33.627120+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:33.627120+0000","last_undegraded":"2023-10-16T20:10:33.627120+0000","last_fullsized":"2023-10-16T20:10:33.627120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:08:44.585208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.416579+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T20:10:33.416579+0000","last_peered":"2023-10-16T20:10:33.416579+0000","last_clean":"2023-10-16T20:10:33.416579+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:10:33.416579+0000","last_undegraded":"2023-10-16T20:10:33.416579+0000","last_fullsized":"2023-10-16T20:10:33.416579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.589018+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T20:10:33.589018+0000","last_peered":"2023-10-16T20:10:33.589018+0000","last_clean":"2023-10-16T20:10:33.589018+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:10:33.589018+0000","last_undegraded":"2023-10-16T20:10:33.589018+0000","last_fullsized":"2023-10-16T20:10:33.589018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580533+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T20:10:33.580533+0000","last_peered":"2023-10-16T20:10:33.580533+0000","last_clean":"2023-10-16T20:10:33.580533+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:10:33.580533+0000","last_undegraded":"2023-10-16T20:10:33.580533+0000","last_fullsized":"2023-10-16T20:10:33.580533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:27.830970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587275+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T20:10:33.587275+0000","last_peered":"2023-10-16T20:10:33.587275+0000","last_clean":"2023-10-16T20:10:33.587275+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:10:33.587275+0000","last_undegraded":"2023-10-16T20:10:33.587275+0000","last_fullsized":"2023-10-16T20:10:33.587275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.421682+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T20:10:33.421682+0000","last_peered":"2023-10-16T20:10:33.421682+0000","last_clean":"2023-10-16T20:10:33.421682+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:33.421682+0000","last_undegraded":"2023-10-16T20:10:33.421682+0000","last_fullsized":"2023-10-16T20:10:33.421682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587450+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T20:10:33.587450+0000","last_peered":"2023-10-16T20:10:33.587450+0000","last_clean":"2023-10-16T20:10:33.587450+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:10:33.587450+0000","last_undegraded":"2023-10-16T20:10:33.587450+0000","last_fullsized":"2023-10-16T20:10:33.587450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.408954+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T20:10:33.408954+0000","last_peered":"2023-10-16T20:10:33.408954+0000","last_clean":"2023-10-16T20:10:33.408954+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:10:33.408954+0000","last_undegraded":"2023-10-16T20:10:33.408954+0000","last_fullsized":"2023-10-16T20:10:33.408954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590410+0000","last_change":"2023-10-16T19:41:25.495312+0000","last_active":"2023-10-16T20:10:33.590410+0000","last_peered":"2023-10-16T20:10:33.590410+0000","last_clean":"2023-10-16T20:10:33.590410+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:10:33.590410+0000","last_undegraded":"2023-10-16T20:10:33.590410+0000","last_fullsized":"2023-10-16T20:10:33.590410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.445781+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T20:10:33.445781+0000","last_peered":"2023-10-16T20:10:33.445781+0000","last_clean":"2023-10-16T20:10:33.445781+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:10:33.445781+0000","last_undegraded":"2023-10-16T20:10:33.445781+0000","last_fullsized":"2023-10-16T20:10:33.445781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:22.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451146+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T20:10:33.451146+0000","last_peered":"2023-10-16T20:10:33.451146+0000","last_clean":"2023-10-16T20:10:33.451146+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:10:33.451146+0000","last_undegraded":"2023-10-16T20:10:33.451146+0000","last_fullsized":"2023-10-16T20:10:33.451146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:24.755768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583441+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T20:10:33.583441+0000","last_peered":"2023-10-16T20:10:33.583441+0000","last_clean":"2023-10-16T20:10:33.583441+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:10:33.583441+0000","last_undegraded":"2023-10-16T20:10:33.583441+0000","last_fullsized":"2023-10-16T20:10:33.583441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:28.573499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.585861+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T20:10:33.585861+0000","last_peered":"2023-10-16T20:10:33.585861+0000","last_clean":"2023-10-16T20:10:33.585861+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:10:33.585861+0000","last_undegraded":"2023-10-16T20:10:33.585861+0000","last_fullsized":"2023-10-16T20:10:33.585861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.626070+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T20:10:33.626070+0000","last_peered":"2023-10-16T20:10:33.626070+0000","last_clean":"2023-10-16T20:10:33.626070+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:33.626070+0000","last_undegraded":"2023-10-16T20:10:33.626070+0000","last_fullsized":"2023-10-16T20:10:33.626070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:02:44.147843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590788+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T20:10:33.590788+0000","last_peered":"2023-10-16T20:10:33.590788+0000","last_clean":"2023-10-16T20:10:33.590788+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:10:33.590788+0000","last_undegraded":"2023-10-16T20:10:33.590788+0000","last_fullsized":"2023-10-16T20:10:33.590788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.595432+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T20:10:33.595432+0000","last_peered":"2023-10-16T20:10:33.595432+0000","last_clean":"2023-10-16T20:10:33.595432+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:10:33.595432+0000","last_undegraded":"2023-10-16T20:10:33.595432+0000","last_fullsized":"2023-10-16T20:10:33.595432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:06.757031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2224","reported_seq":2252,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.666044+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T20:10:33.666044+0000","last_peered":"2023-10-16T20:10:33.666044+0000","last_clean":"2023-10-16T20:10:33.666044+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:33.666044+0000","last_undegraded":"2023-10-16T20:10:33.666044+0000","last_fullsized":"2023-10-16T20:10:33.666044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584389+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T20:10:33.584389+0000","last_peered":"2023-10-16T20:10:33.584389+0000","last_clean":"2023-10-16T20:10:33.584389+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:10:33.584389+0000","last_undegraded":"2023-10-16T20:10:33.584389+0000","last_fullsized":"2023-10-16T20:10:33.584389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'121","reported_seq":258,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:30.057629+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T20:09:30.057629+0000","last_peered":"2023-10-16T20:09:30.057629+0000","last_clean":"2023-10-16T20:09:30.057629+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:09:30.057629+0000","last_undegraded":"2023-10-16T20:09:30.057629+0000","last_fullsized":"2023-10-16T20:09:30.057629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'203","reported_seq":426,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.633215+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T20:10:13.633215+0000","last_peered":"2023-10-16T20:10:13.633215+0000","last_clean":"2023-10-16T20:10:13.633215+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:13.633215+0000","last_undegraded":"2023-10-16T20:10:13.633215+0000","last_fullsized":"2023-10-16T20:10:13.633215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:41.550175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.502464+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T20:10:33.502464+0000","last_peered":"2023-10-16T20:10:33.502464+0000","last_clean":"2023-10-16T20:10:33.502464+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:10:33.502464+0000","last_undegraded":"2023-10-16T20:10:33.502464+0000","last_fullsized":"2023-10-16T20:10:33.502464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'7","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:56.062806+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T20:09:56.062806+0000","last_peered":"2023-10-16T20:09:56.062806+0000","last_clean":"2023-10-16T20:09:56.062806+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:09:56.062806+0000","last_undegraded":"2023-10-16T20:09:56.062806+0000","last_fullsized":"2023-10-16T20:09:56.062806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.447539+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T20:10:33.447539+0000","last_peered":"2023-10-16T20:10:33.447539+0000","last_clean":"2023-10-16T20:10:33.447539+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:10:33.447539+0000","last_undegraded":"2023-10-16T20:10:33.447539+0000","last_fullsized":"2023-10-16T20:10:33.447539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:06.622410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'169","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.942089+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T20:10:32.942089+0000","last_peered":"2023-10-16T20:10:32.942089+0000","last_clean":"2023-10-16T20:10:32.942089+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:10:32.942089+0000","last_undegraded":"2023-10-16T20:10:32.942089+0000","last_fullsized":"2023-10-16T20:10:32.942089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583115+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T20:10:33.583115+0000","last_peered":"2023-10-16T20:10:33.583115+0000","last_clean":"2023-10-16T20:10:33.583115+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:10:33.583115+0000","last_undegraded":"2023-10-16T20:10:33.583115+0000","last_fullsized":"2023-10-16T20:10:33.583115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'80","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:44.535041+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T20:09:44.535041+0000","last_peered":"2023-10-16T20:09:44.535041+0000","last_clean":"2023-10-16T20:09:44.535041+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:09:44.535041+0000","last_undegraded":"2023-10-16T20:09:44.535041+0000","last_fullsized":"2023-10-16T20:09:44.535041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581935+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T20:10:33.581935+0000","last_peered":"2023-10-16T20:10:33.581935+0000","last_clean":"2023-10-16T20:10:33.581935+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:10:33.581935+0000","last_undegraded":"2023-10-16T20:10:33.581935+0000","last_fullsized":"2023-10-16T20:10:33.581935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'84","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:24.530946+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T20:10:24.530946+0000","last_peered":"2023-10-16T20:10:24.530946+0000","last_clean":"2023-10-16T20:10:24.530946+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:24.530946+0000","last_undegraded":"2023-10-16T20:10:24.530946+0000","last_fullsized":"2023-10-16T20:10:24.530946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.034679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.342447+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T20:10:33.342447+0000","last_peered":"2023-10-16T20:10:33.342447+0000","last_clean":"2023-10-16T20:10:33.342447+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:10:33.342447+0000","last_undegraded":"2023-10-16T20:10:33.342447+0000","last_fullsized":"2023-10-16T20:10:33.342447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:01:31.000528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1226","reported_seq":1255,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.798808+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T20:10:11.798808+0000","last_peered":"2023-10-16T20:10:11.798808+0000","last_clean":"2023-10-16T20:10:11.798808+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:10:11.798808+0000","last_undegraded":"2023-10-16T20:10:11.798808+0000","last_fullsized":"2023-10-16T20:10:11.798808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451956+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T20:10:33.451956+0000","last_peered":"2023-10-16T20:10:33.451956+0000","last_clean":"2023-10-16T20:10:33.451956+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:10:33.451956+0000","last_undegraded":"2023-10-16T20:10:33.451956+0000","last_fullsized":"2023-10-16T20:10:33.451956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'116","reported_seq":247,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.012976+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T20:10:20.012976+0000","last_peered":"2023-10-16T20:10:20.012976+0000","last_clean":"2023-10-16T20:10:20.012976+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:20.012976+0000","last_undegraded":"2023-10-16T20:10:20.012976+0000","last_fullsized":"2023-10-16T20:10:20.012976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579846+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T20:10:33.579846+0000","last_peered":"2023-10-16T20:10:33.579846+0000","last_clean":"2023-10-16T20:10:33.579846+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:10:33.579846+0000","last_undegraded":"2023-10-16T20:10:33.579846+0000","last_fullsized":"2023-10-16T20:10:33.579846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'94","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.112139+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T20:10:20.112139+0000","last_peered":"2023-10-16T20:10:20.112139+0000","last_clean":"2023-10-16T20:10:20.112139+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:10:20.112139+0000","last_undegraded":"2023-10-16T20:10:20.112139+0000","last_fullsized":"2023-10-16T20:10:20.112139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.405427+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T20:10:33.405427+0000","last_peered":"2023-10-16T20:10:33.405427+0000","last_clean":"2023-10-16T20:10:33.405427+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:10:33.405427+0000","last_undegraded":"2023-10-16T20:10:33.405427+0000","last_fullsized":"2023-10-16T20:10:33.405427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'915","reported_seq":944,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.946659+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T20:10:32.946659+0000","last_peered":"2023-10-16T20:10:32.946659+0000","last_clean":"2023-10-16T20:10:32.946659+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:10:32.946659+0000","last_undegraded":"2023-10-16T20:10:32.946659+0000","last_fullsized":"2023-10-16T20:10:32.946659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.522059+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T20:10:33.522059+0000","last_peered":"2023-10-16T20:10:33.522059+0000","last_clean":"2023-10-16T20:10:33.522059+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:10:33.522059+0000","last_undegraded":"2023-10-16T20:10:33.522059+0000","last_fullsized":"2023-10-16T20:10:33.522059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'112","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:51.891715+0000","last_change":"2023-10-16T19:40:56.482468+0000","last_active":"2023-10-16T20:09:51.891715+0000","last_peered":"2023-10-16T20:09:51.891715+0000","last_clean":"2023-10-16T20:09:51.891715+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:09:51.891715+0000","last_undegraded":"2023-10-16T20:09:51.891715+0000","last_fullsized":"2023-10-16T20:09:51.891715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:02.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.411939+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T20:10:33.411939+0000","last_peered":"2023-10-16T20:10:33.411939+0000","last_clean":"2023-10-16T20:10:33.411939+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:33.411939+0000","last_undegraded":"2023-10-16T20:10:33.411939+0000","last_fullsized":"2023-10-16T20:10:33.411939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'191","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:14.234893+0000","last_change":"2023-10-16T19:40:56.462321+0000","last_active":"2023-10-16T20:10:14.234893+0000","last_peered":"2023-10-16T20:10:14.234893+0000","last_clean":"2023-10-16T20:10:14.234893+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:14.234893+0000","last_undegraded":"2023-10-16T20:10:14.234893+0000","last_fullsized":"2023-10-16T20:10:14.234893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:09:02.603337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.360807+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T20:10:33.360807+0000","last_peered":"2023-10-16T20:10:33.360807+0000","last_clean":"2023-10-16T20:10:33.360807+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:10:33.360807+0000","last_undegraded":"2023-10-16T20:10:33.360807+0000","last_fullsized":"2023-10-16T20:10:33.360807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'9","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.666624+0000","last_change":"2023-10-16T19:40:56.485793+0000","last_active":"2023-10-16T20:10:13.666624+0000","last_peered":"2023-10-16T20:10:13.666624+0000","last_clean":"2023-10-16T20:10:13.666624+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:13.666624+0000","last_undegraded":"2023-10-16T20:10:13.666624+0000","last_fullsized":"2023-10-16T20:10:13.666624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:32.321901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410999+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T20:10:33.410999+0000","last_peered":"2023-10-16T20:10:33.410999+0000","last_clean":"2023-10-16T20:10:33.410999+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:10:33.410999+0000","last_undegraded":"2023-10-16T20:10:33.410999+0000","last_fullsized":"2023-10-16T20:10:33.410999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.267853+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T20:10:13.267853+0000","last_peered":"2023-10-16T20:10:13.267853+0000","last_clean":"2023-10-16T20:10:13.267853+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:10:13.267853+0000","last_undegraded":"2023-10-16T20:10:13.267853+0000","last_fullsized":"2023-10-16T20:10:13.267853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:00.283154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.624221+0000","last_change":"2023-10-16T19:41:25.728395+0000","last_active":"2023-10-16T20:10:33.624221+0000","last_peered":"2023-10-16T20:10:33.624221+0000","last_clean":"2023-10-16T20:10:33.624221+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:10:33.624221+0000","last_undegraded":"2023-10-16T20:10:33.624221+0000","last_fullsized":"2023-10-16T20:10:33.624221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:29.023300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'593","reported_seq":623,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.941718+0000","last_change":"2023-10-16T19:40:56.484210+0000","last_active":"2023-10-16T20:10:32.941718+0000","last_peered":"2023-10-16T20:10:32.941718+0000","last_clean":"2023-10-16T20:10:32.941718+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:32.941718+0000","last_undegraded":"2023-10-16T20:10:32.941718+0000","last_fullsized":"2023-10-16T20:10:32.941718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.723581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.439287+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T20:10:33.439287+0000","last_peered":"2023-10-16T20:10:33.439287+0000","last_clean":"2023-10-16T20:10:33.439287+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:10:33.439287+0000","last_undegraded":"2023-10-16T20:10:33.439287+0000","last_fullsized":"2023-10-16T20:10:33.439287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:41.265191+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T20:06:41.265191+0000","last_peered":"2023-10-16T20:06:41.265191+0000","last_clean":"2023-10-16T20:06:41.265191+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:06:41.265191+0000","last_undegraded":"2023-10-16T20:06:41.265191+0000","last_fullsized":"2023-10-16T20:06:41.265191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:08:01.239242+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T20:08:01.239242+0000","last_peered":"2023-10-16T20:08:01.239242+0000","last_clean":"2023-10-16T20:08:01.239242+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:08:01.239242+0000","last_undegraded":"2023-10-16T20:08:01.239242+0000","last_fullsized":"2023-10-16T20:08:01.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.501193+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T20:10:33.501193+0000","last_peered":"2023-10-16T20:10:33.501193+0000","last_clean":"2023-10-16T20:10:33.501193+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:10:33.501193+0000","last_undegraded":"2023-10-16T20:10:33.501193+0000","last_fullsized":"2023-10-16T20:10:33.501193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'10","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.421795+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T20:10:13.421795+0000","last_peered":"2023-10-16T20:10:13.421795+0000","last_clean":"2023-10-16T20:10:13.421795+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:10:13.421795+0000","last_undegraded":"2023-10-16T20:10:13.421795+0000","last_fullsized":"2023-10-16T20:10:13.421795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579847+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T20:10:33.579847+0000","last_peered":"2023-10-16T20:10:33.579847+0000","last_clean":"2023-10-16T20:10:33.579847+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:10:33.579847+0000","last_undegraded":"2023-10-16T20:10:33.579847+0000","last_fullsized":"2023-10-16T20:10:33.579847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:17.150243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'180","reported_seq":299,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:29.575973+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T20:10:29.575973+0000","last_peered":"2023-10-16T20:10:29.575973+0000","last_clean":"2023-10-16T20:10:29.575973+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:29.575973+0000","last_undegraded":"2023-10-16T20:10:29.575973+0000","last_fullsized":"2023-10-16T20:10:29.575973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:56.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.375187+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T20:10:33.375187+0000","last_peered":"2023-10-16T20:10:33.375187+0000","last_clean":"2023-10-16T20:10:33.375187+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:10:33.375187+0000","last_undegraded":"2023-10-16T20:10:33.375187+0000","last_fullsized":"2023-10-16T20:10:33.375187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:16.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'439","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.949381+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T20:10:32.949381+0000","last_peered":"2023-10-16T20:10:32.949381+0000","last_clean":"2023-10-16T20:10:32.949381+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:10:32.949381+0000","last_undegraded":"2023-10-16T20:10:32.949381+0000","last_fullsized":"2023-10-16T20:10:32.949381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596484+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T20:10:33.596484+0000","last_peered":"2023-10-16T20:10:33.596484+0000","last_clean":"2023-10-16T20:10:33.596484+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:10:33.596484+0000","last_undegraded":"2023-10-16T20:10:33.596484+0000","last_fullsized":"2023-10-16T20:10:33.596484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:06.580346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.266788+0000","last_change":"2023-10-16T19:40:56.466410+0000","last_active":"2023-10-16T20:10:08.266788+0000","last_peered":"2023-10-16T20:10:08.266788+0000","last_clean":"2023-10-16T20:10:08.266788+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:08.266788+0000","last_undegraded":"2023-10-16T20:10:08.266788+0000","last_fullsized":"2023-10-16T20:10:08.266788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:53.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586134+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T20:10:33.586134+0000","last_peered":"2023-10-16T20:10:33.586134+0000","last_clean":"2023-10-16T20:10:33.586134+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:10:33.586134+0000","last_undegraded":"2023-10-16T20:10:33.586134+0000","last_fullsized":"2023-10-16T20:10:33.586134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'72","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.061284+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T20:10:08.061284+0000","last_peered":"2023-10-16T20:10:08.061284+0000","last_clean":"2023-10-16T20:10:08.061284+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:10:08.061284+0000","last_undegraded":"2023-10-16T20:10:08.061284+0000","last_fullsized":"2023-10-16T20:10:08.061284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.384254+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T20:10:33.384254+0000","last_peered":"2023-10-16T20:10:33.384254+0000","last_clean":"2023-10-16T20:10:33.384254+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:10:33.384254+0000","last_undegraded":"2023-10-16T20:10:33.384254+0000","last_fullsized":"2023-10-16T20:10:33.384254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:01.128500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'179","reported_seq":209,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:26.801226+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T20:10:26.801226+0000","last_peered":"2023-10-16T20:10:26.801226+0000","last_clean":"2023-10-16T20:10:26.801226+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:26.801226+0000","last_undegraded":"2023-10-16T20:10:26.801226+0000","last_fullsized":"2023-10-16T20:10:26.801226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:06.191043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.622595+0000","last_change":"2023-10-16T19:41:25.493927+0000","last_active":"2023-10-16T20:10:33.622595+0000","last_peered":"2023-10-16T20:10:33.622595+0000","last_clean":"2023-10-16T20:10:33.622595+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:10:33.622595+0000","last_undegraded":"2023-10-16T20:10:33.622595+0000","last_fullsized":"2023-10-16T20:10:33.622595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.153861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'15","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.432292+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T20:10:13.432292+0000","last_peered":"2023-10-16T20:10:13.432292+0000","last_clean":"2023-10-16T20:10:13.432292+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:10:13.432292+0000","last_undegraded":"2023-10-16T20:10:13.432292+0000","last_fullsized":"2023-10-16T20:10:13.432292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":76,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580103+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T20:10:33.580103+0000","last_peered":"2023-10-16T20:10:33.580103+0000","last_clean":"2023-10-16T20:10:33.580103+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:10:33.580103+0000","last_undegraded":"2023-10-16T20:10:33.580103+0000","last_fullsized":"2023-10-16T20:10:33.580103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:52.393790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:03.895071+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T20:10:03.895071+0000","last_peered":"2023-10-16T20:10:03.895071+0000","last_clean":"2023-10-16T20:10:03.895071+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:10:03.895071+0000","last_undegraded":"2023-10-16T20:10:03.895071+0000","last_fullsized":"2023-10-16T20:10:03.895071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596571+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T20:10:33.596571+0000","last_peered":"2023-10-16T20:10:33.596571+0000","last_clean":"2023-10-16T20:10:33.596571+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:33.596571+0000","last_undegraded":"2023-10-16T20:10:33.596571+0000","last_fullsized":"2023-10-16T20:10:33.596571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:15:24.621161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'174","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.509000+0000","last_change":"2023-10-16T19:40:56.459847+0000","last_active":"2023-10-16T20:10:13.509000+0000","last_peered":"2023-10-16T20:10:13.509000+0000","last_clean":"2023-10-16T20:10:13.509000+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:13.509000+0000","last_undegraded":"2023-10-16T20:10:13.509000+0000","last_fullsized":"2023-10-16T20:10:13.509000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.859136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.493529+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T20:10:33.493529+0000","last_peered":"2023-10-16T20:10:33.493529+0000","last_clean":"2023-10-16T20:10:33.493529+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:10:33.493529+0000","last_undegraded":"2023-10-16T20:10:33.493529+0000","last_fullsized":"2023-10-16T20:10:33.493529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'427","reported_seq":457,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:15.339991+0000","last_change":"2023-10-16T19:40:56.451519+0000","last_active":"2023-10-16T20:10:15.339991+0000","last_peered":"2023-10-16T20:10:15.339991+0000","last_clean":"2023-10-16T20:10:15.339991+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:15.339991+0000","last_undegraded":"2023-10-16T20:10:15.339991+0000","last_fullsized":"2023-10-16T20:10:15.339991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:32.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504071+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T20:10:33.504071+0000","last_peered":"2023-10-16T20:10:33.504071+0000","last_clean":"2023-10-16T20:10:33.504071+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:10:33.504071+0000","last_undegraded":"2023-10-16T20:10:33.504071+0000","last_fullsized":"2023-10-16T20:10:33.504071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'12","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.310375+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T20:10:11.310375+0000","last_peered":"2023-10-16T20:10:11.310375+0000","last_clean":"2023-10-16T20:10:11.310375+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:10:11.310375+0000","last_undegraded":"2023-10-16T20:10:11.310375+0000","last_fullsized":"2023-10-16T20:10:11.310375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.606147+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T20:10:33.606147+0000","last_peered":"2023-10-16T20:10:33.606147+0000","last_clean":"2023-10-16T20:10:33.606147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:10:33.606147+0000","last_undegraded":"2023-10-16T20:10:33.606147+0000","last_fullsized":"2023-10-16T20:10:33.606147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590732+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T20:10:33.590732+0000","last_peered":"2023-10-16T20:10:33.590732+0000","last_clean":"2023-10-16T20:10:33.590732+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:10:33.590732+0000","last_undegraded":"2023-10-16T20:10:33.590732+0000","last_fullsized":"2023-10-16T20:10:33.590732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'10","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.665125+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T20:10:13.665125+0000","last_peered":"2023-10-16T20:10:13.665125+0000","last_clean":"2023-10-16T20:10:13.665125+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:10:13.665125+0000","last_undegraded":"2023-10-16T20:10:13.665125+0000","last_fullsized":"2023-10-16T20:10:13.665125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580795+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T20:10:33.580795+0000","last_peered":"2023-10-16T20:10:33.580795+0000","last_clean":"2023-10-16T20:10:33.580795+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:10:33.580795+0000","last_undegraded":"2023-10-16T20:10:33.580795+0000","last_fullsized":"2023-10-16T20:10:33.580795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'149","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.159611+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T20:10:06.159611+0000","last_peered":"2023-10-16T20:10:06.159611+0000","last_clean":"2023-10-16T20:10:06.159611+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:10:06.159611+0000","last_undegraded":"2023-10-16T20:10:06.159611+0000","last_fullsized":"2023-10-16T20:10:06.159611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.582049+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T20:10:33.582049+0000","last_peered":"2023-10-16T20:10:33.582049+0000","last_clean":"2023-10-16T20:10:33.582049+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:10:33.582049+0000","last_undegraded":"2023-10-16T20:10:33.582049+0000","last_fullsized":"2023-10-16T20:10:33.582049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:06.815262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:42.552748+0000","last_change":"2023-10-16T19:40:56.463917+0000","last_active":"2023-10-16T20:09:42.552748+0000","last_peered":"2023-10-16T20:09:42.552748+0000","last_clean":"2023-10-16T20:09:42.552748+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:09:42.552748+0000","last_undegraded":"2023-10-16T20:09:42.552748+0000","last_fullsized":"2023-10-16T20:09:42.552748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.407183+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T20:10:33.407183+0000","last_peered":"2023-10-16T20:10:33.407183+0000","last_clean":"2023-10-16T20:10:33.407183+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:10:33.407183+0000","last_undegraded":"2023-10-16T20:10:33.407183+0000","last_fullsized":"2023-10-16T20:10:33.407183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'70","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.298762+0000","last_change":"2023-10-16T19:40:56.466355+0000","last_active":"2023-10-16T20:10:06.298762+0000","last_peered":"2023-10-16T20:10:06.298762+0000","last_clean":"2023-10-16T20:10:06.298762+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:06.298762+0000","last_undegraded":"2023-10-16T20:10:06.298762+0000","last_fullsized":"2023-10-16T20:10:06.298762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:55:24.003914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":7912,"ondisk_log_size":7912,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509804,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2270000000000001,"15min":1.1899999999999999},"min":{"1min":0.755,"5min":0.71299999999999997,"15min":0.55300000000000005},"max":{"1min":1.738,"5min":2.0569999999999999,"15min":2.085},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.242,"15min":1.3},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.905,"5min":1.9510000000000001,"15min":2.1520000000000001},"last":1.2010000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.21,"15min":1.2350000000000001},"min":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.72,"5min":1.996,"15min":2.3050000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2549999999999999,"15min":1.325},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8320000000000001,"5min":2.177,"15min":2.27},"last":1.3100000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2889999999999999,"15min":1.3280000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.726,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.401,"15min":1.4239999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.9750000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.365,"15min":1.413},"min":{"1min":0.746,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8460000000000001,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.4870000000000001,"15min":1.502},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.0379999999999998,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.51}]},{"osd":4,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.325,"15min":1.304},"min":{"1min":0.72499999999999998,"5min":0.626,"15min":0.624},"max":{"1min":1.863,"5min":2.254,"15min":2.375},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.421,"5min":1.3899999999999999,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.849,"5min":2.298,"15min":2.5459999999999998},"last":1.3500000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4570000000000001,"15min":1.4510000000000001},"min":{"1min":0.92400000000000004,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.845,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.131},{"interface":"front","average":{"1min":1.583,"5min":1.5149999999999999,"15min":1.5089999999999999},"min":{"1min":0.91400000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.9770000000000001,"5min":2.3109999999999999,"15min":2.4750000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.585,"15min":1.595},"min":{"1min":0.83699999999999997,"5min":0.82599999999999996,"15min":0.80500000000000005},"max":{"1min":2.081,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5700000000000001,"15min":1.5629999999999999},"min":{"1min":0.89500000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1960000000000002,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.5569999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509804,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1739999999999999,"15min":1.196},"min":{"1min":0.74099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.899,"5min":1.931,"15min":2.4380000000000002},"last":1.05},{"interface":"front","average":{"1min":1.155,"5min":1.294,"15min":1.276},"min":{"1min":0.70899999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6759999999999999,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.1839999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2170000000000001,"15min":1.2509999999999999},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7569999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.494},{"interface":"front","average":{"1min":1.264,"5min":1.373,"15min":1.3480000000000001},"min":{"1min":0.93100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.2349999999999999,"15min":2.6680000000000001},"last":1.581}]},{"osd":2,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.393,"15min":1.413},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.0190000000000001,"5min":2.367,"15min":2.367},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.381,"15min":1.4039999999999999},"min":{"1min":0.88,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.2709999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.478,"15min":1.476},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5800000000000001,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.329},{"interface":"front","average":{"1min":1.319,"5min":1.4650000000000001,"15min":1.4470000000000001},"min":{"1min":1.022,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":1.972,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.022}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.399,"15min":1.3660000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7729999999999999,"5min":3.415,"15min":3.415},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.4490000000000001,"15min":1.417},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8400000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0880000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4259999999999999,"15min":1.387},"min":{"1min":1.0069999999999999,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":1.952,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.6020000000000001,"15min":1.5569999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.68300000000000005},"max":{"1min":1.843,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.714}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.96799999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.7929999999999999,"5min":3.145,"15min":3.145},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.552,"5min":1.6240000000000001,"15min":1.581},"min":{"1min":1.2889999999999999,"5min":1.044,"15min":0.98799999999999999},"max":{"1min":2.1219999999999999,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.645}]}]},{"osd":5,"up_from":15,"seq":64424509805,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":1.677},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82599999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8700000000000001,"5min":1.954,"15min":2.3839999999999999},"last":0.73699999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.7250000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.25},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":0.97799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0169999999999999,"5min":2.677,"15min":2.677},"last":1.833}]},{"osd":2,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.397,"15min":1.347},"min":{"1min":1.026,"5min":0.83599999999999997,"15min":0.69699999999999995},"max":{"1min":1.9690000000000001,"5min":2.177,"15min":2.448},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.403,"5min":1.4470000000000001,"15min":1.4510000000000001},"min":{"1min":1.1200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.9039999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.397}]},{"osd":3,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4570000000000001,"15min":1.4610000000000001},"min":{"1min":1.073,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.8140000000000001,"5min":2.3370000000000002,"15min":2.3650000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5449999999999999,"15min":1.526},"min":{"1min":1.3049999999999999,"5min":1.048,"15min":0.77000000000000002},"max":{"1min":1.899,"5min":2.71,"15min":2.71},"last":1.514}]},{"osd":4,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.347,"15min":1.3460000000000001},"min":{"1min":0.88400000000000001,"5min":0.628,"15min":0.628},"max":{"1min":2.149,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.95799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1080000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.157}]},{"osd":6,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5149999999999999,"15min":1.4790000000000001},"min":{"1min":1.0169999999999999,"5min":0.80500000000000005,"15min":0.79000000000000004},"max":{"1min":2.375,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":1.978},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5389999999999999,"15min":1.5149999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.169,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":2.0219999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.5920000000000001,"15min":1.597},"min":{"1min":1.153,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":1.9350000000000001,"5min":2.6819999999999999,"15min":2.7629999999999999},"last":1.7549999999999999},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.673,"15min":1.659},"min":{"1min":1.1839999999999999,"5min":1.097,"15min":0.91900000000000004},"max":{"1min":2.452,"5min":2.5979999999999999,"15min":2.867},"last":1.6240000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509804,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.206,"15min":1.1950000000000001},"min":{"1min":0.80500000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":2.2410000000000001,"5min":2.5800000000000001,"15min":2.7069999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2509999999999999,"15min":1.278},"min":{"1min":0.80200000000000005,"5min":0.67900000000000005,"15min":0.52100000000000002},"max":{"1min":1.7410000000000001,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":0.58199999999999996}]},{"osd":1,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.419,"15min":1.3839999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.44500000000000001},"max":{"1min":2.964,"5min":2.964,"15min":2.964},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.6559999999999999,"15min":1.5820000000000001},"min":{"1min":1.0609999999999999,"5min":0.61399999999999999,"15min":0.57299999999999995},"max":{"1min":2.4990000000000001,"5min":3.056,"15min":3.1779999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.6850000000000001,"15min":1.679},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.52700000000000002},"max":{"1min":2.645,"5min":2.996,"15min":3.5310000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.762,"15min":1.7509999999999999},"min":{"1min":1.0700000000000001,"5min":0.79900000000000004,"15min":0.69499999999999995},"max":{"1min":2.407,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":0.84899999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.5489999999999999,"15min":1.575},"min":{"1min":0.90700000000000003,"5min":0.82399999999999995,"15min":0.71399999999999997},"max":{"1min":2.7559999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.6719999999999999,"15min":1.6579999999999999},"min":{"1min":1.073,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":2.3439999999999999,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":0.96899999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.7370000000000001,"15min":1.748},"min":{"1min":1.0600000000000001,"5min":0.97299999999999998,"15min":0.68999999999999995},"max":{"1min":2.403,"5min":3.52,"15min":3.52},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.607,"5min":1.6930000000000001,"15min":1.6890000000000001},"min":{"1min":1.159,"5min":1.077,"15min":0.64600000000000002},"max":{"1min":2.1619999999999999,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.0940000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.8280000000000001,"15min":1.8009999999999999},"min":{"1min":1.2649999999999999,"5min":1.153,"15min":0.72199999999999998},"max":{"1min":2.46,"5min":2.887,"15min":3.1000000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.766,"5min":1.831,"15min":1.8680000000000001},"min":{"1min":0.98999999999999999,"5min":0.85799999999999998,"15min":0.73099999999999998},"max":{"1min":2.4060000000000001,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.0760000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:09:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"min":{"1min":1.24,"5min":1.02,"15min":0.75},"max":{"1min":2.6440000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.921,"5min":1.974,"15min":1.944},"min":{"1min":1.3580000000000001,"5min":1.278,"15min":0.66800000000000004},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":3.2330000000000001},"last":1.115}]}]},{"osd":2,"up_from":15,"seq":64424509805,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.048,"15min":1.073},"min":{"1min":0.71599999999999997,"5min":0.437,"15min":0.437},"max":{"1min":1.7729999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.278,"5min":1.383,"15min":1.383},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0630000000000002,"5min":3.1179999999999999,"15min":3.702},"last":1.492}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.429,"15min":1.4630000000000001},"min":{"1min":0.72499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.0019999999999998,"5min":2.4889999999999999,"15min":2.738},"last":0.999},{"interface":"front","average":{"1min":1.47,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.873,"5min":0.81200000000000006,"15min":0.71199999999999997},"max":{"1min":2.4660000000000002,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.27}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.5920000000000001,"15min":1.5660000000000001},"min":{"1min":0.875,"5min":0.71299999999999997,"15min":0.61799999999999999},"max":{"1min":2.504,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.155},{"interface":"front","average":{"1min":1.486,"5min":1.6819999999999999,"15min":1.71},"min":{"1min":1.0700000000000001,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":2.1269999999999998,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.3759999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.645,"15min":1.657},"min":{"1min":1.0409999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9199999999999999,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.7829999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.6539999999999999,"15min":1.649},"min":{"1min":1.155,"5min":1.0369999999999999,"15min":0.98399999999999999},"max":{"1min":2.105,"5min":2.6669999999999998,"15min":3.54},"last":1.736}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6859999999999999,"15min":1.639},"min":{"1min":1.109,"5min":1.095,"15min":0.71199999999999997},"max":{"1min":2.4060000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.744,"15min":1.7749999999999999},"min":{"1min":1.181,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.056,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.5669999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.8049999999999999,"15min":1.8109999999999999},"min":{"1min":1.347,"5min":1.167,"15min":1.1020000000000001},"max":{"1min":2.2440000000000002,"5min":3.1720000000000002,"15min":3.6259999999999999},"last":2.0870000000000002},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.788,"15min":1.7769999999999999},"min":{"1min":1.2569999999999999,"5min":1.147,"15min":0.877},"max":{"1min":2.423,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.623}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.8480000000000001,"15min":1.885},"min":{"1min":1.3799999999999999,"5min":1.163,"15min":1.0109999999999999},"max":{"1min":2.3599999999999999,"5min":3.012,"15min":3.7839999999999998},"last":2.153},{"interface":"front","average":{"1min":1.772,"5min":1.8779999999999999,"15min":1.8700000000000001},"min":{"1min":1.413,"5min":1.359,"15min":0.89200000000000002},"max":{"1min":2.5590000000000002,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.528}]}]},{"osd":0,"up_from":15,"seq":64424509805,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.125,"15min":1.1339999999999999},"min":{"1min":0.746,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":2.6509999999999998,"15min":3.1960000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4139999999999999,"15min":1.371},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.66500000000000004},"max":{"1min":2.7789999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.2929999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.444,"15min":1.52},"min":{"1min":0.80100000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0590000000000002,"5min":2.8330000000000002,"15min":2.8359999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.444,"5min":1.5589999999999999,"15min":1.573},"min":{"1min":1.0069999999999999,"5min":0.82499999999999996,"15min":0.621},"max":{"1min":2.8769999999999998,"5min":3.1320000000000001,"15min":3.3450000000000002},"last":1.548}]},{"osd":3,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4770000000000001,"15min":1.587},"min":{"1min":0.876,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1219999999999999,"5min":2.7839999999999998,"15min":4.6660000000000004},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.7110000000000001,"15min":1.802},"min":{"1min":1.081,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":2.4319999999999999,"5min":2.9359999999999999,"15min":3.2829999999999999},"last":1.1910000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.621,"15min":1.6830000000000001},"min":{"1min":1.1619999999999999,"5min":1.0049999999999999,"15min":0.98999999999999999},"max":{"1min":2.2109999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.758},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.675,"15min":1.7150000000000001},"min":{"1min":1.1160000000000001,"5min":0.92600000000000005,"15min":0.79700000000000004},"max":{"1min":2.2290000000000001,"5min":2.544,"15min":3.1890000000000001},"last":1.6559999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.75,"15min":1.7370000000000001},"min":{"1min":1.1839999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.718,"15min":1.7709999999999999},"min":{"1min":1.163,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.4140000000000001,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.603}]},{"osd":6,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.792,"5min":1.8089999999999999,"15min":1.8620000000000001},"min":{"1min":1.147,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.4900000000000002,"5min":2.8290000000000002,"15min":3.399},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.853,"15min":1.8460000000000001},"min":{"1min":1.375,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.46},"last":1.8129999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:09:43 2023","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.9530000000000001,"15min":1.96},"min":{"1min":1.2270000000000001,"5min":1.1899999999999999,"15min":1.1000000000000001},"max":{"1min":3.21,"5min":3.21,"15min":3.6160000000000001},"last":1.873},{"interface":"front","average":{"1min":1.762,"5min":1.8169999999999999,"15min":1.909},"min":{"1min":1.3540000000000001,"5min":1.121,"15min":1.121},"max":{"1min":2.1850000000000001,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.8360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542508,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2,"15min":1.1990000000000001},"min":{"1min":0.82899999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6419999999999999,"5min":1.804,"15min":2.5649999999999999},"last":1.972},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2030000000000001,"15min":1.2829999999999999},"min":{"1min":0.76800000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.77,"5min":1.968,"15min":3.3769999999999998},"last":9.0700000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.319,"15min":1.3029999999999999},"min":{"1min":0.94599999999999995,"5min":0.77200000000000002,"15min":0.747},"max":{"1min":1.9370000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":9.1120000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.254,"15min":1.298},"min":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.7709999999999999,"5min":2.1179999999999999,"15min":3.3410000000000002},"last":17.715}]},{"osd":2,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.397,"15min":1.3999999999999999},"min":{"1min":1.02,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7989999999999999,"5min":1.962,"15min":2.7229999999999999},"last":3.1890000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3700000000000001,"15min":1.3720000000000001},"min":{"1min":1.0649999999999999,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.7010000000000001,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.873}]},{"osd":3,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4430000000000001,"15min":1.4590000000000001},"min":{"1min":1.02,"5min":0.90400000000000003,"15min":0.81200000000000006},"max":{"1min":2.177,"5min":2.177,"15min":2.2629999999999999},"last":8.2469999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.5029999999999999,"15min":1.5189999999999999},"min":{"1min":1.0820000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.9330000000000001,"5min":2.2869999999999999,"15min":2.6040000000000001},"last":8.2769999999999992}]},{"osd":5,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.351,"15min":1.323},"min":{"1min":0.96599999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9670000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":2.0249999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.4530000000000001,"15min":1.4410000000000001},"min":{"1min":1.056,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":2.0649999999999999,"5min":2.2690000000000001,"15min":3.0499999999999998},"last":8.1869999999999994}]},{"osd":6,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.472,"15min":1.4319999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.869,"5min":2.3879999999999999,"15min":2.9300000000000002},"last":3.0880000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5329999999999999,"15min":1.52},"min":{"1min":1.038,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":1.835,"5min":2.512,"15min":2.601},"last":1.9159999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.583,"15min":1.5549999999999999},"min":{"1min":1.2290000000000001,"5min":0.92600000000000005,"15min":0.86299999999999999},"max":{"1min":2.484,"5min":2.5449999999999999,"15min":3.1829999999999998},"last":8.7769999999999992},{"interface":"front","average":{"1min":1.752,"5min":1.643,"15min":1.613},"min":{"1min":1.3779999999999999,"5min":1.0449999999999999,"15min":0.999},"max":{"1min":2.4199999999999999,"5min":2.6080000000000001,"15min":3.23},"last":8.4290000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2,"15min":1.1850000000000001},"min":{"1min":0.78500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":2.2959999999999998,"5min":2.944,"15min":2.944},"last":1.417},{"interface":"front","average":{"1min":1.254,"5min":1.2210000000000001,"15min":1.3120000000000001},"min":{"1min":0.88800000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.077}]},{"osd":2,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.431,"15min":1.421},"min":{"1min":0.69299999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.0289999999999999,"5min":2.835,"15min":3.585},"last":1.661},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.5549999999999999,"15min":1.583},"min":{"1min":0.98099999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.4180000000000001,"5min":2.75,"15min":2.8719999999999999},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":1.76,"15min":1.728},"min":{"1min":0.98299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":2.5379999999999998,"5min":2.964,"15min":3.3740000000000001},"last":1.28},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.573,"15min":1.5840000000000001},"min":{"1min":0.76600000000000001,"5min":0.66000000000000003,"15min":0.51200000000000001},"max":{"1min":2.3530000000000002,"5min":2.8370000000000002,"15min":3.234},"last":1.351}]},{"osd":4,"last update":"Mon Oct 16 20:09:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.593,"15min":1.573},"min":{"1min":1.1160000000000001,"5min":0.81000000000000005,"15min":0.71499999999999997},"max":{"1min":2.2450000000000001,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.462},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":1.2050000000000001,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":2.371,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.179}]},{"osd":5,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.6299999999999999,"15min":1.6519999999999999},"min":{"1min":1.0720000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.02,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.796,"15min":1.75},"min":{"1min":1.3180000000000001,"5min":1.022,"15min":0.77400000000000002},"max":{"1min":2.4340000000000002,"5min":3.2170000000000001,"15min":3.819},"last":1.714}]},{"osd":6,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.8600000000000001,"15min":1.8260000000000001},"min":{"1min":1.1160000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.3130000000000002,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.859,"15min":1.8460000000000001},"min":{"1min":1.3,"5min":0.92000000000000004,"15min":0.746},"max":{"1min":2.6499999999999999,"5min":2.698,"15min":3.3210000000000002},"last":1.534}]},{"osd":7,"last update":"Mon Oct 16 20:09:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.804,"15min":1.825},"min":{"1min":1.113,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.7829999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.764},{"interface":"front","average":{"1min":1.923,"5min":2,"15min":1.964},"min":{"1min":1.401,"5min":1.1599999999999999,"15min":0.96299999999999997},"max":{"1min":2.536,"5min":3.3239999999999998,"15min":3.923},"last":1.802}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:42.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:10:42.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.640+0000 7febb51b6640 1 Processor -- start 2023-10-16T20:10:42.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.641+0000 7febb51b6640 1 -- start start 2023-10-16T20:10:42.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.642+0000 7febb51b6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febb0151190 0x7febb00c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:42.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.642+0000 7febb51b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 0x7febb00c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:42.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.642+0000 7febb51b6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febb006d5d0 0x7febb006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:42.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.642+0000 7febb51b6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb00c4010 con 0x7febb0151190 2023-10-16T20:10:42.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.642+0000 7febb51b6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb00c1ce0 con 0x7febb006d5d0 2023-10-16T20:10:42.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.642+0000 7febb51b6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb0151570 con 0x7febb00c12f0 2023-10-16T20:10:42.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.686+0000 7febaed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febb0151190 0x7febb00c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:42.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.689+0000 7febaed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febb0151190 0x7febb00c2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54216/0 (socket says 172.21.15.57:54216) 2023-10-16T20:10:42.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.689+0000 7febaed9d640 1 -- 172.21.15.57:0/3378818525 learned_addr learned my addr 172.21.15.57:0/3378818525 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:42.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.701+0000 7febaed9d640 1 -- 172.21.15.57:0/3378818525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 msgr2=0x7febb00c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:42.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.701+0000 7febaed9d640 1 --2- 172.21.15.57:0/3378818525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 0x7febb00c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.701+0000 7febaed9d640 1 -- 172.21.15.57:0/3378818525 >> v2:172.21.15.110:3300/0 conn(0x7febb006d5d0 msgr2=0x7febb006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:42.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.701+0000 7febaed9d640 1 --2- 172.21.15.57:0/3378818525 >> v2:172.21.15.110:3300/0 conn(0x7febb006d5d0 0x7febb006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.701+0000 7febaed9d640 1 -- 172.21.15.57:0/3378818525 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb00c5530 con 0x7febb0151190 2023-10-16T20:10:42.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.708+0000 7febaed9d640 1 --2- 172.21.15.57:0/3378818525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c2560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7febb01549f0 tx=0x7feba002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1644c2399f43e99d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:42.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.717+0000 7febadd9b640 1 -- 172.21.15.57:0/3378818525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0031880 con 0x7febb0151190 2023-10-16T20:10:42.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.717+0000 7febadd9b640 1 -- 172.21.15.57:0/3378818525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba00319e0 con 0x7febb0151190 2023-10-16T20:10:42.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.717+0000 7febadd9b640 1 -- 172.21.15.57:0/3378818525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0031d70 con 0x7febb0151190 2023-10-16T20:10:42.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 -- 172.21.15.57:0/3378818525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 msgr2=0x7febb00c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:42.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 --2- 172.21.15.57:0/3378818525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c2560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7febb01549f0 tx=0x7feba002b920 comp rx=0 tx=0).stop 2023-10-16T20:10:42.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 -- 172.21.15.57:0/3378818525 shutdown_connections 2023-10-16T20:10:42.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 --2- 172.21.15.57:0/3378818525 >> v2:172.21.15.110:3300/0 conn(0x7febb006d5d0 0x7febb006da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 --2- 172.21.15.57:0/3378818525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 0x7febb00c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 --2- 172.21.15.57:0/3378818525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c2560 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 -- 172.21.15.57:0/3378818525 >> 172.21.15.57:0/3378818525 conn(0x7febb006c430 msgr2=0x7febb0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:42.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 -- 172.21.15.57:0/3378818525 shutdown_connections 2023-10-16T20:10:42.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.718+0000 7febb51b6640 1 -- 172.21.15.57:0/3378818525 wait complete. 2023-10-16T20:10:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.721+0000 7febb51b6640 1 Processor -- start 2023-10-16T20:10:42.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.721+0000 7febb51b6640 1 -- start start 2023-10-16T20:10:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.723+0000 7febb51b6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb006d5d0 0x7febb015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.723+0000 7febb51b6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 0x7febb01f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.723+0000 7febb51b6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.723+0000 7febb51b6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb01f6830 con 0x7febb0151190 2023-10-16T20:10:42.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.723+0000 7febb51b6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb00ca910 con 0x7febb006d5d0 2023-10-16T20:10:42.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.723+0000 7febb51b6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb01f6550 con 0x7febb00c12f0 2023-10-16T20:10:42.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.724+0000 7febaf59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:42.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.724+0000 7febaf59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54232/0 (socket says 172.21.15.57:54232) 2023-10-16T20:10:42.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.724+0000 7febaf59e640 1 -- 172.21.15.57:0/2574297407 learned_addr learned my addr 172.21.15.57:0/2574297407 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.730+0000 7febaf59e640 1 -- 172.21.15.57:0/2574297407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 msgr2=0x7febb01f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.730+0000 7febaf59e640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 0x7febb01f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.730+0000 7febaf59e640 1 -- 172.21.15.57:0/2574297407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb006d5d0 msgr2=0x7febb015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.730+0000 7febaf59e640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb006d5d0 0x7febb015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:42.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.730+0000 7febaf59e640 1 -- 172.21.15.57:0/2574297407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00094d0 con 0x7febb0151190 2023-10-16T20:10:42.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.734+0000 7febaf59e640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c8e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feba800b970 tx=0x7feba800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:42.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.745+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba800cb40 con 0x7febb0151190 2023-10-16T20:10:42.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.745+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba800ccc0 con 0x7febb0151190 2023-10-16T20:10:42.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.745+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8014680 con 0x7febb0151190 2023-10-16T20:10:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.745+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb0071830 con 0x7febb0151190 2023-10-16T20:10:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.745+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb00cb060 con 0x7febb0151190 2023-10-16T20:10:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:42.747+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb00cb280 con 0x7febb0151190 2023-10-16T20:10:43.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.071+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feba8007370 con 0x7febb0151190 2023-10-16T20:10:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.074+0000 7feb977fe640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feb9c06aef0 0x7feb9c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.075+0000 7febaed9d640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feb9c06aef0 0x7feb9c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:43.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.077+0000 7febaed9d640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feb9c06aef0 0x7feb9c06d3b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feba0036000 tx=0x7feba0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.089+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feba800ce30 con 0x7febb0151190 2023-10-16T20:10:43.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.091+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feba8054a70 con 0x7febb0151190 2023-10-16T20:10:43.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.302+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febb004e1d0 con 0x7febb0151190 2023-10-16T20:10:43.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.371+0000 7feb977fe640 1 -- 172.21.15.57:0/2574297407 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7feba8019070 con 0x7febb0151190 2023-10-16T20:10:43.374 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:43.374 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:10:43.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feb9c06aef0 msgr2=0x7feb9c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:43.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feb9c06aef0 0x7feb9c06d3b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feba0036000 tx=0x7feba0030000 comp rx=0 tx=0).stop 2023-10-16T20:10:43.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 msgr2=0x7febb00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:43.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c8e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feba800b970 tx=0x7feba800be30 comp rx=0 tx=0).stop 2023-10-16T20:10:43.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 shutdown_connections 2023-10-16T20:10:43.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feb9c06aef0 0x7feb9c06d3b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:43.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb0151190 0x7febb00c8e50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:43.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c12f0 0x7febb01f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:43.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 --2- 172.21.15.57:0/2574297407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb006d5d0 0x7febb015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:43.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 >> 172.21.15.57:0/2574297407 conn(0x7febb006c430 msgr2=0x7febb00be6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:43.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 shutdown_connections 2023-10-16T20:10:43.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:43.374+0000 7febb51b6640 1 -- 172.21.15.57:0/2574297407 wait complete. 2023-10-16T20:10:44.396 INFO:tasks.ceph:Scrubbing osd.0 2023-10-16T20:10:44.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:44.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.631+0000 7fb035047640 1 Processor -- start 2023-10-16T20:10:44.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.631+0000 7fb035047640 1 -- start start 2023-10-16T20:10:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.633+0000 7fb035047640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0300c4300 0x7fb0300c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.633+0000 7fb035047640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030150b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.633+0000 7fb035047640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0300c6850 con 0x7fb0300c3f20 2023-10-16T20:10:44.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.633+0000 7fb035047640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0300c4fa0 con 0x7fb0300c4300 2023-10-16T20:10:44.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.633+0000 7fb035047640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c33d0 con 0x7fb030071da0 2023-10-16T20:10:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.635+0000 7fb034846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.635+0000 7fb027fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0300c4300 0x7fb0300c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:44.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.636+0000 7fb034846640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:47872/0 (socket says 172.21.15.57:47872) 2023-10-16T20:10:44.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.636+0000 7fb034846640 1 -- 172.21.15.57:0/3052637487 learned_addr learned my addr 172.21.15.57:0/3052637487 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:44.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.643+0000 7fb034846640 1 -- 172.21.15.57:0/3052637487 >> v2:172.21.15.110:3300/0 conn(0x7fb0300c4300 msgr2=0x7fb0300c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:44.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.643+0000 7fb034846640 1 --2- 172.21.15.57:0/3052637487 >> v2:172.21.15.110:3300/0 conn(0x7fb0300c4300 0x7fb0300c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:44.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.643+0000 7fb034846640 1 -- 172.21.15.57:0/3052637487 >> v1:172.21.15.110:6789/0 conn(0x7fb0300c3f20 legacy=0x7fb03015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.643+0000 7fb034846640 1 -- 172.21.15.57:0/3052637487 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300c6230 con 0x7fb030071da0 2023-10-16T20:10:44.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.649+0000 7fb034846640 1 --2- 172.21.15.57:0/3052637487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030150b20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb028009870 tx=0x7fb02802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=806871f210821536 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.660+0000 7fb02f7fe640 1 -- 172.21.15.57:0/3052637487 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028030840 con 0x7fb030071da0 2023-10-16T20:10:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.661+0000 7fb02f7fe640 1 -- 172.21.15.57:0/3052637487 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0280309a0 con 0x7fb030071da0 2023-10-16T20:10:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.661+0000 7fb02f7fe640 1 -- 172.21.15.57:0/3052637487 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028030d30 con 0x7fb030071da0 2023-10-16T20:10:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.661+0000 7fb035047640 1 -- 172.21.15.57:0/3052637487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 msgr2=0x7fb030150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.661+0000 7fb035047640 1 --2- 172.21.15.57:0/3052637487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030150b20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb028009870 tx=0x7fb02802b980 comp rx=0 tx=0).stop 2023-10-16T20:10:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.662+0000 7fb035047640 1 -- 172.21.15.57:0/3052637487 shutdown_connections 2023-10-16T20:10:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.662+0000 7fb035047640 1 --2- 172.21.15.57:0/3052637487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030150b20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.662+0000 7fb035047640 1 --2- 172.21.15.57:0/3052637487 >> v2:172.21.15.110:3300/0 conn(0x7fb0300c4300 0x7fb0300c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.662+0000 7fb035047640 1 -- 172.21.15.57:0/3052637487 >> 172.21.15.57:0/3052637487 conn(0x7fb03006dd80 msgr2=0x7fb03006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.662+0000 7fb035047640 1 -- 172.21.15.57:0/3052637487 shutdown_connections 2023-10-16T20:10:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.662+0000 7fb035047640 1 -- 172.21.15.57:0/3052637487 wait complete. 2023-10-16T20:10:44.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.665+0000 7fb035047640 1 Processor -- start 2023-10-16T20:10:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.666+0000 7fb035047640 1 -- start start 2023-10-16T20:10:44.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.667+0000 7fb035047640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.667+0000 7fb035047640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0300c3f20 0x7fb0300ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.667+0000 7fb035047640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0300c4300 0x7fb0300ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.667+0000 7fb035047640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300ad0c0 con 0x7fb0300c4300 2023-10-16T20:10:44.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.667+0000 7fb035047640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300ae250 con 0x7fb0300c3f20 2023-10-16T20:10:44.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.667+0000 7fb035047640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03014d0d0 con 0x7fb030071da0 2023-10-16T20:10:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.668+0000 7fb034846640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0300c4300 0x7fb0300ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.669+0000 7fb034846640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0300c4300 0x7fb0300ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54246/0 (socket says 172.21.15.57:54246) 2023-10-16T20:10:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.669+0000 7fb034846640 1 -- 172.21.15.57:0/3096981228 learned_addr learned my addr 172.21.15.57:0/3096981228 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.669+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.674+0000 7fb034846640 1 -- 172.21.15.57:0/3096981228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 msgr2=0x7fb030159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.674+0000 7fb034846640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb030071da0 0x7fb030159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.674+0000 7fb034846640 1 -- 172.21.15.57:0/3096981228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0300c3f20 msgr2=0x7fb0300ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.674+0000 7fb034846640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0300c3f20 0x7fb0300ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.674+0000 7fb034846640 1 -- 172.21.15.57:0/3096981228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280094d0 con 0x7fb0300c4300 2023-10-16T20:10:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.677+0000 7fb034846640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0300c4300 0x7fb0300ada20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb028009990 tx=0x7fb028004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.682+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028039c10 con 0x7fb0300c4300 2023-10-16T20:10:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.682+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028039d70 con 0x7fb0300c4300 2023-10-16T20:10:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.682+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0280446c0 con 0x7fb0300c4300 2023-10-16T20:10:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.682+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300ae720 con 0x7fb0300c4300 2023-10-16T20:10:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.682+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0300ae440 con 0x7fb0300c4300 2023-10-16T20:10:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.683+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0300af9f0 con 0x7fb0300c4300 2023-10-16T20:10:44.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.719+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb02804d3b0 con 0x7fb0300c4300 2023-10-16T20:10:44.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.721+0000 7fb02d7fa640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb01006aec0 0x7fb01006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.722+0000 7fb02ffff640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb01006aec0 0x7fb01006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:44.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.724+0000 7fb02ffff640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb01006aec0 0x7fb01006d380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0200012e0 tx=0x7fb020009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:44.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.729+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb02803e070 con 0x7fb0300c4300 2023-10-16T20:10:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.730+0000 7fb02d7fa640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fb0100731e0 0x7fb010075660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.730+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 --> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb010075d30 con 0x7fb0100731e0 2023-10-16T20:10:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.730+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb028077770 con 0x7fb0300c4300 2023-10-16T20:10:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.730+0000 7fb027fff640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fb0100731e0 0x7fb010075660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:44.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.732+0000 7fb027fff640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fb0100731e0 0x7fb010075660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:44.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.734+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== osd.0 v2:172.21.15.57:6818/314169635 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb010075d30 con 0x7fb0100731e0 2023-10-16T20:10:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.753+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 --> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb03015a9a0 con 0x7fb0100731e0 2023-10-16T20:10:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.754+0000 7fb02d7fa640 1 -- 172.21.15.57:0/3096981228 <== osd.0 v2:172.21.15.57:6818/314169635 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb018009a70 con 0x7fb0100731e0 2023-10-16T20:10:44.757 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:44.757 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:44.757 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fb0100731e0 msgr2=0x7fb010075660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6818/314169635,v1:172.21.15.57:6819/314169635] conn(0x7fb0100731e0 0x7fb010075660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb01006aec0 msgr2=0x7fb01006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb01006aec0 0x7fb01006d380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0200012e0 tx=0x7fb020009040 comp rx=0 tx=0).stop 2023-10-16T20:10:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0300c4300 msgr2=0x7fb0300ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 --2- 172.21.15.57:0/3096981228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0300c4300 0x7fb0300ada20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb028009990 tx=0x7fb028004730 comp rx=0 tx=0).stop 2023-10-16T20:10:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb034846640 1 -- 172.21.15.57:0/3096981228 reap_dead start 2023-10-16T20:10:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 shutdown_connections 2023-10-16T20:10:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.755+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 >> 172.21.15.57:0/3096981228 conn(0x7fb03006dd80 msgr2=0x7fb0300c1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.756+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 shutdown_connections 2023-10-16T20:10:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:44.756+0000 7fb035047640 1 -- 172.21.15.57:0/3096981228 wait complete. 2023-10-16T20:10:44.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-16T20:10:45.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.003+0000 7f6dd7190640 1 Processor -- start 2023-10-16T20:10:45.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.004+0000 7f6dd7190640 1 -- start start 2023-10-16T20:10:45.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.005+0000 7f6dd7190640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 0x7f6dd01563c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.005+0000 7f6dd7190640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd0150330 con 0x7f6dd014ff50 2023-10-16T20:10:45.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.005+0000 7f6dd7190640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00c66d0 con 0x7f6dd00711f0 2023-10-16T20:10:45.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.005+0000 7f6dd7190640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00c2b80 con 0x7f6dd0155f70 2023-10-16T20:10:45.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.006+0000 7f6dd4f2c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6dd014ff50 0x7f6dd0071930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50812/0 (socket says 172.21.15.57:50812) 2023-10-16T20:10:45.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.006+0000 7f6dd4f2c640 1 -- 172.21.15.57:0/361256373 learned_addr learned my addr 172.21.15.57:0/361256373 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:45.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.007+0000 7f6dd572d640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 0x7f6dd01563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.010+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219917349 0 0) 0x7f6dd0150330 con 0x7f6dd014ff50 2023-10-16T20:10:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.010+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db8005730 con 0x7f6dd014ff50 2023-10-16T20:10:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219258018 0 0) 0x7f6db8005730 con 0x7f6dd014ff50 2023-10-16T20:10:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 msgr2=0x7f6dd01563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 0x7f6dd01563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 >> v1:172.21.15.110:6789/0 conn(0x7f6dd00711f0 legacy=0x7f6dd00c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0156900 con 0x7f6dd014ff50 2023-10-16T20:10:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f6dc00019f0 con 0x7f6dd014ff50 2023-10-16T20:10:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 >> v1:172.21.15.57:6789/0 conn(0x7f6dd014ff50 legacy=0x7f6dd0071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 0x7f6db8005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.014+0000 7f6dcf7fe640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db8006180 0x7f6db80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.015+0000 7f6dcf7fe640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006f10 0x7f6db8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.015+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800dd30 con 0x7f6db8006180 2023-10-16T20:10:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.015+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800dea0 con 0x7f6db8006f10 2023-10-16T20:10:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.015+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800e060 con 0x7f6dd0155f70 2023-10-16T20:10:45.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.018+0000 7f6dcffff640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db8006180 0x7f6db80069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.019+0000 7f6dd572d640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006f10 0x7f6db8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.021+0000 7f6dcffff640 1 -- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 msgr2=0x7f6db8005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:45.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.021+0000 7f6dcffff640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd0155f70 0x7f6db8005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.021+0000 7f6dcffff640 1 -- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006f10 msgr2=0x7f6db8007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:45.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.021+0000 7f6dcffff640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006f10 0x7f6db8007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.021+0000 7f6dcffff640 1 -- 172.21.15.57:0/361256373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8005730 con 0x7f6db8006180 2023-10-16T20:10:45.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.025+0000 7f6dcffff640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db8006180 0x7f6db80069d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4001750 tx=0x7f6db8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf2aa892b6d2bc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.033+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40052d0 con 0x7f6db8006180 2023-10-16T20:10:45.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.033+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc402e050 con 0x7f6db8006180 2023-10-16T20:10:45.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.033+0000 7f6dcf7fe640 1 -- 172.21.15.57:0/361256373 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4003830 con 0x7f6db8006180 2023-10-16T20:10:45.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd7190640 1 -- 172.21.15.57:0/361256373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db8006180 msgr2=0x7f6db80069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd7190640 1 --2- 172.21.15.57:0/361256373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db8006180 0x7f6db80069d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4001750 tx=0x7f6db8007a00 comp rx=0 tx=0).stop 2023-10-16T20:10:45.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd572d640 1 -- 172.21.15.57:0/361256373 reap_dead start 2023-10-16T20:10:45.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd7190640 1 -- 172.21.15.57:0/361256373 shutdown_connections 2023-10-16T20:10:45.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd7190640 1 -- 172.21.15.57:0/361256373 >> 172.21.15.57:0/361256373 conn(0x7f6dd006c430 msgr2=0x7f6dd0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:45.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd7190640 1 -- 172.21.15.57:0/361256373 shutdown_connections 2023-10-16T20:10:45.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.034+0000 7f6dd7190640 1 -- 172.21.15.57:0/361256373 wait complete. 2023-10-16T20:10:45.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.038+0000 7f6dd7190640 1 Processor -- start 2023-10-16T20:10:45.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.038+0000 7f6dd7190640 1 -- start start 2023-10-16T20:10:45.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.039+0000 7f6dd7190640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006180 0x7f6dd0154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.039+0000 7f6dd7190640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 0x7f6dd0154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.039+0000 7f6dd7190640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd006ded0 0x7f6dd014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.039+0000 7f6dd7190640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0153c20 con 0x7f6dd0149a90 2023-10-16T20:10:45.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.039+0000 7f6dd7190640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0158fd0 con 0x7f6db8006180 2023-10-16T20:10:45.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.039+0000 7f6dd7190640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0158cf0 con 0x7f6dd006ded0 2023-10-16T20:10:45.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.040+0000 7f6dcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 0x7f6dd0154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.041+0000 7f6dd4f2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006180 0x7f6dd0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.041+0000 7f6dcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 0x7f6dd0154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54274/0 (socket says 172.21.15.57:54274) 2023-10-16T20:10:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.041+0000 7f6dcffff640 1 -- 172.21.15.57:0/2920725479 learned_addr learned my addr 172.21.15.57:0/2920725479 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.041+0000 7f6dd572d640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd006ded0 0x7f6dd014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.047+0000 7f6dcffff640 1 -- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd006ded0 msgr2=0x7f6dd014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.047+0000 7f6dcffff640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd006ded0 0x7f6dd014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.047+0000 7f6dcffff640 1 -- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006180 msgr2=0x7f6dd0154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.047+0000 7f6dcffff640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006180 0x7f6dd0154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.047+0000 7f6dcffff640 1 -- 172.21.15.57:0/2920725479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd014d880 con 0x7f6dd0149a90 2023-10-16T20:10:45.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.051+0000 7f6dcffff640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 0x7f6dd0154fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005040 tx=0x7f6dc4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.059+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4007640 con 0x7f6dd0149a90 2023-10-16T20:10:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.059+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc40069e0 con 0x7f6dd0149a90 2023-10-16T20:10:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.059+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4006d90 con 0x7f6dd0149a90 2023-10-16T20:10:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.059+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd014db60 con 0x7f6dd0149a90 2023-10-16T20:10:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.059+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd014e120 con 0x7f6dd0149a90 2023-10-16T20:10:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.061+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd014e2e0 con 0x7f6dd0149a90 2023-10-16T20:10:45.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.086+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6dc40035f0 con 0x7f6dd0149a90 2023-10-16T20:10:45.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.087+0000 7f6dcd7fa640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6dbc06aef0 0x7f6dbc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.088+0000 7f6dd4f2c640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6dbc06aef0 0x7f6dbc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.088+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6dc407a640 con 0x7f6dd0149a90 2023-10-16T20:10:45.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.090+0000 7f6dd4f2c640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6dbc06aef0 0x7f6dbc06d3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0001be0 tx=0x7f6dc0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.397+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dc4076980 con 0x7f6dd0149a90 2023-10-16T20:10:45.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.608+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dd0071640 con 0x7f6dbc06aef0 2023-10-16T20:10:45.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.609+0000 7f6dcd7fa640 1 -- 172.21.15.57:0/2920725479 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6dc0007e60 con 0x7f6dbc06aef0 2023-10-16T20:10:45.611 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2023-10-16T20:10:45.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.611+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6dbc06aef0 msgr2=0x7f6dbc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.611+0000 7f6dd7190640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6dbc06aef0 0x7f6dbc06d3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0001be0 tx=0x7f6dc0007c10 comp rx=0 tx=0).stop 2023-10-16T20:10:45.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.611+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 msgr2=0x7f6dd0154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.611+0000 7f6dd7190640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 0x7f6dd0154fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005040 tx=0x7f6dc4001120 comp rx=0 tx=0).stop 2023-10-16T20:10:45.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 shutdown_connections 2023-10-16T20:10:45.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f6dbc06aef0 0x7f6dbc06d3b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dd006ded0 0x7f6dd014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dd0149a90 0x7f6dd0154fe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 --2- 172.21.15.57:0/2920725479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8006180 0x7f6dd0154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 >> 172.21.15.57:0/2920725479 conn(0x7f6dd006c430 msgr2=0x7f6dd0071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:45.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 shutdown_connections 2023-10-16T20:10:45.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.612+0000 7f6dd7190640 1 -- 172.21.15.57:0/2920725479 wait complete. 2023-10-16T20:10:45.633 INFO:tasks.ceph:Scrubbing osd.1 2023-10-16T20:10:45.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:45.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.855+0000 7fa0307f0640 1 Processor -- start 2023-10-16T20:10:45.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.855+0000 7fa0307f0640 1 -- start start 2023-10-16T20:10:45.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.857+0000 7fa0307f0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa02806b060 0x7fa028070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.857+0000 7fa0307f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0280cb7d0 0x7fa028152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.857+0000 7fa0307f0640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0280c6dd0 con 0x7fa02806b440 2023-10-16T20:10:45.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.857+0000 7fa0307f0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0280c70b0 con 0x7fa02806b060 2023-10-16T20:10:45.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.857+0000 7fa0307f0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280c7390 con 0x7fa0280cb7d0 2023-10-16T20:10:45.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.859+0000 7fa02e58c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa02806b060 0x7fa028070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.859+0000 7fa02ed8d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0280cb7d0 0x7fa028152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.860+0000 7fa02e58c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa02806b060 0x7fa028070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54286/0 (socket says 172.21.15.57:54286) 2023-10-16T20:10:45.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.860+0000 7fa02e58c640 1 -- 172.21.15.57:0/958291118 learned_addr learned my addr 172.21.15.57:0/958291118 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.867+0000 7fa02e58c640 1 -- 172.21.15.57:0/958291118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0280cb7d0 msgr2=0x7fa028152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:45.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.867+0000 7fa02e58c640 1 --2- 172.21.15.57:0/958291118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0280cb7d0 0x7fa028152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.867+0000 7fa02e58c640 1 -- 172.21.15.57:0/958291118 >> v1:172.21.15.57:6789/0 conn(0x7fa02806b440 legacy=0x7fa0281599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:45.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.867+0000 7fa02e58c640 1 -- 172.21.15.57:0/958291118 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0281591e0 con 0x7fa02806b060 2023-10-16T20:10:45.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.867+0000 7fa02ed8d640 1 --2- 172.21.15.57:0/958291118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0280cb7d0 0x7fa028152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:10:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.872+0000 7fa02e58c640 1 --2- 172.21.15.57:0/958291118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b060 0x7fa028070390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa024009850 tx=0x7fa02402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dee3ce3b007bd44 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.878+0000 7fa02d58a640 1 -- 172.21.15.57:0/958291118 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024004230 con 0x7fa02806b060 2023-10-16T20:10:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.878+0000 7fa02d58a640 1 -- 172.21.15.57:0/958291118 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024004390 con 0x7fa02806b060 2023-10-16T20:10:45.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.878+0000 7fa02d58a640 1 -- 172.21.15.57:0/958291118 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024031830 con 0x7fa02806b060 2023-10-16T20:10:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.879+0000 7fa0307f0640 1 -- 172.21.15.57:0/958291118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b060 msgr2=0x7fa028070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.879+0000 7fa0307f0640 1 --2- 172.21.15.57:0/958291118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b060 0x7fa028070390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa024009850 tx=0x7fa02402b8d0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.879+0000 7fa0307f0640 1 -- 172.21.15.57:0/958291118 shutdown_connections 2023-10-16T20:10:45.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.879+0000 7fa0307f0640 1 --2- 172.21.15.57:0/958291118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0280cb7d0 0x7fa028152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.879+0000 7fa0307f0640 1 --2- 172.21.15.57:0/958291118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b060 0x7fa028070390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.879+0000 7fa0307f0640 1 -- 172.21.15.57:0/958291118 >> 172.21.15.57:0/958291118 conn(0x7fa0280cac40 msgr2=0x7fa0280cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:45.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.880+0000 7fa0307f0640 1 -- 172.21.15.57:0/958291118 shutdown_connections 2023-10-16T20:10:45.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.880+0000 7fa0307f0640 1 -- 172.21.15.57:0/958291118 wait complete. 2023-10-16T20:10:45.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.882+0000 7fa0307f0640 1 Processor -- start 2023-10-16T20:10:45.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.882+0000 7fa0307f0640 1 -- start start 2023-10-16T20:10:45.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.883+0000 7fa0307f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa02806b060 0x7fa0281ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.883+0000 7fa0307f0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b440 0x7fa0281538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.883+0000 7fa0307f0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0280cb7d0 0x7fa02814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.883+0000 7fa0307f0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa028153f00 con 0x7fa02806b440 2023-10-16T20:10:45.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.883+0000 7fa0307f0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0281541e0 con 0x7fa0280cb7d0 2023-10-16T20:10:45.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.883+0000 7fa0307f0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0281544c0 con 0x7fa02806b060 2023-10-16T20:10:45.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.884+0000 7fa02dd8b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b440 0x7fa0281538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.884+0000 7fa02dd8b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b440 0x7fa0281538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54292/0 (socket says 172.21.15.57:54292) 2023-10-16T20:10:45.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.884+0000 7fa02dd8b640 1 -- 172.21.15.57:0/991746532 learned_addr learned my addr 172.21.15.57:0/991746532 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:45.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.884+0000 7fa02e58c640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa02806b060 0x7fa0281ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.885+0000 7fa02ed8d640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0280cb7d0 0x7fa02814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.891+0000 7fa02dd8b640 1 -- 172.21.15.57:0/991746532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa02806b060 msgr2=0x7fa0281ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.891+0000 7fa02dd8b640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa02806b060 0x7fa0281ef940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.891+0000 7fa02dd8b640 1 -- 172.21.15.57:0/991746532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0280cb7d0 msgr2=0x7fa02814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.891+0000 7fa02dd8b640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0280cb7d0 0x7fa02814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.891+0000 7fa02dd8b640 1 -- 172.21.15.57:0/991746532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020009a70 con 0x7fa02806b440 2023-10-16T20:10:45.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.894+0000 7fa02dd8b640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b440 0x7fa0281538c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa01800c400 tx=0x7fa01800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.903+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018011790 con 0x7fa02806b440 2023-10-16T20:10:45.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.903+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa018011930 con 0x7fa02806b440 2023-10-16T20:10:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.903+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018011ce0 con 0x7fa02806b440 2023-10-16T20:10:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.903+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa024009460 con 0x7fa02806b440 2023-10-16T20:10:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.903+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0281ef140 con 0x7fa02806b440 2023-10-16T20:10:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.905+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa028065fa0 con 0x7fa02806b440 2023-10-16T20:10:45.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.951+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa01801c460 con 0x7fa02806b440 2023-10-16T20:10:45.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.953+0000 7fa01effd640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa00c06aef0 0x7fa00c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.954+0000 7fa02e58c640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa00c06aef0 0x7fa00c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.955+0000 7fa02e58c640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa00c06aef0 0x7fa00c06d3b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa024035000 tx=0x7fa024008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.960+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa018011e40 con 0x7fa02806b440 2023-10-16T20:10:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.960+0000 7fa01effd640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7fa00c073210 0x7fa00c075690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.960+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 --> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa00c075d60 con 0x7fa00c073210 2023-10-16T20:10:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.960+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa018003880 con 0x7fa02806b440 2023-10-16T20:10:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.961+0000 7fa02ed8d640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7fa00c073210 0x7fa00c075690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:45.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.962+0000 7fa02ed8d640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7fa00c073210 0x7fa00c075690 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.964+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== osd.1 v2:172.21.15.57:6802/1525227707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa00c075d60 con 0x7fa00c073210 2023-10-16T20:10:45.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.984+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 --> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0281594c0 con 0x7fa00c073210 2023-10-16T20:10:45.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.985+0000 7fa01effd640 1 -- 172.21.15.57:0/991746532 <== osd.1 v2:172.21.15.57:6802/1525227707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa02000f040 con 0x7fa00c073210 2023-10-16T20:10:45.987 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:45.988 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7fa00c073210 msgr2=0x7fa00c075690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa0307f0640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6802/1525227707,v1:172.21.15.57:6803/1525227707] conn(0x7fa00c073210 0x7fa00c075690 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa00c06aef0 msgr2=0x7fa00c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa0307f0640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa00c06aef0 0x7fa00c06d3b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa024035000 tx=0x7fa024008030 comp rx=0 tx=0).stop 2023-10-16T20:10:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b440 msgr2=0x7fa0281538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa0307f0640 1 --2- 172.21.15.57:0/991746532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02806b440 0x7fa0281538c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa01800c400 tx=0x7fa01800c8c0 comp rx=0 tx=0).stop 2023-10-16T20:10:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.986+0000 7fa02ed8d640 1 -- 172.21.15.57:0/991746532 reap_dead start 2023-10-16T20:10:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.987+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 shutdown_connections 2023-10-16T20:10:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.987+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 >> 172.21.15.57:0/991746532 conn(0x7fa0280cac40 msgr2=0x7fa028152c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.987+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 shutdown_connections 2023-10-16T20:10:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:45.987+0000 7fa0307f0640 1 -- 172.21.15.57:0/991746532 wait complete. 2023-10-16T20:10:46.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-16T20:10:46.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.238+0000 7f879e4d1640 1 Processor -- start 2023-10-16T20:10:46.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.239+0000 7f879e4d1640 1 -- start start 2023-10-16T20:10:46.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.240+0000 7f879e4d1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8798151040 0x7f87980c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:46.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.240+0000 7f879e4d1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f879806e340 0x7f879806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:46.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.240+0000 7f879e4d1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980c5340 con 0x7f879806b9c0 2023-10-16T20:10:46.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.240+0000 7f879e4d1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980c7e90 con 0x7f879806e340 2023-10-16T20:10:46.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.240+0000 7f879e4d1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980c47e0 con 0x7f8798151040 2023-10-16T20:10:46.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.243+0000 7f879dcd0640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f879806b9c0 0x7f879806d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:58290/0 (socket says 172.21.15.57:58290) 2023-10-16T20:10:46.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.243+0000 7f879dcd0640 1 -- 172.21.15.57:0/1610627527 learned_addr learned my addr 172.21.15.57:0/1610627527 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:46.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.243+0000 7f879d4cf640 1 --2- 172.21.15.57:0/1610627527 >> v2:172.21.15.110:3300/0 conn(0x7f8798151040 0x7f87980c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.252+0000 7f879d4cf640 1 -- 172.21.15.57:0/1610627527 >> v2:172.21.15.57:3300/0 conn(0x7f879806e340 msgr2=0x7f879806cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.252+0000 7f879d4cf640 1 --2- 172.21.15.57:0/1610627527 >> v2:172.21.15.57:3300/0 conn(0x7f879806e340 0x7f879806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.252+0000 7f879d4cf640 1 -- 172.21.15.57:0/1610627527 >> v1:172.21.15.110:6789/0 conn(0x7f879806b9c0 legacy=0x7f879806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:46.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.252+0000 7f879d4cf640 1 -- 172.21.15.57:0/1610627527 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87980c2c40 con 0x7f8798151040 2023-10-16T20:10:46.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.259+0000 7f879d4cf640 1 --2- 172.21.15.57:0/1610627527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f87980c4e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f879806cca0 tx=0x7f879402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb091e0cbb072a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.276+0000 7f878ffff640 1 -- 172.21.15.57:0/1610627527 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794030610 con 0x7f8798151040 2023-10-16T20:10:46.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.277+0000 7f878ffff640 1 -- 172.21.15.57:0/1610627527 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794030770 con 0x7f8798151040 2023-10-16T20:10:46.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.277+0000 7f878ffff640 1 -- 172.21.15.57:0/1610627527 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794030b00 con 0x7f8798151040 2023-10-16T20:10:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.277+0000 7f879e4d1640 1 -- 172.21.15.57:0/1610627527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 msgr2=0x7f87980c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.277+0000 7f879e4d1640 1 --2- 172.21.15.57:0/1610627527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f87980c4e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f879806cca0 tx=0x7f879402b960 comp rx=0 tx=0).stop 2023-10-16T20:10:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.278+0000 7f879e4d1640 1 -- 172.21.15.57:0/1610627527 shutdown_connections 2023-10-16T20:10:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.278+0000 7f879e4d1640 1 --2- 172.21.15.57:0/1610627527 >> v2:172.21.15.57:3300/0 conn(0x7f879806e340 0x7f879806cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.278+0000 7f879e4d1640 1 --2- 172.21.15.57:0/1610627527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f87980c4e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.278+0000 7f879e4d1640 1 -- 172.21.15.57:0/1610627527 >> 172.21.15.57:0/1610627527 conn(0x7f87980c6f00 msgr2=0x7f87980c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.278+0000 7f879e4d1640 1 -- 172.21.15.57:0/1610627527 shutdown_connections 2023-10-16T20:10:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.278+0000 7f879e4d1640 1 -- 172.21.15.57:0/1610627527 wait complete. 2023-10-16T20:10:46.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.281+0000 7f879e4d1640 1 Processor -- start 2023-10-16T20:10:46.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.281+0000 7f879e4d1640 1 -- start start 2023-10-16T20:10:46.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.283+0000 7f879e4d1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879806b9c0 0x7f87981586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:46.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.283+0000 7f879e4d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 0x7f87981ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:46.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.283+0000 7f879e4d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f8798159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:46.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.283+0000 7f879e4d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798159a40 con 0x7f879806e340 2023-10-16T20:10:46.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.283+0000 7f879e4d1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798159200 con 0x7f8798151040 2023-10-16T20:10:46.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.283+0000 7f879e4d1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8798159480 con 0x7f879806b9c0 2023-10-16T20:10:46.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.284+0000 7f879ccce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 0x7f87981ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:46.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.284+0000 7f879ccce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 0x7f87981ecfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36102/0 (socket says 172.21.15.57:36102) 2023-10-16T20:10:46.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.284+0000 7f879ccce640 1 -- 172.21.15.57:0/302676551 learned_addr learned my addr 172.21.15.57:0/302676551 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:46.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.285+0000 7f879dcd0640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f8798159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:46.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.285+0000 7f879d4cf640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879806b9c0 0x7f87981586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.288+0000 7f879ccce640 1 -- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879806b9c0 msgr2=0x7f87981586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.288+0000 7f879ccce640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879806b9c0 0x7f87981586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.288+0000 7f879ccce640 1 -- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 msgr2=0x7f8798159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.288+0000 7f879ccce640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f8798159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.288+0000 7f879ccce640 1 -- 172.21.15.57:0/302676551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794009400 con 0x7f879806e340 2023-10-16T20:10:46.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.291+0000 7f879ccce640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 0x7f87981ecfa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f878800b4a0 tx=0x7f878800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.297+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788005a10 con 0x7f879806e340 2023-10-16T20:10:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.297+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788005b70 con 0x7f879806e340 2023-10-16T20:10:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.297+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788010610 con 0x7f879806e340 2023-10-16T20:10:46.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.297+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8798159760 con 0x7f879806e340 2023-10-16T20:10:46.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.297+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87981581c0 con 0x7f879806e340 2023-10-16T20:10:46.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.298+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8798157d40 con 0x7f879806e340 2023-10-16T20:10:46.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.615+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8788010770 con 0x7f879806e340 2023-10-16T20:10:46.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.619+0000 7f878dffb640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f877c06aec0 0x7f877c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:46.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.620+0000 7f879d4cf640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f877c06aec0 0x7f877c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:46.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.621+0000 7f879d4cf640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f877c06aec0 0x7f877c06d380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8794036000 tx=0x7f879403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.654+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8788057f00 con 0x7f879806e340 2023-10-16T20:10:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.665+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8788054240 con 0x7f879806e340 2023-10-16T20:10:46.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.882+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f87980c2ee0 con 0x7f877c06aec0 2023-10-16T20:10:46.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.883+0000 7f878dffb640 1 -- 172.21.15.57:0/302676551 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f879403f040 con 0x7f877c06aec0 2023-10-16T20:10:46.886 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2023-10-16T20:10:46.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.886+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f877c06aec0 msgr2=0x7f877c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:46.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.886+0000 7f879e4d1640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f877c06aec0 0x7f877c06d380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8794036000 tx=0x7f879403b040 comp rx=0 tx=0).stop 2023-10-16T20:10:46.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.886+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 msgr2=0x7f87981ecfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:46.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.886+0000 7f879e4d1640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 0x7f87981ecfa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f878800b4a0 tx=0x7f878800b960 comp rx=0 tx=0).stop 2023-10-16T20:10:46.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 shutdown_connections 2023-10-16T20:10:46.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f877c06aec0 0x7f877c06d380 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798151040 0x7f8798159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f879806e340 0x7f87981ecfa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 --2- 172.21.15.57:0/302676551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879806b9c0 0x7f87981586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:46.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 >> 172.21.15.57:0/302676551 conn(0x7f87980c6f00 msgr2=0x7f87980c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:46.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 shutdown_connections 2023-10-16T20:10:46.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:46.887+0000 7f879e4d1640 1 -- 172.21.15.57:0/302676551 wait complete. 2023-10-16T20:10:46.908 INFO:tasks.ceph:Scrubbing osd.2 2023-10-16T20:10:46.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.146+0000 7f8c018d7640 1 Processor -- start 2023-10-16T20:10:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.146+0000 7f8c018d7640 1 -- start start 2023-10-16T20:10:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.148+0000 7f8c018d7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bfc06b6a0 0x7f8bfc164a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.148+0000 7f8c018d7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc15b730 con 0x7f8bfc0cc780 2023-10-16T20:10:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.148+0000 7f8c018d7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc06bde0 con 0x7f8bfc0ccb60 2023-10-16T20:10:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.148+0000 7f8c018d7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc06c850 con 0x7f8bfc06b6a0 2023-10-16T20:10:47.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.171+0000 7f8bf3fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8bfc0ccb60 0x7f8bfc159960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:58298/0 (socket says 172.21.15.57:58298) 2023-10-16T20:10:47.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.172+0000 7f8bf3fff640 1 -- 172.21.15.57:0/214978870 learned_addr learned my addr 172.21.15.57:0/214978870 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:47.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.189+0000 7f8bfb7fe640 1 --2- 172.21.15.57:0/214978870 >> v2:172.21.15.57:3300/0 conn(0x7f8bfc06b6a0 0x7f8bfc164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.190+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315077576 0 0) 0x7f8bfc06bde0 con 0x7f8bfc0ccb60 2023-10-16T20:10:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.190+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be8003520 con 0x7f8bfc0ccb60 2023-10-16T20:10:47.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449910557 0 0) 0x7f8be8003520 con 0x7f8bfc0ccb60 2023-10-16T20:10:47.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 >> v2:172.21.15.57:3300/0 conn(0x7f8bfc06b6a0 msgr2=0x7f8bfc164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:47.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 --2- 172.21.15.57:0/214978870 >> v2:172.21.15.57:3300/0 conn(0x7f8bfc06b6a0 0x7f8bfc164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 >> v1:172.21.15.57:6789/0 conn(0x7f8bfc0cc780 legacy=0x7f8bfc15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:47.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc06c0a0 con 0x7f8bfc0ccb60 2023-10-16T20:10:47.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f8be4001670 con 0x7f8bfc0ccb60 2023-10-16T20:10:47.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.199+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 >> v1:172.21.15.110:6789/0 conn(0x7f8bfc0ccb60 legacy=0x7f8bfc159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.200+0000 7f8bfa7fc640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be80039c0 0x7f8be8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.200+0000 7f8bfa7fc640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8be80047c0 0x7f8be8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.200+0000 7f8bfa7fc640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be8005180 0x7f8be800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.200+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be800c050 con 0x7f8be8005180 2023-10-16T20:10:47.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.200+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be800c190 con 0x7f8be80039c0 2023-10-16T20:10:47.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.200+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be800c350 con 0x7f8be80047c0 2023-10-16T20:10:47.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.201+0000 7f8bf3fff640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8be80047c0 0x7f8be8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.209+0000 7f8bfaffd640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be80039c0 0x7f8be8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.211+0000 7f8bf3fff640 1 -- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be80039c0 msgr2=0x7f8be8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:47.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.211+0000 7f8bf3fff640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8be80039c0 0x7f8be8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.211+0000 7f8bf3fff640 1 -- 172.21.15.57:0/214978870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be8005180 msgr2=0x7f8be800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.211+0000 7f8bf3fff640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be8005180 0x7f8be800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.211+0000 7f8bf3fff640 1 -- 172.21.15.57:0/214978870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8003520 con 0x7f8be80047c0 2023-10-16T20:10:47.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.211+0000 7f8bfb7fe640 1 -- 172.21.15.57:0/214978870 reap_dead start 2023-10-16T20:10:47.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.219+0000 7f8bf3fff640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8be80047c0 0x7f8be8004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c160 tx=0x7f8be80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f5d2bec9e6b1676 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.229+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4005ad0 con 0x7f8be80047c0 2023-10-16T20:10:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.229+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4005c30 con 0x7f8be80047c0 2023-10-16T20:10:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.229+0000 7f8bfa7fc640 1 -- 172.21.15.57:0/214978870 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be402c7c0 con 0x7f8be80047c0 2023-10-16T20:10:47.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.230+0000 7f8c018d7640 1 -- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8be80047c0 msgr2=0x7f8be8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.230+0000 7f8c018d7640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8be80047c0 0x7f8be8004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c160 tx=0x7f8be80057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.231+0000 7f8c018d7640 1 -- 172.21.15.57:0/214978870 shutdown_connections 2023-10-16T20:10:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.231+0000 7f8c018d7640 1 --2- 172.21.15.57:0/214978870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8be80047c0 0x7f8be8004c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.231+0000 7f8c018d7640 1 -- 172.21.15.57:0/214978870 >> 172.21.15.57:0/214978870 conn(0x7f8bfc0659d0 msgr2=0x7f8bfc065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:47.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.231+0000 7f8c018d7640 1 -- 172.21.15.57:0/214978870 shutdown_connections 2023-10-16T20:10:47.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.231+0000 7f8c018d7640 1 -- 172.21.15.57:0/214978870 wait complete. 2023-10-16T20:10:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.236+0000 7f8c018d7640 1 Processor -- start 2023-10-16T20:10:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.236+0000 7f8c018d7640 1 -- start start 2023-10-16T20:10:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.239+0000 7f8c018d7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80047c0 0x7f8bfc155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.239+0000 7f8c018d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bfc0b1780 0x7f8bfc0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.239+0000 7f8c018d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bfc158200 0x7f8bfc0c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.239+0000 7f8c018d7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc14f310 con 0x7f8be80047c0 2023-10-16T20:10:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.239+0000 7f8c018d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0c93c0 con 0x7f8bfc0b1780 2023-10-16T20:10:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.239+0000 7f8c018d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0bfac0 con 0x7f8bfc158200 2023-10-16T20:10:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.240+0000 7f8bfaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80047c0 0x7f8bfc155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.241+0000 7f8bf3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bfc0b1780 0x7f8bfc0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.241+0000 7f8bfb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bfc158200 0x7f8bfc0c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.241+0000 7f8bfaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80047c0 0x7f8bfc155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36126/0 (socket says 172.21.15.57:36126) 2023-10-16T20:10:47.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.241+0000 7f8bfaffd640 1 -- 172.21.15.57:0/1617054449 learned_addr learned my addr 172.21.15.57:0/1617054449 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:47.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.252+0000 7f8bfaffd640 1 -- 172.21.15.57:0/1617054449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bfc158200 msgr2=0x7f8bfc0c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.252+0000 7f8bfaffd640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bfc158200 0x7f8bfc0c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.252+0000 7f8bfaffd640 1 -- 172.21.15.57:0/1617054449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bfc0b1780 msgr2=0x7f8bfc0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.252+0000 7f8bfaffd640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bfc0b1780 0x7f8bfc0c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.252+0000 7f8bfaffd640 1 -- 172.21.15.57:0/1617054449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0c5370 con 0x7f8be80047c0 2023-10-16T20:10:47.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.258+0000 7f8bfaffd640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80047c0 0x7f8bfc155f00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00e470 tx=0x7f8bec00e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.270+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0135f0 con 0x7f8be80047c0 2023-10-16T20:10:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.270+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec013750 con 0x7f8be80047c0 2023-10-16T20:10:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.270+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec013ae0 con 0x7f8be80047c0 2023-10-16T20:10:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.270+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc0c90e0 con 0x7f8be80047c0 2023-10-16T20:10:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.271+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc0c5000 con 0x7f8be80047c0 2023-10-16T20:10:47.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.272+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bfc15b3c0 con 0x7f8be80047c0 2023-10-16T20:10:47.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.320+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8bec013c40 con 0x7f8be80047c0 2023-10-16T20:10:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.322+0000 7f8bf8ff9640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8bdc06aef0 0x7f8bdc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.322+0000 7f8bf3fff640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8bdc06aef0 0x7f8bdc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.324+0000 7f8bf3fff640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8bdc06aef0 0x7f8bdc06d3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8be4034000 tx=0x7f8be4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:47.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.332+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8bec058ef0 con 0x7f8be80047c0 2023-10-16T20:10:47.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.333+0000 7f8bf8ff9640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f8bdc073210 0x7f8bdc075690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.333+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 --> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bdc075d60 con 0x7f8bdc073210 2023-10-16T20:10:47.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.333+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bec013ef0 con 0x7f8be80047c0 2023-10-16T20:10:47.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.333+0000 7f8bfb7fe640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f8bdc073210 0x7f8bdc075690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.335+0000 7f8bfb7fe640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f8bdc073210 0x7f8bdc075690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:47.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.337+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== osd.2 v2:172.21.15.57:6810/3626764387 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8bdc075d60 con 0x7f8bdc073210 2023-10-16T20:10:47.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.358+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 --> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8bfc15b0e0 con 0x7f8bdc073210 2023-10-16T20:10:47.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.359+0000 7f8bf8ff9640 1 -- 172.21.15.57:0/1617054449 <== osd.2 v2:172.21.15.57:6810/3626764387 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8bf4009e10 con 0x7f8bdc073210 2023-10-16T20:10:47.362 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:47.362 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:47.362 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:47.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f8bdc073210 msgr2=0x7f8bdc075690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6810/3626764387,v1:172.21.15.57:6811/3626764387] conn(0x7f8bdc073210 0x7f8bdc075690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8bdc06aef0 msgr2=0x7f8bdc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f8bdc06aef0 0x7f8bdc06d3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8be4034000 tx=0x7f8be4009030 comp rx=0 tx=0).stop 2023-10-16T20:10:47.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80047c0 msgr2=0x7f8bfc155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 --2- 172.21.15.57:0/1617054449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80047c0 0x7f8bfc155f00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00e470 tx=0x7f8bec00e930 comp rx=0 tx=0).stop 2023-10-16T20:10:47.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8bfb7fe640 1 -- 172.21.15.57:0/1617054449 reap_dead start 2023-10-16T20:10:47.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.360+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 shutdown_connections 2023-10-16T20:10:47.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.361+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 >> 172.21.15.57:0/1617054449 conn(0x7f8bfc0659d0 msgr2=0x7f8bfc150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:47.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.361+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 shutdown_connections 2023-10-16T20:10:47.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.361+0000 7f8c018d7640 1 -- 172.21.15.57:0/1617054449 wait complete. 2023-10-16T20:10:47.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-16T20:10:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.617+0000 7f641adb6640 1 Processor -- start 2023-10-16T20:10:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.618+0000 7f641adb6640 1 -- start start 2023-10-16T20:10:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.620+0000 7f641adb6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6414151190 0x7f64140c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.620+0000 7f641adb6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64140c2aa0 0x7f641406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.620+0000 7f641adb6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6414151570 con 0x7f64140c12f0 2023-10-16T20:10:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.620+0000 7f641adb6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64140c4010 con 0x7f6414151190 2023-10-16T20:10:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.620+0000 7f641adb6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64140c1ce0 con 0x7f64140c2aa0 2023-10-16T20:10:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.621+0000 7f6418b52640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6414151190 0x7f64140c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.622+0000 7f6419353640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64140c2aa0 0x7f641406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.622+0000 7f6418b52640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6414151190 0x7f64140c2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36130/0 (socket says 172.21.15.57:36130) 2023-10-16T20:10:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.622+0000 7f6418b52640 1 -- 172.21.15.57:0/3964716937 learned_addr learned my addr 172.21.15.57:0/3964716937 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.626+0000 7f6418b52640 1 -- 172.21.15.57:0/3964716937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64140c2aa0 msgr2=0x7f641406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.626+0000 7f6418b52640 1 --2- 172.21.15.57:0/3964716937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64140c2aa0 0x7f641406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.626+0000 7f6418b52640 1 -- 172.21.15.57:0/3964716937 >> v1:172.21.15.57:6789/0 conn(0x7f64140c12f0 legacy=0x7f641406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.626+0000 7f6418b52640 1 -- 172.21.15.57:0/3964716937 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64140c5530 con 0x7f6414151190 2023-10-16T20:10:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.633+0000 7f6418b52640 1 --2- 172.21.15.57:0/3964716937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6414151190 0x7f64140c2560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64140c4150 tx=0x7f640802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa56eca5383b929c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.638+0000 7f64137fe640 1 -- 172.21.15.57:0/3964716937 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408030840 con 0x7f6414151190 2023-10-16T20:10:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.640+0000 7f64137fe640 1 -- 172.21.15.57:0/3964716937 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080309a0 con 0x7f6414151190 2023-10-16T20:10:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.640+0000 7f64137fe640 1 -- 172.21.15.57:0/3964716937 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408030d30 con 0x7f6414151190 2023-10-16T20:10:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.641+0000 7f641adb6640 1 -- 172.21.15.57:0/3964716937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6414151190 msgr2=0x7f64140c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.641+0000 7f641adb6640 1 --2- 172.21.15.57:0/3964716937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6414151190 0x7f64140c2560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64140c4150 tx=0x7f640802b980 comp rx=0 tx=0).stop 2023-10-16T20:10:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.642+0000 7f641adb6640 1 -- 172.21.15.57:0/3964716937 shutdown_connections 2023-10-16T20:10:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.642+0000 7f641adb6640 1 --2- 172.21.15.57:0/3964716937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64140c2aa0 0x7f641406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.642+0000 7f641adb6640 1 --2- 172.21.15.57:0/3964716937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6414151190 0x7f64140c2560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.642+0000 7f641adb6640 1 -- 172.21.15.57:0/3964716937 >> 172.21.15.57:0/3964716937 conn(0x7f641406c430 msgr2=0x7f6414069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.642+0000 7f641adb6640 1 -- 172.21.15.57:0/3964716937 shutdown_connections 2023-10-16T20:10:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.642+0000 7f641adb6640 1 -- 172.21.15.57:0/3964716937 wait complete. 2023-10-16T20:10:47.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.645+0000 7f641adb6640 1 Processor -- start 2023-10-16T20:10:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.646+0000 7f641adb6640 1 -- start start 2023-10-16T20:10:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.647+0000 7f641adb6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 0x7f64140ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.648+0000 7f641adb6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64140c2aa0 0x7f64141ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.648+0000 7f641adb6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6414151190 0x7f64141efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.648+0000 7f641adb6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6414153160 con 0x7f64140c12f0 2023-10-16T20:10:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.648+0000 7f641adb6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140c02d0 con 0x7f64140c2aa0 2023-10-16T20:10:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.648+0000 7f641adb6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6414154620 con 0x7f6414151190 2023-10-16T20:10:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.648+0000 7f6418b52640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 0x7f64140ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.649+0000 7f6418b52640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 0x7f64140ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36134/0 (socket says 172.21.15.57:36134) 2023-10-16T20:10:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.649+0000 7f6418b52640 1 -- 172.21.15.57:0/177767857 learned_addr learned my addr 172.21.15.57:0/177767857 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.650+0000 7f6419353640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6414151190 0x7f64141efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.650+0000 7f6413fff640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64140c2aa0 0x7f64141ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.653+0000 7f6418b52640 1 -- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6414151190 msgr2=0x7f64141efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.653+0000 7f6418b52640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6414151190 0x7f64141efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.653+0000 7f6418b52640 1 -- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64140c2aa0 msgr2=0x7f64141ef8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.653+0000 7f6418b52640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64140c2aa0 0x7f64141ef8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:47.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.653+0000 7f6418b52640 1 -- 172.21.15.57:0/177767857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080094d0 con 0x7f64140c12f0 2023-10-16T20:10:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.655+0000 7f6418b52640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 0x7f64140ca7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6408009960 tx=0x7f6408004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:47.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.660+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408039a90 con 0x7f64140c12f0 2023-10-16T20:10:47.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.660+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408039c10 con 0x7f64140c12f0 2023-10-16T20:10:47.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.660+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641415a6e0 con 0x7f64140c12f0 2023-10-16T20:10:47.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.660+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408043410 con 0x7f64140c12f0 2023-10-16T20:10:47.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.661+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64140c0520 con 0x7f64140c12f0 2023-10-16T20:10:47.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.662+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64141ef640 con 0x7f64140c12f0 2023-10-16T20:10:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.965+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f640804c3b0 con 0x7f64140c12f0 2023-10-16T20:10:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.967+0000 7f64117fa640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f63f806aec0 0x7f63f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:47.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.968+0000 7f6413fff640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f63f806aec0 0x7f63f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:47.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:47.969+0000 7f6413fff640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f63f806aec0 0x7f63f806d380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6414154930 tx=0x7f6400009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.009+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f640807add0 con 0x7f64140c12f0 2023-10-16T20:10:48.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.011+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6408077110 con 0x7f64140c12f0 2023-10-16T20:10:48.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.232+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f641415af20 con 0x7f63f806aec0 2023-10-16T20:10:48.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.233+0000 7f64117fa640 1 -- 172.21.15.57:0/177767857 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6400001c70 con 0x7f63f806aec0 2023-10-16T20:10:48.236 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2023-10-16T20:10:48.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f63f806aec0 msgr2=0x7f63f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f63f806aec0 0x7f63f806d380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6414154930 tx=0x7f6400009040 comp rx=0 tx=0).stop 2023-10-16T20:10:48.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 msgr2=0x7f64140ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 0x7f64140ca7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6408009960 tx=0x7f6408004730 comp rx=0 tx=0).stop 2023-10-16T20:10:48.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 shutdown_connections 2023-10-16T20:10:48.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f63f806aec0 0x7f63f806d380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6414151190 0x7f64141efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64140c2aa0 0x7f64141ef8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 --2- 172.21.15.57:0/177767857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64140c12f0 0x7f64140ca7c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 >> 172.21.15.57:0/177767857 conn(0x7f641406c430 msgr2=0x7f641406de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:48.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 shutdown_connections 2023-10-16T20:10:48.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.236+0000 7f641adb6640 1 -- 172.21.15.57:0/177767857 wait complete. 2023-10-16T20:10:48.257 INFO:tasks.ceph:Scrubbing osd.3 2023-10-16T20:10:48.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.487+0000 7ff01bd73640 1 Processor -- start 2023-10-16T20:10:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.488+0000 7ff01bd73640 1 -- start start 2023-10-16T20:10:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.489+0000 7ff01bd73640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff01406a050 0x7ff0140c1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.489+0000 7ff01bd73640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff01406a430 0x7ff01414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.489+0000 7ff01bd73640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0140c1c90 0x7ff01414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.489+0000 7ff01bd73640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff014159090 con 0x7ff01406a050 2023-10-16T20:10:48.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.489+0000 7ff01bd73640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0140c2be0 con 0x7ff01406a430 2023-10-16T20:10:48.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.489+0000 7ff01bd73640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff014159270 con 0x7ff0140c1c90 2023-10-16T20:10:48.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.490+0000 7ff019b0f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff01406a050 0x7ff0140c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.491+0000 7ff019b0f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff01406a050 0x7ff0140c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36142/0 (socket says 172.21.15.57:36142) 2023-10-16T20:10:48.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.491+0000 7ff019b0f640 1 -- 172.21.15.57:0/3746072019 learned_addr learned my addr 172.21.15.57:0/3746072019 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.492+0000 7ff01a310640 1 --2- 172.21.15.57:0/3746072019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0140c1c90 0x7ff01414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.492+0000 7ff01930e640 1 --2- 172.21.15.57:0/3746072019 >> v2:172.21.15.110:3300/0 conn(0x7ff01406a430 0x7ff01414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.493+0000 7ff019b0f640 1 -- 172.21.15.57:0/3746072019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0140c1c90 msgr2=0x7ff01414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:48.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.493+0000 7ff019b0f640 1 --2- 172.21.15.57:0/3746072019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0140c1c90 0x7ff01414ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.493+0000 7ff019b0f640 1 -- 172.21.15.57:0/3746072019 >> v2:172.21.15.110:3300/0 conn(0x7ff01406a430 msgr2=0x7ff01414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:48.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.493+0000 7ff019b0f640 1 --2- 172.21.15.57:0/3746072019 >> v2:172.21.15.110:3300/0 conn(0x7ff01406a430 0x7ff01414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.493+0000 7ff019b0f640 1 -- 172.21.15.57:0/3746072019 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014159510 con 0x7ff01406a050 2023-10-16T20:10:48.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.496+0000 7ff019b0f640 1 --2- 172.21.15.57:0/3746072019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff01406a050 0x7ff0140c1750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0140ca210 tx=0x7ff01002db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a656bf9bf922eee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.501+0000 7ff018b0d640 1 -- 172.21.15.57:0/3746072019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01002e940 con 0x7ff01406a050 2023-10-16T20:10:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.501+0000 7ff018b0d640 1 -- 172.21.15.57:0/3746072019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01002eaa0 con 0x7ff01406a050 2023-10-16T20:10:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.501+0000 7ff018b0d640 1 -- 172.21.15.57:0/3746072019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01002ee30 con 0x7ff01406a050 2023-10-16T20:10:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 -- 172.21.15.57:0/3746072019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff01406a050 msgr2=0x7ff0140c1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3746072019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff01406a050 0x7ff0140c1750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0140ca210 tx=0x7ff01002db90 comp rx=0 tx=0).stop 2023-10-16T20:10:48.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 -- 172.21.15.57:0/3746072019 shutdown_connections 2023-10-16T20:10:48.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3746072019 >> v2:172.21.15.110:3300/0 conn(0x7ff01406a430 0x7ff01414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3746072019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0140c1c90 0x7ff01414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3746072019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff01406a050 0x7ff0140c1750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.502+0000 7ff01bd73640 1 -- 172.21.15.57:0/3746072019 >> 172.21.15.57:0/3746072019 conn(0x7ff0140ca350 msgr2=0x7ff0140ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:48.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.503+0000 7ff01bd73640 1 -- 172.21.15.57:0/3746072019 shutdown_connections 2023-10-16T20:10:48.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.503+0000 7ff01bd73640 1 -- 172.21.15.57:0/3746072019 wait complete. 2023-10-16T20:10:48.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.505+0000 7ff01bd73640 1 Processor -- start 2023-10-16T20:10:48.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.505+0000 7ff01bd73640 1 -- start start 2023-10-16T20:10:48.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.506+0000 7ff01bd73640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01406a050 0x7ff014148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.506+0000 7ff01bd73640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff01406a430 0x7ff0141504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.506+0000 7ff01bd73640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0140c1c90 0x7ff014144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.506+0000 7ff01bd73640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0141473a0 con 0x7ff0140c1c90 2023-10-16T20:10:48.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.506+0000 7ff01bd73640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014152450 con 0x7ff01406a050 2023-10-16T20:10:48.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.506+0000 7ff01bd73640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff014147ed0 con 0x7ff01406a430 2023-10-16T20:10:48.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.507+0000 7ff01a310640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0140c1c90 0x7ff014144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.507+0000 7ff01a310640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0140c1c90 0x7ff014144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36158/0 (socket says 172.21.15.57:36158) 2023-10-16T20:10:48.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.507+0000 7ff01a310640 1 -- 172.21.15.57:0/3849597396 learned_addr learned my addr 172.21.15.57:0/3849597396 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:48.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.508+0000 7ff019b0f640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01406a050 0x7ff014148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.508+0000 7ff01930e640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff01406a430 0x7ff0141504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.511+0000 7ff01a310640 1 -- 172.21.15.57:0/3849597396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff01406a430 msgr2=0x7ff0141504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.511+0000 7ff01a310640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff01406a430 0x7ff0141504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.511+0000 7ff01a310640 1 -- 172.21.15.57:0/3849597396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01406a050 msgr2=0x7ff014148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.511+0000 7ff01a310640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01406a050 0x7ff014148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.511+0000 7ff01a310640 1 -- 172.21.15.57:0/3849597396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100094d0 con 0x7ff0140c1c90 2023-10-16T20:10:48.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.514+0000 7ff01a310640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0140c1c90 0x7ff014144b70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff00c007e90 tx=0x7ff00c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.520+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c014420 con 0x7ff0140c1c90 2023-10-16T20:10:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.520+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c014580 con 0x7ff0140c1c90 2023-10-16T20:10:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.520+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c014930 con 0x7ff0140c1c90 2023-10-16T20:10:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.520+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff014146b40 con 0x7ff0140c1c90 2023-10-16T20:10:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.520+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0141470c0 con 0x7ff0140c1c90 2023-10-16T20:10:48.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.522+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff014159ad0 con 0x7ff0140c1c90 2023-10-16T20:10:48.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.545+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff00c014a90 con 0x7ff0140c1c90 2023-10-16T20:10:48.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.547+0000 7ff00a7fc640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feff806aef0 0x7feff806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.547+0000 7ff019b0f640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feff806aef0 0x7feff806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.549+0000 7ff019b0f640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feff806aef0 0x7feff806d3b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff010038000 tx=0x7ff010032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.552+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff00c059c20 con 0x7ff0140c1c90 2023-10-16T20:10:48.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.553+0000 7ff00a7fc640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7feff8073210 0x7feff8075690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.553+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 --> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feff8075d60 con 0x7feff8073210 2023-10-16T20:10:48.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.553+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff00c055860 con 0x7ff0140c1c90 2023-10-16T20:10:48.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.553+0000 7ff01930e640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7feff8073210 0x7feff8075690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.554+0000 7ff01930e640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7feff8073210 0x7feff8075690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.555+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== osd.3 v2:172.21.15.57:6826/1613164107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7feff8075d60 con 0x7feff8073210 2023-10-16T20:10:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.573+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 --> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff0141597f0 con 0x7feff8073210 2023-10-16T20:10:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.574+0000 7ff00a7fc640 1 -- 172.21.15.57:0/3849597396 <== osd.3 v2:172.21.15.57:6826/1613164107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff0040076f0 con 0x7feff8073210 2023-10-16T20:10:48.577 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:48.577 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.574+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7feff8073210 msgr2=0x7feff8075690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.574+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6826/1613164107,v1:172.21.15.57:6827/1613164107] conn(0x7feff8073210 0x7feff8075690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feff806aef0 msgr2=0x7feff806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7feff806aef0 0x7feff806d3b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff010038000 tx=0x7ff010032000 comp rx=0 tx=0).stop 2023-10-16T20:10:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0140c1c90 msgr2=0x7ff014144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 --2- 172.21.15.57:0/3849597396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0140c1c90 0x7ff014144b70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff00c007e90 tx=0x7ff00c00e4b0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01a310640 1 -- 172.21.15.57:0/3849597396 reap_dead start 2023-10-16T20:10:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 shutdown_connections 2023-10-16T20:10:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 >> 172.21.15.57:0/3849597396 conn(0x7ff0140ca350 msgr2=0x7ff014156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 shutdown_connections 2023-10-16T20:10:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.575+0000 7ff01bd73640 1 -- 172.21.15.57:0/3849597396 wait complete. 2023-10-16T20:10:48.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-16T20:10:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.826+0000 7fd38c4da640 1 Processor -- start 2023-10-16T20:10:48.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.827+0000 7fd38c4da640 1 -- start start 2023-10-16T20:10:48.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.828+0000 7fd38c4da640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.828+0000 7fd38c4da640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3841578d0 0x7fd3840c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.828+0000 7fd38c4da640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3841618b0 con 0x7fd3840c5930 2023-10-16T20:10:48.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.828+0000 7fd38c4da640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38415e360 con 0x7fd3841578d0 2023-10-16T20:10:48.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.828+0000 7fd38c4da640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384160d30 con 0x7fd3840c5550 2023-10-16T20:10:48.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.829+0000 7fd38aa77640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3841578d0 0x7fd3840c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.830+0000 7fd38a276640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.830+0000 7fd38aa77640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3841578d0 0x7fd3840c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36164/0 (socket says 172.21.15.57:36164) 2023-10-16T20:10:48.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.830+0000 7fd38aa77640 1 -- 172.21.15.57:0/1029919227 learned_addr learned my addr 172.21.15.57:0/1029919227 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.834+0000 7fd38aa77640 1 -- 172.21.15.57:0/1029919227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 msgr2=0x7fd38415de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.834+0000 7fd38aa77640 1 --2- 172.21.15.57:0/1029919227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.834+0000 7fd38aa77640 1 -- 172.21.15.57:0/1029919227 >> v1:172.21.15.57:6789/0 conn(0x7fd3840c5930 legacy=0x7fd3841571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.834+0000 7fd38aa77640 1 -- 172.21.15.57:0/1029919227 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384161010 con 0x7fd3841578d0 2023-10-16T20:10:48.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.838+0000 7fd38aa77640 1 --2- 172.21.15.57:0/1029919227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3841578d0 0x7fd3840c6e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009e50 tx=0x7fd37c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff21241735104d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.845+0000 7fd389274640 1 -- 172.21.15.57:0/1029919227 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c02cb00 con 0x7fd3841578d0 2023-10-16T20:10:48.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.845+0000 7fd389274640 1 -- 172.21.15.57:0/1029919227 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c02cc60 con 0x7fd3841578d0 2023-10-16T20:10:48.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.845+0000 7fd389274640 1 -- 172.21.15.57:0/1029919227 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0343f0 con 0x7fd3841578d0 2023-10-16T20:10:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.846+0000 7fd38c4da640 1 -- 172.21.15.57:0/1029919227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3841578d0 msgr2=0x7fd3840c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.846+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1029919227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3841578d0 0x7fd3840c6e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009e50 tx=0x7fd37c02bf60 comp rx=0 tx=0).stop 2023-10-16T20:10:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.846+0000 7fd38c4da640 1 -- 172.21.15.57:0/1029919227 shutdown_connections 2023-10-16T20:10:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.846+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1029919227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3841578d0 0x7fd3840c6e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.846+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1029919227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.847+0000 7fd38c4da640 1 -- 172.21.15.57:0/1029919227 >> 172.21.15.57:0/1029919227 conn(0x7fd38406c430 msgr2=0x7fd384069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.847+0000 7fd38c4da640 1 -- 172.21.15.57:0/1029919227 shutdown_connections 2023-10-16T20:10:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.847+0000 7fd38c4da640 1 -- 172.21.15.57:0/1029919227 wait complete. 2023-10-16T20:10:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.849+0000 7fd38c4da640 1 Processor -- start 2023-10-16T20:10:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.849+0000 7fd38c4da640 1 -- start start 2023-10-16T20:10:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.850+0000 7fd38c4da640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.850+0000 7fd38c4da640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 0x7fd38414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.850+0000 7fd38c4da640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3841578d0 0x7fd3841f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.850+0000 7fd38c4da640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840c3500 con 0x7fd3840c5930 2023-10-16T20:10:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.850+0000 7fd38c4da640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38414b010 con 0x7fd3841578d0 2023-10-16T20:10:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.850+0000 7fd38c4da640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841f2610 con 0x7fd3840c5550 2023-10-16T20:10:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.851+0000 7fd389a75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 0x7fd38414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.851+0000 7fd389a75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 0x7fd38414aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36174/0 (socket says 172.21.15.57:36174) 2023-10-16T20:10:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.851+0000 7fd389a75640 1 -- 172.21.15.57:0/1000785777 learned_addr learned my addr 172.21.15.57:0/1000785777 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.852+0000 7fd38aa77640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3841578d0 0x7fd3841f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.852+0000 7fd38a276640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.856+0000 7fd389a75640 1 -- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 msgr2=0x7fd38415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.856+0000 7fd389a75640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.856+0000 7fd389a75640 1 -- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3841578d0 msgr2=0x7fd3841f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.856+0000 7fd389a75640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3841578d0 0x7fd3841f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.856+0000 7fd389a75640 1 -- 172.21.15.57:0/1000785777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c009b30 con 0x7fd3840c5930 2023-10-16T20:10:48.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.859+0000 7fd389a75640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 0x7fd38414aad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c400 tx=0x7fd37400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:48.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.865+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740052d0 con 0x7fd3840c5930 2023-10-16T20:10:48.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.866+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374005430 con 0x7fd3840c5930 2023-10-16T20:10:48.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.866+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374003830 con 0x7fd3840c5930 2023-10-16T20:10:48.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.866+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3841f28f0 con 0x7fd3840c5930 2023-10-16T20:10:48.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.866+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3841f2eb0 con 0x7fd3840c5930 2023-10-16T20:10:48.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.867+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3841f30d0 con 0x7fd3840c5930 2023-10-16T20:10:48.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.889+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd374003990 con 0x7fd3840c5930 2023-10-16T20:10:48.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.891+0000 7fd37affd640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd36806aec0 0x7fd36806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:48.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.891+0000 7fd38a276640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd36806aec0 0x7fd36806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:48.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:48.892+0000 7fd38a276640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd36806aec0 0x7fd36806d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd380009aa0 tx=0x7fd380009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:49.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.212+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd374057df0 con 0x7fd3840c5930 2023-10-16T20:10:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.213+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd374054130 con 0x7fd3840c5930 2023-10-16T20:10:49.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.437+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3840c6250 con 0x7fd36806aec0 2023-10-16T20:10:49.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.438+0000 7fd37affd640 1 -- 172.21.15.57:0/1000785777 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3840c6250 con 0x7fd36806aec0 2023-10-16T20:10:49.441 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2023-10-16T20:10:49.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd36806aec0 msgr2=0x7fd36806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd36806aec0 0x7fd36806d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd380009aa0 tx=0x7fd380009190 comp rx=0 tx=0).stop 2023-10-16T20:10:49.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 msgr2=0x7fd38414aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 0x7fd38414aad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c400 tx=0x7fd37400c8c0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 shutdown_connections 2023-10-16T20:10:49.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fd36806aec0 0x7fd36806d380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3841578d0 0x7fd3841f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3840c5930 0x7fd38414aad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 --2- 172.21.15.57:0/1000785777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c5550 0x7fd38415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 >> 172.21.15.57:0/1000785777 conn(0x7fd38406c430 msgr2=0x7fd384070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:49.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 shutdown_connections 2023-10-16T20:10:49.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.442+0000 7fd38c4da640 1 -- 172.21.15.57:0/1000785777 wait complete. 2023-10-16T20:10:49.463 INFO:tasks.ceph:Scrubbing osd.4 2023-10-16T20:10:49.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.693+0000 7fb667561640 1 Processor -- start 2023-10-16T20:10:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.694+0000 7fb667561640 1 -- start start 2023-10-16T20:10:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.695+0000 7fb667561640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb66006a050 0x7fb6600c1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.695+0000 7fb667561640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb66006a430 0x7fb66014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.695+0000 7fb667561640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb660159270 con 0x7fb6600c1c90 2023-10-16T20:10:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.695+0000 7fb667561640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb660159090 con 0x7fb66006a430 2023-10-16T20:10:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.695+0000 7fb667561640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600c2be0 con 0x7fb66006a050 2023-10-16T20:10:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.696+0000 7fb664afc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb66006a430 0x7fb66014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.697+0000 7fb664afc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb66006a430 0x7fb66014fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36190/0 (socket says 172.21.15.57:36190) 2023-10-16T20:10:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.697+0000 7fb664afc640 1 -- 172.21.15.57:0/3006342085 learned_addr learned my addr 172.21.15.57:0/3006342085 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.700+0000 7fb664afc640 1 -- 172.21.15.57:0/3006342085 >> v2:172.21.15.110:3300/0 conn(0x7fb66006a050 msgr2=0x7fb6600c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.700+0000 7fb664afc640 1 --2- 172.21.15.57:0/3006342085 >> v2:172.21.15.110:3300/0 conn(0x7fb66006a050 0x7fb6600c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.700+0000 7fb664afc640 1 -- 172.21.15.57:0/3006342085 >> v1:172.21.15.110:6789/0 conn(0x7fb6600c1c90 legacy=0x7fb6600c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.700+0000 7fb664afc640 1 -- 172.21.15.57:0/3006342085 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660159510 con 0x7fb66006a430 2023-10-16T20:10:49.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.703+0000 7fb664afc640 1 --2- 172.21.15.57:0/3006342085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a430 0x7fb66014fa20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb66006ac00 tx=0x7fb65002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d97896e9923f448 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.706+0000 7fb657fff640 1 -- 172.21.15.57:0/3006342085 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650030860 con 0x7fb66006a430 2023-10-16T20:10:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.706+0000 7fb657fff640 1 -- 172.21.15.57:0/3006342085 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6500309c0 con 0x7fb66006a430 2023-10-16T20:10:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.706+0000 7fb657fff640 1 -- 172.21.15.57:0/3006342085 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650030d50 con 0x7fb66006a430 2023-10-16T20:10:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 -- 172.21.15.57:0/3006342085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a430 msgr2=0x7fb66014fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 --2- 172.21.15.57:0/3006342085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a430 0x7fb66014fa20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb66006ac00 tx=0x7fb65002b9a0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 -- 172.21.15.57:0/3006342085 shutdown_connections 2023-10-16T20:10:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 --2- 172.21.15.57:0/3006342085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a430 0x7fb66014fa20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 --2- 172.21.15.57:0/3006342085 >> v2:172.21.15.110:3300/0 conn(0x7fb66006a050 0x7fb6600c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 -- 172.21.15.57:0/3006342085 >> 172.21.15.57:0/3006342085 conn(0x7fb6600ca350 msgr2=0x7fb6600ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 -- 172.21.15.57:0/3006342085 shutdown_connections 2023-10-16T20:10:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.707+0000 7fb667561640 1 -- 172.21.15.57:0/3006342085 wait complete. 2023-10-16T20:10:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.709+0000 7fb667561640 1 Processor -- start 2023-10-16T20:10:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.710+0000 7fb667561640 1 -- start start 2023-10-16T20:10:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb667561640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a050 0x7fb660142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb667561640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66006a430 0x7fb6601f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb667561640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6600c1c90 0x7fb6601f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb667561640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601586f0 con 0x7fb66006a050 2023-10-16T20:10:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb667561640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660157780 con 0x7fb66006a430 2023-10-16T20:10:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb667561640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601510a0 con 0x7fb6600c1c90 2023-10-16T20:10:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.711+0000 7fb6652fd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a050 0x7fb660142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.712+0000 7fb6652fd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a050 0x7fb660142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36200/0 (socket says 172.21.15.57:36200) 2023-10-16T20:10:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.712+0000 7fb6652fd640 1 -- 172.21.15.57:0/3120840116 learned_addr learned my addr 172.21.15.57:0/3120840116 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.716+0000 7fb6652fd640 1 -- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6600c1c90 msgr2=0x7fb6601f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.716+0000 7fb6652fd640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6600c1c90 0x7fb6601f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.716+0000 7fb6652fd640 1 -- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66006a430 msgr2=0x7fb6601f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.716+0000 7fb6652fd640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66006a430 0x7fb6601f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.716+0000 7fb6652fd640 1 -- 172.21.15.57:0/3120840116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500094d0 con 0x7fb66006a050 2023-10-16T20:10:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.730+0000 7fb6652fd640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a050 0x7fb660142720 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00b4a0 tx=0x7fb65c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.736+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c010610 con 0x7fb66006a050 2023-10-16T20:10:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.736+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c010770 con 0x7fb66006a050 2023-10-16T20:10:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.736+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c010b20 con 0x7fb66006a050 2023-10-16T20:10:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.736+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb660143390 con 0x7fb66006a050 2023-10-16T20:10:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.736+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6601f2810 con 0x7fb66006a050 2023-10-16T20:10:49.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.737+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb660159ad0 con 0x7fb66006a050 2023-10-16T20:10:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.768+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb65c010c80 con 0x7fb66006a050 2023-10-16T20:10:49.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.770+0000 7fb655ffb640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb64406aec0 0x7fb64406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.770+0000 7fb664afc640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb64406aec0 0x7fb64406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:49.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.772+0000 7fb664afc640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb64406aec0 0x7fb64406d380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb650036000 tx=0x7fb65003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.776+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb65c058cc0 con 0x7fb66006a050 2023-10-16T20:10:49.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.776+0000 7fb655ffb640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7fb6440731e0 0x7fb644075660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:49.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.776+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 --> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb644075d30 con 0x7fb6440731e0 2023-10-16T20:10:49.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.776+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb65c054900 con 0x7fb66006a050 2023-10-16T20:10:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.777+0000 7fb665afe640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7fb6440731e0 0x7fb644075660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.778+0000 7fb665afe640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7fb6440731e0 0x7fb644075660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:49.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.780+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== osd.4 v2:172.21.15.110:6800/1242957558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb644075d30 con 0x7fb6440731e0 2023-10-16T20:10:49.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.800+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 --> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb6601597f0 con 0x7fb6440731e0 2023-10-16T20:10:49.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.801+0000 7fb655ffb640 1 -- 172.21.15.57:0/3120840116 <== osd.4 v2:172.21.15.110:6800/1242957558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb65800ac90 con 0x7fb6440731e0 2023-10-16T20:10:49.804 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:49.804 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:49.804 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:49.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.802+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7fb6440731e0 msgr2=0x7fb644075660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.802+0000 7fb667561640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.110:6800/1242957558,v1:172.21.15.110:6801/1242957558] conn(0x7fb6440731e0 0x7fb644075660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.802+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb64406aec0 msgr2=0x7fb64406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.802+0000 7fb667561640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb64406aec0 0x7fb64406d380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb650036000 tx=0x7fb65003b040 comp rx=0 tx=0).stop 2023-10-16T20:10:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a050 msgr2=0x7fb660142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb667561640 1 --2- 172.21.15.57:0/3120840116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb66006a050 0x7fb660142720 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00b4a0 tx=0x7fb65c00b960 comp rx=0 tx=0).stop 2023-10-16T20:10:49.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb665afe640 1 -- 172.21.15.57:0/3120840116 reap_dead start 2023-10-16T20:10:49.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 shutdown_connections 2023-10-16T20:10:49.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 >> 172.21.15.57:0/3120840116 conn(0x7fb6600ca350 msgr2=0x7fb6600c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:49.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 shutdown_connections 2023-10-16T20:10:49.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:49.803+0000 7fb667561640 1 -- 172.21.15.57:0/3120840116 wait complete. 2023-10-16T20:10:49.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-16T20:10:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.047+0000 7f3c7cc46640 1 Processor -- start 2023-10-16T20:10:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.047+0000 7f3c7cc46640 1 -- start start 2023-10-16T20:10:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.049+0000 7f3c7cc46640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c78159a10 0x7f3c780c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.049+0000 7f3c7cc46640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c78159ec0 con 0x7f3c7815d1c0 2023-10-16T20:10:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.049+0000 7f3c7cc46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7815cd30 con 0x7f3c78153110 2023-10-16T20:10:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.049+0000 7f3c7cc46640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780c6250 con 0x7f3c78159a10 2023-10-16T20:10:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.050+0000 7f3c76d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c78159a10 0x7f3c780c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.050+0000 7f3c76d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c78159a10 0x7f3c780c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36204/0 (socket says 172.21.15.57:36204) 2023-10-16T20:10:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.050+0000 7f3c76d9d640 1 -- 172.21.15.57:0/4152643475 learned_addr learned my addr 172.21.15.57:0/4152643475 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.053+0000 7f3c76d9d640 1 -- 172.21.15.57:0/4152643475 >> v1:172.21.15.110:6789/0 conn(0x7f3c78153110 legacy=0x7f3c780bc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.053+0000 7f3c76d9d640 1 -- 172.21.15.57:0/4152643475 >> v1:172.21.15.57:6789/0 conn(0x7f3c7815d1c0 legacy=0x7f3c780c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.053+0000 7f3c76d9d640 1 -- 172.21.15.57:0/4152643475 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780c78f0 con 0x7f3c78159a10 2023-10-16T20:10:50.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.057+0000 7f3c76d9d640 1 --2- 172.21.15.57:0/4152643475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780c6b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009e50 tx=0x7f3c7002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64385e0550696b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:50.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.062+0000 7f3c75d9b640 1 -- 172.21.15.57:0/4152643475 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7002cbb0 con 0x7f3c78159a10 2023-10-16T20:10:50.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.062+0000 7f3c75d9b640 1 -- 172.21.15.57:0/4152643475 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7002cd10 con 0x7f3c78159a10 2023-10-16T20:10:50.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.062+0000 7f3c75d9b640 1 -- 172.21.15.57:0/4152643475 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70034610 con 0x7f3c78159a10 2023-10-16T20:10:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 -- 172.21.15.57:0/4152643475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 msgr2=0x7f3c780c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/4152643475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780c6b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009e50 tx=0x7f3c7002c010 comp rx=0 tx=0).stop 2023-10-16T20:10:50.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 -- 172.21.15.57:0/4152643475 shutdown_connections 2023-10-16T20:10:50.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/4152643475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780c6b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 -- 172.21.15.57:0/4152643475 >> 172.21.15.57:0/4152643475 conn(0x7f3c7806c430 msgr2=0x7f3c78069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:50.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 -- 172.21.15.57:0/4152643475 shutdown_connections 2023-10-16T20:10:50.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.063+0000 7f3c7cc46640 1 -- 172.21.15.57:0/4152643475 wait complete. 2023-10-16T20:10:50.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.065+0000 7f3c7cc46640 1 Processor -- start 2023-10-16T20:10:50.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.065+0000 7f3c7cc46640 1 -- start start 2023-10-16T20:10:50.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.066+0000 7f3c7cc46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c78153110 0x7f3c781580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.066+0000 7f3c7cc46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780bea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.066+0000 7f3c7cc46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c7815d1c0 0x7f3c7814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.066+0000 7f3c7cc46640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c781f2540 con 0x7f3c78159a10 2023-10-16T20:10:50.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.066+0000 7f3c7cc46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c781f2810 con 0x7f3c78153110 2023-10-16T20:10:50.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.066+0000 7f3c7cc46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78154cd0 con 0x7f3c7815d1c0 2023-10-16T20:10:50.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.067+0000 7f3c6ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.068+0000 7f3c6ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36206/0 (socket says 172.21.15.57:36206) 2023-10-16T20:10:50.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.068+0000 7f3c6ffff640 1 -- 172.21.15.57:0/2011799135 learned_addr learned my addr 172.21.15.57:0/2011799135 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:50.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.068+0000 7f3c76d9d640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c7815d1c0 0x7f3c7814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.068+0000 7f3c7659c640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c78153110 0x7f3c781580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.071+0000 7f3c6ffff640 1 -- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c7815d1c0 msgr2=0x7f3c7814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.071+0000 7f3c6ffff640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c7815d1c0 0x7f3c7814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.071+0000 7f3c6ffff640 1 -- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c78153110 msgr2=0x7f3c781580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.071+0000 7f3c6ffff640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c78153110 0x7f3c781580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.071+0000 7f3c6ffff640 1 -- 172.21.15.57:0/2011799135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70009b30 con 0x7f3c78159a10 2023-10-16T20:10:50.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.074+0000 7f3c6ffff640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780bea00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000b3f0 tx=0x7f3c6000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:50.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.078+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60011830 con 0x7f3c78159a10 2023-10-16T20:10:50.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.078+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60011990 con 0x7f3c78159a10 2023-10-16T20:10:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.078+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60011d40 con 0x7f3c78159a10 2023-10-16T20:10:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.078+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78154fb0 con 0x7f3c78159a10 2023-10-16T20:10:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.078+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780be4e0 con 0x7f3c78159a10 2023-10-16T20:10:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.080+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c78154a40 con 0x7f3c78159a10 2023-10-16T20:10:50.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.102+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c60004020 con 0x7f3c78159a10 2023-10-16T20:10:50.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.103+0000 7f3c6effd640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3c5806aec0 0x7f3c5806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.103+0000 7f3c7659c640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3c5806aec0 0x7f3c5806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.104+0000 7f3c7659c640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3c5806aec0 0x7f3c5806d380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f60 tx=0x7f3c68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:50.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.105+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3c60058d20 con 0x7f3c78159a10 2023-10-16T20:10:50.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.413+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c60054960 con 0x7f3c78159a10 2023-10-16T20:10:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.618+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c780c5f70 con 0x7f3c5806aec0 2023-10-16T20:10:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.620+0000 7f3c6effd640 1 -- 172.21.15.57:0/2011799135 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c68001c70 con 0x7f3c5806aec0 2023-10-16T20:10:50.622 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2023-10-16T20:10:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.622+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3c5806aec0 msgr2=0x7f3c5806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.622+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3c5806aec0 0x7f3c5806d380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f60 tx=0x7f3c68009040 comp rx=0 tx=0).stop 2023-10-16T20:10:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.622+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 msgr2=0x7f3c780bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.622+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780bea00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000b3f0 tx=0x7f3c6000b8b0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 shutdown_connections 2023-10-16T20:10:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3c5806aec0 0x7f3c5806d380 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c7815d1c0 0x7f3c7814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c78159a10 0x7f3c780bea00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 --2- 172.21.15.57:0/2011799135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c78153110 0x7f3c781580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 >> 172.21.15.57:0/2011799135 conn(0x7f3c7806c430 msgr2=0x7f3c781513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 shutdown_connections 2023-10-16T20:10:50.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.623+0000 7f3c7cc46640 1 -- 172.21.15.57:0/2011799135 wait complete. 2023-10-16T20:10:50.645 INFO:tasks.ceph:Scrubbing osd.5 2023-10-16T20:10:50.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.868+0000 7fb3a0fc5640 1 Processor -- start 2023-10-16T20:10:50.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.868+0000 7fb3a0fc5640 1 -- start start 2023-10-16T20:10:50.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.870+0000 7fb3a0fc5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 0x7fb39c14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.870+0000 7fb3a0fc5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb39c0c4cd0 0x7fb39c14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.870+0000 7fb3a0fc5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c159270 con 0x7fb39c06a050 2023-10-16T20:10:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.870+0000 7fb3a0fc5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c159090 con 0x7fb39c0c4cd0 2023-10-16T20:10:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.870+0000 7fb3a0fc5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0c2be0 con 0x7fb39c06a430 2023-10-16T20:10:50.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.897+0000 7fb393fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 0x7fb39c14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.898+0000 7fb393fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 0x7fb39c14fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:42720/0 (socket says 172.21.15.57:42720) 2023-10-16T20:10:50.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.898+0000 7fb393fff640 1 -- 172.21.15.57:0/3213964046 learned_addr learned my addr 172.21.15.57:0/3213964046 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:50.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.902+0000 7fb393fff640 1 -- 172.21.15.57:0/3213964046 >> v2:172.21.15.110:3300/0 conn(0x7fb39c0c4cd0 msgr2=0x7fb39c14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:50.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.902+0000 7fb393fff640 1 --2- 172.21.15.57:0/3213964046 >> v2:172.21.15.110:3300/0 conn(0x7fb39c0c4cd0 0x7fb39c14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.902+0000 7fb393fff640 1 -- 172.21.15.57:0/3213964046 >> v1:172.21.15.110:6789/0 conn(0x7fb39c06a050 legacy=0x7fb39c0c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:50.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.902+0000 7fb393fff640 1 -- 172.21.15.57:0/3213964046 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c159510 con 0x7fb39c06a430 2023-10-16T20:10:50.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.906+0000 7fb393fff640 1 --2- 172.21.15.57:0/3213964046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 0x7fb39c14fa20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb384009870 tx=0x7fb38402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b98030f63838797 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:50.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.911+0000 7fb399d9b640 1 -- 172.21.15.57:0/3213964046 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384030840 con 0x7fb39c06a430 2023-10-16T20:10:50.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.911+0000 7fb399d9b640 1 -- 172.21.15.57:0/3213964046 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840309a0 con 0x7fb39c06a430 2023-10-16T20:10:50.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.911+0000 7fb399d9b640 1 -- 172.21.15.57:0/3213964046 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384030d30 con 0x7fb39c06a430 2023-10-16T20:10:50.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.912+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/3213964046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 msgr2=0x7fb39c14fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.912+0000 7fb3a0fc5640 1 --2- 172.21.15.57:0/3213964046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 0x7fb39c14fa20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb384009870 tx=0x7fb38402b980 comp rx=0 tx=0).stop 2023-10-16T20:10:50.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.913+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/3213964046 shutdown_connections 2023-10-16T20:10:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.913+0000 7fb3a0fc5640 1 --2- 172.21.15.57:0/3213964046 >> v2:172.21.15.110:3300/0 conn(0x7fb39c0c4cd0 0x7fb39c14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.913+0000 7fb3a0fc5640 1 --2- 172.21.15.57:0/3213964046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c06a430 0x7fb39c14fa20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.913+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/3213964046 >> 172.21.15.57:0/3213964046 conn(0x7fb39c0ca350 msgr2=0x7fb39c0ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.913+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/3213964046 shutdown_connections 2023-10-16T20:10:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.913+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/3213964046 wait complete. 2023-10-16T20:10:50.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.916+0000 7fb3a0fc5640 1 Processor -- start 2023-10-16T20:10:50.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.916+0000 7fb3a0fc5640 1 -- start start 2023-10-16T20:10:50.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.917+0000 7fb3a0fc5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb39c06a050 0x7fb39c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.917+0000 7fb3a0fc5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb39c06a430 0x7fb39c0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.917+0000 7fb3a0fc5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c0c4cd0 0x7fb39c1e2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.917+0000 7fb3a0fc5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0c8e80 con 0x7fb39c06a050 2023-10-16T20:10:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.917+0000 7fb3a0fc5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1e3830 con 0x7fb39c06a430 2023-10-16T20:10:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.917+0000 7fb3a0fc5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c14ed10 con 0x7fb39c0c4cd0 2023-10-16T20:10:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.918+0000 7fb39a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb39c06a050 0x7fb39c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.919+0000 7fb39a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb39c06a050 0x7fb39c0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36214/0 (socket says 172.21.15.57:36214) 2023-10-16T20:10:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.919+0000 7fb39a59c640 1 -- 172.21.15.57:0/503083749 learned_addr learned my addr 172.21.15.57:0/503083749 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.922+0000 7fb39a59c640 1 -- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c0c4cd0 msgr2=0x7fb39c1e2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.922+0000 7fb39a59c640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb39c0c4cd0 0x7fb39c1e2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.922+0000 7fb39a59c640 1 -- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb39c06a430 msgr2=0x7fb39c0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.922+0000 7fb39a59c640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb39c06a430 0x7fb39c0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.922+0000 7fb39a59c640 1 -- 172.21.15.57:0/503083749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840094d0 con 0x7fb39c06a050 2023-10-16T20:10:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.928+0000 7fb39a59c640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb39c06a050 0x7fb39c0c6fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c440 tx=0x7fb38c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:50.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.943+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c005480 con 0x7fb39c06a050 2023-10-16T20:10:50.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.943+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c0035f0 con 0x7fb39c06a050 2023-10-16T20:10:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.943+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c14ef40 con 0x7fb39c06a050 2023-10-16T20:10:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.943+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0039c0 con 0x7fb39c06a050 2023-10-16T20:10:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.943+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c1e3480 con 0x7fb39c06a050 2023-10-16T20:10:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.944+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb39c159ad0 con 0x7fb39c06a050 2023-10-16T20:10:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.984+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb38c007020 con 0x7fb39c06a050 2023-10-16T20:10:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.987+0000 7fb392ffd640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb37c06ae70 0x7fb37c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.988+0000 7fb393fff640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb37c06ae70 0x7fb37c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:50.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:50.989+0000 7fb393fff640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb37c06ae70 0x7fb37c06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb384036000 tx=0x7fb38403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:51.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.041+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb38c057ee0 con 0x7fb39c06a050 2023-10-16T20:10:51.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.042+0000 7fb392ffd640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7fb37c073190 0x7fb37c075610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.042+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 --> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb37c075ce0 con 0x7fb37c073190 2023-10-16T20:10:51.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.042+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb38c0575b0 con 0x7fb39c06a050 2023-10-16T20:10:51.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.043+0000 7fb39ad9d640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7fb37c073190 0x7fb37c075610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.045+0000 7fb39ad9d640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7fb37c073190 0x7fb37c075610 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.047+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== osd.5 v2:172.21.15.110:6808/3573598804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb37c075ce0 con 0x7fb37c073190 2023-10-16T20:10:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.074+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 --> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb39c1597f0 con 0x7fb37c073190 2023-10-16T20:10:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.075+0000 7fb392ffd640 1 -- 172.21.15.57:0/503083749 <== osd.5 v2:172.21.15.110:6808/3573598804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb39400ac70 con 0x7fb37c073190 2023-10-16T20:10:51.077 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:51.078 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7fb37c073190 msgr2=0x7fb37c075610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.110:6808/3573598804,v1:172.21.15.110:6809/3573598804] conn(0x7fb37c073190 0x7fb37c075610 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb37c06ae70 msgr2=0x7fb37c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fb37c06ae70 0x7fb37c06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb384036000 tx=0x7fb38403b040 comp rx=0 tx=0).stop 2023-10-16T20:10:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb39c06a050 msgr2=0x7fb39c0c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 --2- 172.21.15.57:0/503083749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb39c06a050 0x7fb39c0c6fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c440 tx=0x7fb38c00c900 comp rx=0 tx=0).stop 2023-10-16T20:10:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb39ad9d640 1 -- 172.21.15.57:0/503083749 reap_dead start 2023-10-16T20:10:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 shutdown_connections 2023-10-16T20:10:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.076+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 >> 172.21.15.57:0/503083749 conn(0x7fb39c0ca350 msgr2=0x7fb39c158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.077+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 shutdown_connections 2023-10-16T20:10:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.077+0000 7fb3a0fc5640 1 -- 172.21.15.57:0/503083749 wait complete. 2023-10-16T20:10:51.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-16T20:10:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.333+0000 7f25ca1ed640 1 Processor -- start 2023-10-16T20:10:51.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.334+0000 7f25ca1ed640 1 -- start start 2023-10-16T20:10:51.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.335+0000 7f25ca1ed640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 0x7f25c40c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.335+0000 7f25ca1ed640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25c40c6df0 0x7f25c4065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.335+0000 7f25ca1ed640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c40c7240 con 0x7f25c40b1c50 2023-10-16T20:10:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.335+0000 7f25ca1ed640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c40c8ff0 con 0x7f25c40c6df0 2023-10-16T20:10:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.335+0000 7f25ca1ed640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40cca90 con 0x7f25c41563d0 2023-10-16T20:10:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.337+0000 7f25c89ea640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f25c40b1c50 0x7f25c40cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45502/0 (socket says 172.21.15.57:45502) 2023-10-16T20:10:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.337+0000 7f25c89ea640 1 -- 172.21.15.57:0/1460010125 learned_addr learned my addr 172.21.15.57:0/1460010125 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.337+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1460010125 >> v2:172.21.15.110:3300/0 conn(0x7f25c40c6df0 0x7f25c4065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.337+0000 7f25c91eb640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 0x7f25c40c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.340+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869796605 0 0) 0x7f25c40c7240 con 0x7f25c40b1c50 2023-10-16T20:10:51.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.340+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b0003520 con 0x7f25c40b1c50 2023-10-16T20:10:51.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1544174280 0 0) 0x7f25b0003520 con 0x7f25c40b1c50 2023-10-16T20:10:51.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 msgr2=0x7f25c40c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:51.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 0x7f25c40c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 >> v2:172.21.15.110:3300/0 conn(0x7f25c40c6df0 msgr2=0x7f25c4065cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:51.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 --2- 172.21.15.57:0/1460010125 >> v2:172.21.15.110:3300/0 conn(0x7f25c40c6df0 0x7f25c4065cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c41567b0 con 0x7f25c40b1c50 2023-10-16T20:10:51.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.343+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f25b4001670 con 0x7f25c40b1c50 2023-10-16T20:10:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 >> v1:172.21.15.57:6789/0 conn(0x7f25c40b1c50 legacy=0x7f25c40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 0x7f25b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0003f70 0x7f25b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25b0004d00 0x7f25b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c8ff0 con 0x7f25b0004d00 2023-10-16T20:10:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40cca90 con 0x7f25b0003f70 2023-10-16T20:10:51.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.344+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b000b9b0 con 0x7f25c41563d0 2023-10-16T20:10:51.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.347+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25b0004d00 0x7f25b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.350+0000 7f25c89ea640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0003f70 0x7f25b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.350+0000 7f25c99ec640 1 -- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 msgr2=0x7f25b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.350+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c41563d0 0x7f25b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.350+0000 7f25c99ec640 1 -- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0003f70 msgr2=0x7f25b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.350+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0003f70 0x7f25b00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.350+0000 7f25c99ec640 1 -- 172.21.15.57:0/1460010125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0003520 con 0x7f25b0004d00 2023-10-16T20:10:51.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.353+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25b0004d00 0x7f25b0005180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009fc0 tx=0x7f25b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d56ed1f368db4b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:51.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.358+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc02cc40 con 0x7f25b0004d00 2023-10-16T20:10:51.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.358+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc00f040 con 0x7f25b0004d00 2023-10-16T20:10:51.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.358+0000 7f25bbfff640 1 -- 172.21.15.57:0/1460010125 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc034440 con 0x7f25b0004d00 2023-10-16T20:10:51.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.358+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1460010125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25b0004d00 msgr2=0x7f25b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.358+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1460010125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25b0004d00 0x7f25b0005180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009fc0 tx=0x7f25b00057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.359+0000 7f25c99ec640 1 -- 172.21.15.57:0/1460010125 reap_dead start 2023-10-16T20:10:51.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.359+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1460010125 shutdown_connections 2023-10-16T20:10:51.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.359+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1460010125 >> 172.21.15.57:0/1460010125 conn(0x7f25c406db40 msgr2=0x7f25c406df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:51.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.359+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1460010125 shutdown_connections 2023-10-16T20:10:51.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.359+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1460010125 wait complete. 2023-10-16T20:10:51.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.361+0000 7f25ca1ed640 1 Processor -- start 2023-10-16T20:10:51.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.361+0000 7f25ca1ed640 1 -- start start 2023-10-16T20:10:51.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.362+0000 7f25ca1ed640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0004d00 0x7f25c41ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.362+0000 7f25ca1ed640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c40b1630 0x7f25c40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.362+0000 7f25ca1ed640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 0x7f25c41f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.362+0000 7f25ca1ed640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c41eeab0 con 0x7f25c41f1060 2023-10-16T20:10:51.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.362+0000 7f25ca1ed640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40cc030 con 0x7f25b0004d00 2023-10-16T20:10:51.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.362+0000 7f25ca1ed640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c4aa0 con 0x7f25c40b1630 2023-10-16T20:10:51.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.363+0000 7f25c99ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 0x7f25c41f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.364+0000 7f25c99ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 0x7f25c41f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36232/0 (socket says 172.21.15.57:36232) 2023-10-16T20:10:51.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.364+0000 7f25c99ec640 1 -- 172.21.15.57:0/1281998765 learned_addr learned my addr 172.21.15.57:0/1281998765 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:51.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.364+0000 7f25c91eb640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0004d00 0x7f25c41ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.364+0000 7f25c89ea640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c40b1630 0x7f25c40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.368+0000 7f25c99ec640 1 -- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c40b1630 msgr2=0x7f25c40cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.368+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c40b1630 0x7f25c40cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.368+0000 7f25c99ec640 1 -- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0004d00 msgr2=0x7f25c41ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.368+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0004d00 0x7f25c41ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.368+0000 7f25c99ec640 1 -- 172.21.15.57:0/1281998765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40c68c0 con 0x7f25c41f1060 2023-10-16T20:10:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.370+0000 7f25c99ec640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 0x7f25c41f14e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00e230 tx=0x7f25bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:51.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.375+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc034d50 con 0x7f25c41f1060 2023-10-16T20:10:51.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.375+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc003990 con 0x7f25c41f1060 2023-10-16T20:10:51.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.375+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc003d40 con 0x7f25c41f1060 2023-10-16T20:10:51.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.375+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c40c4170 con 0x7f25c41f1060 2023-10-16T20:10:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.375+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40c4730 con 0x7f25c41f1060 2023-10-16T20:10:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.376+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c404e160 con 0x7f25c41f1060 2023-10-16T20:10:51.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.411+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25bc004030 con 0x7f25c41f1060 2023-10-16T20:10:51.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.412+0000 7f25b9ffb640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f25a806aec0 0x7f25a806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:51.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.413+0000 7f25c91eb640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f25a806aec0 0x7f25a806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:51.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.414+0000 7f25c91eb640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f25a806aec0 0x7f25a806d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25c0004770 tx=0x7f25c0006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:51.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.719+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f25bc07a270 con 0x7f25c41f1060 2023-10-16T20:10:51.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.720+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25bc0765b0 con 0x7f25c41f1060 2023-10-16T20:10:51.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.945+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f25c40c8a30 con 0x7f25a806aec0 2023-10-16T20:10:51.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.946+0000 7f25b9ffb640 1 -- 172.21.15.57:0/1281998765 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25c0004020 con 0x7f25a806aec0 2023-10-16T20:10:51.948 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2023-10-16T20:10:51.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f25a806aec0 msgr2=0x7f25a806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f25a806aec0 0x7f25a806d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25c0004770 tx=0x7f25c0006a20 comp rx=0 tx=0).stop 2023-10-16T20:10:51.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 msgr2=0x7f25c41f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:51.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 0x7f25c41f14e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00e230 tx=0x7f25bc009750 comp rx=0 tx=0).stop 2023-10-16T20:10:51.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 shutdown_connections 2023-10-16T20:10:51.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f25a806aec0 0x7f25a806d380 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c41f1060 0x7f25c41f14e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25c40b1630 0x7f25c40cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 --2- 172.21.15.57:0/1281998765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25b0004d00 0x7f25c41ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:51.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 >> 172.21.15.57:0/1281998765 conn(0x7f25c406db40 msgr2=0x7f25c4155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:51.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 shutdown_connections 2023-10-16T20:10:51.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:51.949+0000 7f25ca1ed640 1 -- 172.21.15.57:0/1281998765 wait complete. 2023-10-16T20:10:51.970 INFO:tasks.ceph:Scrubbing osd.6 2023-10-16T20:10:51.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:52.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.191+0000 7fbe8359e640 1 Processor -- start 2023-10-16T20:10:52.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.191+0000 7fbe8359e640 1 -- start start 2023-10-16T20:10:52.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.193+0000 7fbe8359e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe840c4300 0x7fbe840c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.193+0000 7fbe8359e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe84071da0 0x7fbe84150b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.193+0000 7fbe8359e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840c6850 con 0x7fbe840c3f20 2023-10-16T20:10:52.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.193+0000 7fbe8359e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe840c4fa0 con 0x7fbe840c4300 2023-10-16T20:10:52.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.193+0000 7fbe8359e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe840c33d0 con 0x7fbe84071da0 2023-10-16T20:10:52.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.194+0000 7fbe81d9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe840c4300 0x7fbe840c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.195+0000 7fbe81d9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe840c4300 0x7fbe840c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36238/0 (socket says 172.21.15.57:36238) 2023-10-16T20:10:52.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.195+0000 7fbe81d9b640 1 -- 172.21.15.57:0/2115626151 learned_addr learned my addr 172.21.15.57:0/2115626151 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:52.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.196+0000 7fbe82d9d640 1 --2- 172.21.15.57:0/2115626151 >> v2:172.21.15.110:3300/0 conn(0x7fbe84071da0 0x7fbe84150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.198+0000 7fbe81d9b640 1 -- 172.21.15.57:0/2115626151 >> v2:172.21.15.110:3300/0 conn(0x7fbe84071da0 msgr2=0x7fbe84150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:52.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.198+0000 7fbe81d9b640 1 --2- 172.21.15.57:0/2115626151 >> v2:172.21.15.110:3300/0 conn(0x7fbe84071da0 0x7fbe84150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.198+0000 7fbe81d9b640 1 -- 172.21.15.57:0/2115626151 >> v1:172.21.15.110:6789/0 conn(0x7fbe840c3f20 legacy=0x7fbe8415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.198+0000 7fbe81d9b640 1 -- 172.21.15.57:0/2115626151 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840c6230 con 0x7fbe840c4300 2023-10-16T20:10:52.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.201+0000 7fbe81d9b640 1 --2- 172.21.15.57:0/2115626151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe840c4300 0x7fbe840c5bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe840c7760 tx=0x7fbe7802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4e5cfae63f2992 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.206+0000 7fbe8159a640 1 -- 172.21.15.57:0/2115626151 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78030870 con 0x7fbe840c4300 2023-10-16T20:10:52.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.206+0000 7fbe8159a640 1 -- 172.21.15.57:0/2115626151 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe780309d0 con 0x7fbe840c4300 2023-10-16T20:10:52.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.206+0000 7fbe8159a640 1 -- 172.21.15.57:0/2115626151 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78030d60 con 0x7fbe840c4300 2023-10-16T20:10:52.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 -- 172.21.15.57:0/2115626151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe840c4300 msgr2=0x7fbe840c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 --2- 172.21.15.57:0/2115626151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe840c4300 0x7fbe840c5bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe840c7760 tx=0x7fbe7802b9b0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 -- 172.21.15.57:0/2115626151 shutdown_connections 2023-10-16T20:10:52.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 --2- 172.21.15.57:0/2115626151 >> v2:172.21.15.110:3300/0 conn(0x7fbe84071da0 0x7fbe84150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 --2- 172.21.15.57:0/2115626151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe840c4300 0x7fbe840c5bd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 -- 172.21.15.57:0/2115626151 >> 172.21.15.57:0/2115626151 conn(0x7fbe8406dd80 msgr2=0x7fbe8406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:52.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 -- 172.21.15.57:0/2115626151 shutdown_connections 2023-10-16T20:10:52.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.207+0000 7fbe8359e640 1 -- 172.21.15.57:0/2115626151 wait complete. 2023-10-16T20:10:52.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.209+0000 7fbe8359e640 1 Processor -- start 2023-10-16T20:10:52.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.209+0000 7fbe8359e640 1 -- start start 2023-10-16T20:10:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.210+0000 7fbe8359e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe84071da0 0x7fbe8414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.210+0000 7fbe8359e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe840c3f20 0x7fbe841ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.210+0000 7fbe8359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe840c4300 0x7fbe840ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.210+0000 7fbe8359e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840aead0 con 0x7fbe84071da0 2023-10-16T20:10:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.210+0000 7fbe8359e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841eef10 con 0x7fbe840c3f20 2023-10-16T20:10:52.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.210+0000 7fbe8359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841f1500 con 0x7fbe840c4300 2023-10-16T20:10:52.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.212+0000 7fbe8259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe84071da0 0x7fbe8414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.212+0000 7fbe8259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe84071da0 0x7fbe8414efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36250/0 (socket says 172.21.15.57:36250) 2023-10-16T20:10:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.212+0000 7fbe8259c640 1 -- 172.21.15.57:0/389458544 learned_addr learned my addr 172.21.15.57:0/389458544 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.212+0000 7fbe82d9d640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe840c4300 0x7fbe840ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.215+0000 7fbe81d9b640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe840c3f20 0x7fbe841ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.217+0000 7fbe8259c640 1 -- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe840c4300 msgr2=0x7fbe840ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.217+0000 7fbe8259c640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe840c4300 0x7fbe840ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.217+0000 7fbe8259c640 1 -- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe840c3f20 msgr2=0x7fbe841ee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.217+0000 7fbe8259c640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe840c3f20 0x7fbe841ee9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.217+0000 7fbe8259c640 1 -- 172.21.15.57:0/389458544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780094d0 con 0x7fbe84071da0 2023-10-16T20:10:52.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.220+0000 7fbe8259c640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe84071da0 0x7fbe8414efb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c430 tx=0x7fbe7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.226+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740052d0 con 0x7fbe84071da0 2023-10-16T20:10:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.226+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74005450 con 0x7fbe84071da0 2023-10-16T20:10:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.226+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74007260 con 0x7fbe84071da0 2023-10-16T20:10:52.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.226+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe841f1da0 con 0x7fbe84071da0 2023-10-16T20:10:52.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.226+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8414f990 con 0x7fbe84071da0 2023-10-16T20:10:52.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.227+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe840af9f0 con 0x7fbe84071da0 2023-10-16T20:10:52.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.254+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe740073c0 con 0x7fbe84071da0 2023-10-16T20:10:52.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.255+0000 7fbe72ffd640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fbe6406aec0 0x7fbe6406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.256+0000 7fbe81d9b640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fbe6406aec0 0x7fbe6406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.257+0000 7fbe81d9b640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fbe6406aec0 0x7fbe6406d380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe78036000 tx=0x7fbe7803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.258+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbe74058290 con 0x7fbe84071da0 2023-10-16T20:10:52.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.258+0000 7fbe72ffd640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7fbe640731e0 0x7fbe64075660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.258+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 --> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe64075d30 con 0x7fbe640731e0 2023-10-16T20:10:52.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.258+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe740545d0 con 0x7fbe84071da0 2023-10-16T20:10:52.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.259+0000 7fbe82d9d640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7fbe640731e0 0x7fbe64075660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.260+0000 7fbe82d9d640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7fbe640731e0 0x7fbe64075660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.262+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== osd.6 v2:172.21.15.110:6816/492622180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbe64075d30 con 0x7fbe640731e0 2023-10-16T20:10:52.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.282+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 --> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe8415a9a0 con 0x7fbe640731e0 2023-10-16T20:10:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.283+0000 7fbe72ffd640 1 -- 172.21.15.57:0/389458544 <== osd.6 v2:172.21.15.110:6816/492622180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbe7c0083a0 con 0x7fbe640731e0 2023-10-16T20:10:52.285 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:52.285 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:52.285 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:52.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.283+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7fbe640731e0 msgr2=0x7fbe64075660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.283+0000 7fbe8359e640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.110:6816/492622180,v1:172.21.15.110:6820/492622180] conn(0x7fbe640731e0 0x7fbe64075660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fbe6406aec0 msgr2=0x7fbe6406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fbe6406aec0 0x7fbe6406d380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe78036000 tx=0x7fbe7803b040 comp rx=0 tx=0).stop 2023-10-16T20:10:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe84071da0 msgr2=0x7fbe8414efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 --2- 172.21.15.57:0/389458544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe84071da0 0x7fbe8414efb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c430 tx=0x7fbe7400c8f0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe82d9d640 1 -- 172.21.15.57:0/389458544 reap_dead start 2023-10-16T20:10:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 shutdown_connections 2023-10-16T20:10:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 >> 172.21.15.57:0/389458544 conn(0x7fbe8406dd80 msgr2=0x7fbe840c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 shutdown_connections 2023-10-16T20:10:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.284+0000 7fbe8359e640 1 -- 172.21.15.57:0/389458544 wait complete. 2023-10-16T20:10:52.309 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-16T20:10:52.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.522+0000 7f996caea640 1 Processor -- start 2023-10-16T20:10:52.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.522+0000 7f996caea640 1 -- start start 2023-10-16T20:10:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.523+0000 7f996caea640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9968153180 0x7f99680ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.523+0000 7f996caea640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99680ceb00 0x7f99680c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.523+0000 7f996caea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99680c5c20 0x7f99680c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.523+0000 7f996caea640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680cef90 con 0x7f9968153180 2023-10-16T20:10:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.523+0000 7f996caea640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9968159bb0 con 0x7f99680ceb00 2023-10-16T20:10:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.523+0000 7f996caea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9968153560 con 0x7f99680c5c20 2023-10-16T20:10:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.524+0000 7f99677fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9968153180 0x7f99680ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.525+0000 7f99677fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9968153180 0x7f99680ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36252/0 (socket says 172.21.15.57:36252) 2023-10-16T20:10:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.525+0000 7f99677fe640 1 -- 172.21.15.57:0/3462868140 learned_addr learned my addr 172.21.15.57:0/3462868140 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.525+0000 7f9967fff640 1 --2- 172.21.15.57:0/3462868140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99680c5c20 0x7f99680c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.525+0000 7f9966ffd640 1 --2- 172.21.15.57:0/3462868140 >> v2:172.21.15.110:3300/0 conn(0x7f99680ceb00 0x7f99680c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.527+0000 7f99677fe640 1 -- 172.21.15.57:0/3462868140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99680c5c20 msgr2=0x7f99680c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:52.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.527+0000 7f99677fe640 1 --2- 172.21.15.57:0/3462868140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99680c5c20 0x7f99680c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.527+0000 7f99677fe640 1 -- 172.21.15.57:0/3462868140 >> v2:172.21.15.110:3300/0 conn(0x7f99680ceb00 msgr2=0x7f99680c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:52.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.527+0000 7f99677fe640 1 --2- 172.21.15.57:0/3462868140 >> v2:172.21.15.110:3300/0 conn(0x7f99680ceb00 0x7f99680c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.527+0000 7f99677fe640 1 -- 172.21.15.57:0/3462868140 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968158fa0 con 0x7f9968153180 2023-10-16T20:10:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.530+0000 7f99677fe640 1 --2- 172.21.15.57:0/3462868140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9968153180 0x7f99680ce5c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f996806b110 tx=0x7f995802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29da9dbc77e9bc38 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.536+0000 7f99667fc640 1 -- 172.21.15.57:0/3462868140 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995802ca80 con 0x7f9968153180 2023-10-16T20:10:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.536+0000 7f99667fc640 1 -- 172.21.15.57:0/3462868140 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995802cbe0 con 0x7f9968153180 2023-10-16T20:10:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.536+0000 7f99667fc640 1 -- 172.21.15.57:0/3462868140 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580343f0 con 0x7f9968153180 2023-10-16T20:10:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.536+0000 7f996caea640 1 -- 172.21.15.57:0/3462868140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9968153180 msgr2=0x7f99680ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.536+0000 7f996caea640 1 --2- 172.21.15.57:0/3462868140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9968153180 0x7f99680ce5c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f996806b110 tx=0x7f995802bee0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 -- 172.21.15.57:0/3462868140 shutdown_connections 2023-10-16T20:10:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 --2- 172.21.15.57:0/3462868140 >> v2:172.21.15.110:3300/0 conn(0x7f99680ceb00 0x7f99680c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 --2- 172.21.15.57:0/3462868140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99680c5c20 0x7f99680c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 --2- 172.21.15.57:0/3462868140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9968153180 0x7f99680ce5c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 -- 172.21.15.57:0/3462868140 >> 172.21.15.57:0/3462868140 conn(0x7f996806c760 msgr2=0x7f996806a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:52.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 -- 172.21.15.57:0/3462868140 shutdown_connections 2023-10-16T20:10:52.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.537+0000 7f996caea640 1 -- 172.21.15.57:0/3462868140 wait complete. 2023-10-16T20:10:52.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.539+0000 7f996caea640 1 Processor -- start 2023-10-16T20:10:52.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.539+0000 7f996caea640 1 -- start start 2023-10-16T20:10:52.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f996caea640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 0x7f996814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f996caea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9968153180 0x7f99680c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f996caea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99680c4c00 0x7f996814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f996caea640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996814de30 con 0x7f99680c5c20 2023-10-16T20:10:52.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f996caea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996814ecc0 con 0x7f99680c4c00 2023-10-16T20:10:52.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f996caea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996814ef80 con 0x7f9968153180 2023-10-16T20:10:52.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.540+0000 7f99677fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 0x7f996814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.541+0000 7f99677fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 0x7f996814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36266/0 (socket says 172.21.15.57:36266) 2023-10-16T20:10:52.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.541+0000 7f99677fe640 1 -- 172.21.15.57:0/1591384563 learned_addr learned my addr 172.21.15.57:0/1591384563 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:52.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.541+0000 7f9966ffd640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9968153180 0x7f99680c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.542+0000 7f9967fff640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99680c4c00 0x7f996814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.545+0000 7f99677fe640 1 -- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9968153180 msgr2=0x7f99680c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.545+0000 7f99677fe640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9968153180 0x7f99680c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.545+0000 7f99677fe640 1 -- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99680c4c00 msgr2=0x7f996814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:52.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.545+0000 7f99677fe640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99680c4c00 0x7f996814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:52.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.545+0000 7f99677fe640 1 -- 172.21.15.57:0/1591384563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009b30 con 0x7f99680c5c20 2023-10-16T20:10:52.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.548+0000 7f99677fe640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 0x7f996814c940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9958009f40 tx=0x7f9958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.552+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958009510 con 0x7f99680c5c20 2023-10-16T20:10:52.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.552+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995803f400 con 0x7f99680c5c20 2023-10-16T20:10:52.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.552+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995803f790 con 0x7f99680c5c20 2023-10-16T20:10:52.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.552+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996814cf80 con 0x7f99680c5c20 2023-10-16T20:10:52.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.552+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996814d540 con 0x7f99680c5c20 2023-10-16T20:10:52.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.554+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996804e160 con 0x7f99680c5c20 2023-10-16T20:10:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.581+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f995802cd50 con 0x7f99680c5c20 2023-10-16T20:10:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.582+0000 7f995ffff640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f994806aec0 0x7f994806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.582+0000 7f9966ffd640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f994806aec0 0x7f994806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.584+0000 7f9966ffd640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f994806aec0 0x7f994806d380 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99681ef8f0 tx=0x7f9950008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.588+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f995807b700 con 0x7f99680c5c20 2023-10-16T20:10:52.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:52.954+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9958077a40 con 0x7f99680c5c20 2023-10-16T20:10:53.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.179+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9968159280 con 0x7f994806aec0 2023-10-16T20:10:53.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.180+0000 7f995ffff640 1 -- 172.21.15.57:0/1591384563 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f99500108a0 con 0x7f994806aec0 2023-10-16T20:10:53.182 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2023-10-16T20:10:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f994806aec0 msgr2=0x7f994806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f994806aec0 0x7f994806d380 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99681ef8f0 tx=0x7f9950008040 comp rx=0 tx=0).stop 2023-10-16T20:10:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 msgr2=0x7f996814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 0x7f996814c940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9958009f40 tx=0x7f9958004a40 comp rx=0 tx=0).stop 2023-10-16T20:10:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 shutdown_connections 2023-10-16T20:10:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f994806aec0 0x7f994806d380 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99680c4c00 0x7f996814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9968153180 0x7f99680c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 --2- 172.21.15.57:0/1591384563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99680c5c20 0x7f996814c940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.183+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 >> 172.21.15.57:0/1591384563 conn(0x7f996806c760 msgr2=0x7f99680ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.184+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 shutdown_connections 2023-10-16T20:10:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.184+0000 7f996caea640 1 -- 172.21.15.57:0/1591384563 wait complete. 2023-10-16T20:10:53.204 INFO:tasks.ceph:Scrubbing osd.7 2023-10-16T20:10:53.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:10:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.424+0000 7fa6ada10640 1 Processor -- start 2023-10-16T20:10:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.424+0000 7fa6ada10640 1 -- start start 2023-10-16T20:10:53.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.426+0000 7fa6ada10640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6a80ceb20 0x7fa6a815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.426+0000 7fa6ada10640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6a80c3970 0x7fa6a8152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.426+0000 7fa6ada10640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a815d600 con 0x7fa6a80cef00 2023-10-16T20:10:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.426+0000 7fa6ada10640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a81594a0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.426+0000 7fa6ada10640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80c9c40 con 0x7fa6a80c3970 2023-10-16T20:10:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.427+0000 7fa6a6ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6a80ceb20 0x7fa6a815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.428+0000 7fa6a77fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6a80c3970 0x7fa6a8152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.428+0000 7fa6a6ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6a80ceb20 0x7fa6a815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36278/0 (socket says 172.21.15.57:36278) 2023-10-16T20:10:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.428+0000 7fa6a6ffd640 1 -- 172.21.15.57:0/386272079 learned_addr learned my addr 172.21.15.57:0/386272079 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:53.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.433+0000 7fa6a6ffd640 1 -- 172.21.15.57:0/386272079 >> v2:172.21.15.110:3300/0 conn(0x7fa6a80c3970 msgr2=0x7fa6a8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:53.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.433+0000 7fa6a6ffd640 1 --2- 172.21.15.57:0/386272079 >> v2:172.21.15.110:3300/0 conn(0x7fa6a80c3970 0x7fa6a8152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.433+0000 7fa6a6ffd640 1 -- 172.21.15.57:0/386272079 >> v1:172.21.15.57:6789/0 conn(0x7fa6a80cef00 legacy=0x7fa6a8159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.433+0000 7fa6a6ffd640 1 -- 172.21.15.57:0/386272079 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80caa50 con 0x7fa6a80ceb20 2023-10-16T20:10:53.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.437+0000 7fa6a6ffd640 1 --2- 172.21.15.57:0/386272079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a815d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80b28d0 tx=0x7fa69802ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49d8f2955d064f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.445+0000 7fa6a5ffb640 1 -- 172.21.15.57:0/386272079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69802f860 con 0x7fa6a80ceb20 2023-10-16T20:10:53.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.445+0000 7fa6a5ffb640 1 -- 172.21.15.57:0/386272079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69802f9c0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.445+0000 7fa6a5ffb640 1 -- 172.21.15.57:0/386272079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69802fd50 con 0x7fa6a80ceb20 2023-10-16T20:10:53.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 -- 172.21.15.57:0/386272079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 msgr2=0x7fa6a815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 --2- 172.21.15.57:0/386272079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a815d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80b28d0 tx=0x7fa69802ba40 comp rx=0 tx=0).stop 2023-10-16T20:10:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 -- 172.21.15.57:0/386272079 shutdown_connections 2023-10-16T20:10:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 --2- 172.21.15.57:0/386272079 >> v2:172.21.15.110:3300/0 conn(0x7fa6a80c3970 0x7fa6a8152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 --2- 172.21.15.57:0/386272079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a815d0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 -- 172.21.15.57:0/386272079 >> 172.21.15.57:0/386272079 conn(0x7fa6a806b990 msgr2=0x7fa6a806a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 -- 172.21.15.57:0/386272079 shutdown_connections 2023-10-16T20:10:53.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.446+0000 7fa6ada10640 1 -- 172.21.15.57:0/386272079 wait complete. 2023-10-16T20:10:53.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.449+0000 7fa6ada10640 1 Processor -- start 2023-10-16T20:10:53.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.449+0000 7fa6ada10640 1 -- start start 2023-10-16T20:10:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.450+0000 7fa6ada10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a80c3970 0x7fa6a814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.450+0000 7fa6ada10640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.450+0000 7fa6ada10640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a80cef00 0x7fa6a80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.450+0000 7fa6ada10640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8157680 con 0x7fa6a80ceb20 2023-10-16T20:10:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.450+0000 7fa6ada10640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80ce380 con 0x7fa6a80cef00 2023-10-16T20:10:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.450+0000 7fa6ada10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81591b0 con 0x7fa6a80c3970 2023-10-16T20:10:53.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.451+0000 7fa6a67fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.451+0000 7fa6a6ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a80c3970 0x7fa6a814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.451+0000 7fa6a67fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a80b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36290/0 (socket says 172.21.15.57:36290) 2023-10-16T20:10:53.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.452+0000 7fa6a67fc640 1 -- 172.21.15.57:0/4095879312 learned_addr learned my addr 172.21.15.57:0/4095879312 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:53.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.452+0000 7fa6a77fe640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a80cef00 0x7fa6a80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.456+0000 7fa6a67fc640 1 -- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a80c3970 msgr2=0x7fa6a814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.456+0000 7fa6a67fc640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6a80c3970 0x7fa6a814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.456+0000 7fa6a67fc640 1 -- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a80cef00 msgr2=0x7fa6a80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.456+0000 7fa6a67fc640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6a80cef00 0x7fa6a80b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.456+0000 7fa6a67fc640 1 -- 172.21.15.57:0/4095879312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980094d0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.459+0000 7fa6a67fc640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a80b3aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa69000c790 tx=0x7fa69000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.464+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69000cea0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.464+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa690003da0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.464+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690005270 con 0x7fa6a80ceb20 2023-10-16T20:10:53.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.464+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a80b2df0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.464+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a80cda50 con 0x7fa6a80ceb20 2023-10-16T20:10:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.465+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6a80cb010 con 0x7fa6a80ceb20 2023-10-16T20:10:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.507+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6900053d0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.510+0000 7fa69ffff640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa68806aea0 0x7fa68806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.511+0000 7fa6a6ffd640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa68806aea0 0x7fa68806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.513+0000 7fa6a6ffd640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa68806aea0 0x7fa68806d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa698036000 tx=0x7fa698008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.514+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6900581b0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.514+0000 7fa69ffff640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fa6880731c0 0x7fa688075640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.514+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 --> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa688075d10 con 0x7fa6880731c0 2023-10-16T20:10:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.514+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6900544f0 con 0x7fa6a80ceb20 2023-10-16T20:10:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.515+0000 7fa6a77fe640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fa6880731c0 0x7fa688075640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.517+0000 7fa6a77fe640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fa6880731c0 0x7fa688075640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.519+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== osd.7 v2:172.21.15.110:6811/3203439813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa688075d10 con 0x7fa6880731c0 2023-10-16T20:10:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.538+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 --> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6a80cad30 con 0x7fa6880731c0 2023-10-16T20:10:53.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.539+0000 7fa69ffff640 1 -- 172.21.15.57:0/4095879312 <== osd.7 v2:172.21.15.110:6811/3203439813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa6a0009b80 con 0x7fa6880731c0 2023-10-16T20:10:53.541 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-16T20:10:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:10:53.541 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-16T20:10:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.539+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fa6880731c0 msgr2=0x7fa688075640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.110:6811/3203439813,v1:172.21.15.110:6812/3203439813] conn(0x7fa6880731c0 0x7fa688075640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa68806aea0 msgr2=0x7fa68806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fa68806aea0 0x7fa68806d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa698036000 tx=0x7fa698008030 comp rx=0 tx=0).stop 2023-10-16T20:10:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 msgr2=0x7fa6a80b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 --2- 172.21.15.57:0/4095879312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a80ceb20 0x7fa6a80b3aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa69000c790 tx=0x7fa69000cc50 comp rx=0 tx=0).stop 2023-10-16T20:10:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6a77fe640 1 -- 172.21.15.57:0/4095879312 reap_dead start 2023-10-16T20:10:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 shutdown_connections 2023-10-16T20:10:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 >> 172.21.15.57:0/4095879312 conn(0x7fa6a806b990 msgr2=0x7fa6a8073010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 shutdown_connections 2023-10-16T20:10:53.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.540+0000 7fa6ada10640 1 -- 172.21.15.57:0/4095879312 wait complete. 2023-10-16T20:10:53.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-16T20:10:53.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.794+0000 7f2dded2e640 1 Processor -- start 2023-10-16T20:10:53.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.794+0000 7f2dded2e640 1 -- start start 2023-10-16T20:10:53.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.796+0000 7f2dded2e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd8153240 0x7f2dd80c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.796+0000 7f2dded2e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd806bbe0 con 0x7f2dd806e070 2023-10-16T20:10:53.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.796+0000 7f2dded2e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd8159990 con 0x7f2dd80c68a0 2023-10-16T20:10:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.796+0000 7f2dded2e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815d1a0 con 0x7f2dd8153240 2023-10-16T20:10:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.797+0000 7f2dde52d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2dd806e070 0x7f2dd815ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45532/0 (socket says 172.21.15.57:45532) 2023-10-16T20:10:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.797+0000 7f2dde52d640 1 -- 172.21.15.57:0/15175823 learned_addr learned my addr 172.21.15.57:0/15175823 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:53.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.798+0000 7f2dddd2c640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd8153240 0x7f2dd80c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.801+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541278289 0 0) 0x7f2dd806bbe0 con 0x7f2dd806e070 2023-10-16T20:10:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.801+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc4003520 con 0x7f2dd806e070 2023-10-16T20:10:53.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198596316 0 0) 0x7f2dc4003520 con 0x7f2dd806e070 2023-10-16T20:10:53.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd8153240 msgr2=0x7f2dd80c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:53.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd8153240 0x7f2dd80c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 >> v1:172.21.15.110:6789/0 conn(0x7f2dd80c68a0 legacy=0x7f2dd815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80701d0 con 0x7f2dd806e070 2023-10-16T20:10:53.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f2dd00019f0 con 0x7f2dd806e070 2023-10-16T20:10:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 >> v1:172.21.15.57:6789/0 conn(0x7f2dd806e070 legacy=0x7f2dd815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40039a0 0x7f2dc4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047c0 0x7f2dc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc4005180 0x7f2dc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815d1a0 con 0x7f2dc4005180 2023-10-16T20:10:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc400bfd0 con 0x7f2dc40047c0 2023-10-16T20:10:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.805+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc400c190 con 0x7f2dc40039a0 2023-10-16T20:10:53.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.812+0000 7f2dde52d640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc4005180 0x7f2dc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.814+0000 7f2dddd2c640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40039a0 0x7f2dc4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.815+0000 7f2ddd52b640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047c0 0x7f2dc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.820+0000 7f2dde52d640 1 -- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40039a0 msgr2=0x7f2dc4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:53.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.820+0000 7f2dde52d640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40039a0 0x7f2dc4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.820+0000 7f2dde52d640 1 -- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047c0 msgr2=0x7f2dc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:53.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.820+0000 7f2dde52d640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40047c0 0x7f2dc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.820+0000 7f2dde52d640 1 -- 172.21.15.57:0/15175823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4003520 con 0x7f2dc4005180 2023-10-16T20:10:53.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.825+0000 7f2dde52d640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc4005180 0x7f2dc400b980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2dd806fa70 tx=0x7f2dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cffdd71d05b35b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.836+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0034630 con 0x7f2dc4005180 2023-10-16T20:10:53.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.836+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd002f070 con 0x7f2dc4005180 2023-10-16T20:10:53.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.836+0000 7f2ddcd2a640 1 -- 172.21.15.57:0/15175823 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0034990 con 0x7f2dc4005180 2023-10-16T20:10:53.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.837+0000 7f2dded2e640 1 -- 172.21.15.57:0/15175823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc4005180 msgr2=0x7f2dc400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.837+0000 7f2dded2e640 1 --2- 172.21.15.57:0/15175823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc4005180 0x7f2dc400b980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2dd806fa70 tx=0x7f2dc40057f0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.837+0000 7f2dde52d640 1 -- 172.21.15.57:0/15175823 reap_dead start 2023-10-16T20:10:53.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.837+0000 7f2dded2e640 1 -- 172.21.15.57:0/15175823 shutdown_connections 2023-10-16T20:10:53.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.837+0000 7f2dded2e640 1 -- 172.21.15.57:0/15175823 >> 172.21.15.57:0/15175823 conn(0x7f2dd80c6f00 msgr2=0x7f2dd80c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:53.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.838+0000 7f2dded2e640 1 -- 172.21.15.57:0/15175823 shutdown_connections 2023-10-16T20:10:53.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.838+0000 7f2dded2e640 1 -- 172.21.15.57:0/15175823 wait complete. 2023-10-16T20:10:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.840+0000 7f2dded2e640 1 Processor -- start 2023-10-16T20:10:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.841+0000 7f2dded2e640 1 -- start start 2023-10-16T20:10:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.842+0000 7f2dded2e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4005180 0x7f2dd80c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.842+0000 7f2dded2e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 0x7f2dd8150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.842+0000 7f2dded2e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd815bd80 0x7f2dd81eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.842+0000 7f2dded2e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c1190 con 0x7f2dd80c53f0 2023-10-16T20:10:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.842+0000 7f2dded2e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815c210 con 0x7f2dc4005180 2023-10-16T20:10:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.842+0000 7f2dded2e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815cfa0 con 0x7f2dd815bd80 2023-10-16T20:10:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.843+0000 7f2ddd52b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 0x7f2dd8150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.844+0000 7f2ddd52b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 0x7f2dd8150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36306/0 (socket says 172.21.15.57:36306) 2023-10-16T20:10:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.844+0000 7f2ddd52b640 1 -- 172.21.15.57:0/105259537 learned_addr learned my addr 172.21.15.57:0/105259537 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:53.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.844+0000 7f2dde52d640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd815bd80 0x7f2dd81eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.846+0000 7f2dddd2c640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4005180 0x7f2dd80c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.848+0000 7f2ddd52b640 1 -- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd815bd80 msgr2=0x7f2dd81eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.848+0000 7f2ddd52b640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd815bd80 0x7f2dd81eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.848+0000 7f2ddd52b640 1 -- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4005180 msgr2=0x7f2dd80c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.848+0000 7f2ddd52b640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4005180 0x7f2dd80c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.848+0000 7f2ddd52b640 1 -- 172.21.15.57:0/105259537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd815c420 con 0x7f2dd80c53f0 2023-10-16T20:10:53.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.850+0000 7f2ddd52b640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 0x7f2dd8150650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800f820 tx=0x7f2dc800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.856+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8001390 con 0x7f2dd80c53f0 2023-10-16T20:10:53.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.856+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8005110 con 0x7f2dd80c53f0 2023-10-16T20:10:53.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.856+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80054a0 con 0x7f2dd80c53f0 2023-10-16T20:10:53.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.856+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd815c700 con 0x7f2dd80c53f0 2023-10-16T20:10:53.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.857+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd815ccc0 con 0x7f2dd80c53f0 2023-10-16T20:10:53.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.858+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd80c1370 con 0x7f2dd80c53f0 2023-10-16T20:10:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.919+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2dc8006820 con 0x7f2dd80c53f0 2023-10-16T20:10:53.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.922+0000 7f2dce7fc640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2dbc06aec0 0x7f2dbc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:53.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.923+0000 7f2dddd2c640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2dbc06aec0 0x7f2dbc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:53.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.924+0000 7f2dddd2c640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2dbc06aec0 0x7f2dbc06d380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2dd806ccd0 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:53.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:53.925+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2dc80585f0 con 0x7f2dd80c53f0 2023-10-16T20:10:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.247+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2dc8054930 con 0x7f2dd80c53f0 2023-10-16T20:10:54.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.484+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dd8070790 con 0x7f2dbc06aec0 2023-10-16T20:10:54.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.485+0000 7f2dce7fc640 1 -- 172.21.15.57:0/105259537 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2dd40097d0 con 0x7f2dbc06aec0 2023-10-16T20:10:54.487 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2023-10-16T20:10:54.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2dbc06aec0 msgr2=0x7f2dbc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:54.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2dbc06aec0 0x7f2dbc06d380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2dd806ccd0 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2023-10-16T20:10:54.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 msgr2=0x7f2dd8150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:54.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 0x7f2dd8150650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800f820 tx=0x7f2dc800fce0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 shutdown_connections 2023-10-16T20:10:54.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f2dbc06aec0 0x7f2dbc06d380 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd815bd80 0x7f2dd81eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd80c53f0 0x7f2dd8150650 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 --2- 172.21.15.57:0/105259537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc4005180 0x7f2dd80c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 >> 172.21.15.57:0/105259537 conn(0x7f2dd80c6f00 msgr2=0x7f2dd80c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:54.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 shutdown_connections 2023-10-16T20:10:54.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.488+0000 7f2dded2e640 1 -- 172.21.15.57:0/105259537 wait complete. 2023-10-16T20:10:54.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:54.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.717+0000 7f3a2ffff640 1 Processor -- start 2023-10-16T20:10:54.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.718+0000 7f3a2ffff640 1 -- start start 2023-10-16T20:10:54.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.720+0000 7f3a2ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a3006e340 0x7f3a300c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:54.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.720+0000 7f3a2ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a3006b9c0 0x7f3a3006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:54.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.720+0000 7f3a2ffff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300c5340 con 0x7f3a30151040 2023-10-16T20:10:54.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.720+0000 7f3a2ffff640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300c7e90 con 0x7f3a3006b9c0 2023-10-16T20:10:54.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.720+0000 7f3a2ffff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300c47e0 con 0x7f3a3006e340 2023-10-16T20:10:54.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.721+0000 7f3a2effd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a30151040 0x7f3a3006cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45548/0 (socket says 172.21.15.57:45548) 2023-10-16T20:10:54.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.721+0000 7f3a2effd640 1 -- 172.21.15.57:0/867093633 learned_addr learned my addr 172.21.15.57:0/867093633 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:10:54.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.721+0000 7f3a2f7fe640 1 --2- 172.21.15.57:0/867093633 >> v2:172.21.15.57:3300/0 conn(0x7f3a3006b9c0 0x7f3a3006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:54.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.727+0000 7f3a2f7fe640 1 -- 172.21.15.57:0/867093633 >> v2:172.21.15.110:3300/0 conn(0x7f3a3006e340 msgr2=0x7f3a300c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:54.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.727+0000 7f3a2f7fe640 1 --2- 172.21.15.57:0/867093633 >> v2:172.21.15.110:3300/0 conn(0x7f3a3006e340 0x7f3a300c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.727+0000 7f3a2f7fe640 1 -- 172.21.15.57:0/867093633 >> v1:172.21.15.57:6789/0 conn(0x7f3a30151040 legacy=0x7f3a3006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:54.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.727+0000 7f3a2f7fe640 1 -- 172.21.15.57:0/867093633 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300c2c40 con 0x7f3a3006b9c0 2023-10-16T20:10:54.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.729+0000 7f3a2f7fe640 1 --2- 172.21.15.57:0/867093633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3006b9c0 0x7f3a3006d650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3a3006f050 tx=0x7f3a2802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88b28e4ee2ac1dd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.737+0000 7f3a2e7fc640 1 -- 172.21.15.57:0/867093633 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2802cd10 con 0x7f3a3006b9c0 2023-10-16T20:10:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.737+0000 7f3a2e7fc640 1 -- 172.21.15.57:0/867093633 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2802ce70 con 0x7f3a3006b9c0 2023-10-16T20:10:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.737+0000 7f3a2e7fc640 1 -- 172.21.15.57:0/867093633 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28034640 con 0x7f3a3006b9c0 2023-10-16T20:10:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 -- 172.21.15.57:0/867093633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3006b9c0 msgr2=0x7f3a3006d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/867093633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3006b9c0 0x7f3a3006d650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3a3006f050 tx=0x7f3a2802bf60 comp rx=0 tx=0).stop 2023-10-16T20:10:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 -- 172.21.15.57:0/867093633 shutdown_connections 2023-10-16T20:10:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/867093633 >> v2:172.21.15.110:3300/0 conn(0x7f3a3006e340 0x7f3a300c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/867093633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3006b9c0 0x7f3a3006d650 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 -- 172.21.15.57:0/867093633 >> 172.21.15.57:0/867093633 conn(0x7f3a300c6f00 msgr2=0x7f3a300c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 -- 172.21.15.57:0/867093633 shutdown_connections 2023-10-16T20:10:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.738+0000 7f3a2ffff640 1 -- 172.21.15.57:0/867093633 wait complete. 2023-10-16T20:10:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.740+0000 7f3a2ffff640 1 Processor -- start 2023-10-16T20:10:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.740+0000 7f3a2ffff640 1 -- start start 2023-10-16T20:10:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.741+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 0x7f3a3006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.741+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3006e340 0x7f3a301ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.741+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a30151040 0x7f3a30140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.741+0000 7f3a2ffff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30070a50 con 0x7f3a30151040 2023-10-16T20:10:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.741+0000 7f3a2ffff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30158fe0 con 0x7f3a3006e340 2023-10-16T20:10:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.741+0000 7f3a2ffff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30071e10 con 0x7f3a3006b9c0 2023-10-16T20:10:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.743+0000 7f3a2effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 0x7f3a3006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:54.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.744+0000 7f3a2effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 0x7f3a3006fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:42820/0 (socket says 172.21.15.57:42820) 2023-10-16T20:10:54.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.744+0000 7f3a2effd640 1 -- 172.21.15.57:0/3060199102 learned_addr learned my addr 172.21.15.57:0/3060199102 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:10:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.750+0000 7f3a2f7fe640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a30151040 0x7f3a30140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:54.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.750+0000 7f3a2effd640 1 -- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3006e340 msgr2=0x7f3a301ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.750+0000 7f3a2effd640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3006e340 0x7f3a301ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.750+0000 7f3a2effd640 1 -- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a30151040 msgr2=0x7f3a30140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.750+0000 7f3a2effd640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a30151040 0x7f3a30140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:54.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.750+0000 7f3a2effd640 1 -- 172.21.15.57:0/3060199102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a28009a70 con 0x7f3a3006b9c0 2023-10-16T20:10:54.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.757+0000 7f3a2effd640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 0x7f3a3006fb00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c4b0 tx=0x7f3a2000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.773+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20005ce0 con 0x7f3a3006b9c0 2023-10-16T20:10:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.773+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20005e40 con 0x7f3a3006b9c0 2023-10-16T20:10:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.773+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20007270 con 0x7f3a3006b9c0 2023-10-16T20:10:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.773+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a300718c0 con 0x7f3a3006b9c0 2023-10-16T20:10:54.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.773+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a301ee420 con 0x7f3a3006b9c0 2023-10-16T20:10:54.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:54.774+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a301ee610 con 0x7f3a3006b9c0 2023-10-16T20:10:55.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.093+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a200073d0 con 0x7f3a3006b9c0 2023-10-16T20:10:55.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.095+0000 7f3a2cff9640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a1006aec0 0x7f3a1006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.095+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3a20088f70 con 0x7f3a3006b9c0 2023-10-16T20:10:55.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.096+0000 7f3a27fff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a1006aec0 0x7f3a1006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.098+0000 7f3a27fff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a1006aec0 0x7f3a1006d380 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a300c6700 tx=0x7f3a18006c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:55.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.104+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a200540c0 con 0x7f3a3006b9c0 2023-10-16T20:10:55.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.305+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a3015a5d0 con 0x7f3a1006aec0 2023-10-16T20:10:55.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.329+0000 7f3a2cff9640 1 -- 172.21.15.57:0/3060199102 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286551 (secure 0 0 0) 0x7f3a18013410 con 0x7f3a1006aec0 2023-10-16T20:10:55.335 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:10:55.337 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:10:55.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a1006aec0 msgr2=0x7f3a1006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a1006aec0 0x7f3a1006d380 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a300c6700 tx=0x7f3a18006c80 comp rx=0 tx=0).stop 2023-10-16T20:10:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 msgr2=0x7f3a3006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 0x7f3a3006fb00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c4b0 tx=0x7f3a2000c970 comp rx=0 tx=0).stop 2023-10-16T20:10:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 shutdown_connections 2023-10-16T20:10:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f3a1006aec0 0x7f3a1006d380 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a30151040 0x7f3a30140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3006e340 0x7f3a301ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.334+0000 7f3a2ffff640 1 --2- 172.21.15.57:0/3060199102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a3006b9c0 0x7f3a3006fb00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.335+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 >> 172.21.15.57:0/3060199102 conn(0x7f3a300c6f00 msgr2=0x7f3a300c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.335+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 shutdown_connections 2023-10-16T20:10:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:10:55.335+0000 7f3a2ffff640 1 -- 172.21.15.57:0/3060199102 wait complete. 2023-10-16T20:10:55.358 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":930,"stamp":"2023-10-16T20:10:54.235303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12851,"ondisk_log_size":12851,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004354"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410265+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T20:10:33.410265+0000","last_peered":"2023-10-16T20:10:33.410265+0000","last_clean":"2023-10-16T20:10:33.410265+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:10:33.410265+0000","last_undegraded":"2023-10-16T20:10:33.410265+0000","last_fullsized":"2023-10-16T20:10:33.410265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:30.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.485962+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T20:10:33.485962+0000","last_peered":"2023-10-16T20:10:33.485962+0000","last_clean":"2023-10-16T20:10:33.485962+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:10:33.485962+0000","last_undegraded":"2023-10-16T20:10:33.485962+0000","last_fullsized":"2023-10-16T20:10:33.485962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581509+0000","last_change":"2023-10-16T19:40:59.182213+0000","last_active":"2023-10-16T20:10:33.581509+0000","last_peered":"2023-10-16T20:10:33.581509+0000","last_clean":"2023-10-16T20:10:33.581509+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:33.581509+0000","last_undegraded":"2023-10-16T20:10:33.581509+0000","last_fullsized":"2023-10-16T20:10:33.581509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587881+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T20:10:33.587881+0000","last_peered":"2023-10-16T20:10:33.587881+0000","last_clean":"2023-10-16T20:10:33.587881+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:10:33.587881+0000","last_undegraded":"2023-10-16T20:10:33.587881+0000","last_fullsized":"2023-10-16T20:10:33.587881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.386106+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T20:10:33.386106+0000","last_peered":"2023-10-16T20:10:33.386106+0000","last_clean":"2023-10-16T20:10:33.386106+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:10:33.386106+0000","last_undegraded":"2023-10-16T20:10:33.386106+0000","last_fullsized":"2023-10-16T20:10:33.386106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.588335+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T20:10:33.588335+0000","last_peered":"2023-10-16T20:10:33.588335+0000","last_clean":"2023-10-16T20:10:33.588335+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:10:33.588335+0000","last_undegraded":"2023-10-16T20:10:33.588335+0000","last_fullsized":"2023-10-16T20:10:33.588335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.025757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.477708+0000","last_change":"2023-10-16T19:40:59.175825+0000","last_active":"2023-10-16T20:10:33.477708+0000","last_peered":"2023-10-16T20:10:33.477708+0000","last_clean":"2023-10-16T20:10:33.477708+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:33.477708+0000","last_undegraded":"2023-10-16T20:10:33.477708+0000","last_fullsized":"2023-10-16T20:10:33.477708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504389+0000","last_change":"2023-10-16T19:40:59.163113+0000","last_active":"2023-10-16T20:10:33.504389+0000","last_peered":"2023-10-16T20:10:33.504389+0000","last_clean":"2023-10-16T20:10:33.504389+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:10:33.504389+0000","last_undegraded":"2023-10-16T20:10:33.504389+0000","last_fullsized":"2023-10-16T20:10:33.504389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413486+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413486+0000","last_peered":"2023-10-16T20:10:33.413486+0000","last_clean":"2023-10-16T20:10:33.413486+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413486+0000","last_undegraded":"2023-10-16T20:10:33.413486+0000","last_fullsized":"2023-10-16T20:10:33.413486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:19:30.948426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.605626+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T20:10:33.605626+0000","last_peered":"2023-10-16T20:10:33.605626+0000","last_clean":"2023-10-16T20:10:33.605626+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:10:33.605626+0000","last_undegraded":"2023-10-16T20:10:33.605626+0000","last_fullsized":"2023-10-16T20:10:33.605626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:27.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.559967+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T20:10:33.559967+0000","last_peered":"2023-10-16T20:10:33.559967+0000","last_clean":"2023-10-16T20:10:33.559967+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:10:33.559967+0000","last_undegraded":"2023-10-16T20:10:33.559967+0000","last_fullsized":"2023-10-16T20:10:33.559967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:06.395645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.594417+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T20:10:33.594417+0000","last_peered":"2023-10-16T20:10:33.594417+0000","last_clean":"2023-10-16T20:10:33.594417+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:10:33.594417+0000","last_undegraded":"2023-10-16T20:10:33.594417+0000","last_fullsized":"2023-10-16T20:10:33.594417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504404+0000","last_change":"2023-10-16T19:40:59.210769+0000","last_active":"2023-10-16T20:10:33.504404+0000","last_peered":"2023-10-16T20:10:33.504404+0000","last_clean":"2023-10-16T20:10:33.504404+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:10:33.504404+0000","last_undegraded":"2023-10-16T20:10:33.504404+0000","last_fullsized":"2023-10-16T20:10:33.504404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584464+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T20:10:33.584464+0000","last_peered":"2023-10-16T20:10:33.584464+0000","last_clean":"2023-10-16T20:10:33.584464+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:10:33.584464+0000","last_undegraded":"2023-10-16T20:10:33.584464+0000","last_fullsized":"2023-10-16T20:10:33.584464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.402663+0000","last_change":"2023-10-16T19:40:59.132214+0000","last_active":"2023-10-16T20:10:33.402663+0000","last_peered":"2023-10-16T20:10:33.402663+0000","last_clean":"2023-10-16T20:10:33.402663+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:10:33.402663+0000","last_undegraded":"2023-10-16T20:10:33.402663+0000","last_fullsized":"2023-10-16T20:10:33.402663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586214+0000","last_change":"2023-10-16T19:40:59.174499+0000","last_active":"2023-10-16T20:10:33.586214+0000","last_peered":"2023-10-16T20:10:33.586214+0000","last_clean":"2023-10-16T20:10:33.586214+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:10:33.586214+0000","last_undegraded":"2023-10-16T20:10:33.586214+0000","last_fullsized":"2023-10-16T20:10:33.586214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:51.832545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.570822+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T20:10:33.570822+0000","last_peered":"2023-10-16T20:10:33.570822+0000","last_clean":"2023-10-16T20:10:33.570822+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:10:33.570822+0000","last_undegraded":"2023-10-16T20:10:33.570822+0000","last_fullsized":"2023-10-16T20:10:33.570822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.627226+0000","last_change":"2023-10-16T19:40:59.210502+0000","last_active":"2023-10-16T20:10:33.627226+0000","last_peered":"2023-10-16T20:10:33.627226+0000","last_clean":"2023-10-16T20:10:33.627226+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:33.627226+0000","last_undegraded":"2023-10-16T20:10:33.627226+0000","last_fullsized":"2023-10-16T20:10:33.627226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.416579+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T20:10:33.416579+0000","last_peered":"2023-10-16T20:10:33.416579+0000","last_clean":"2023-10-16T20:10:33.416579+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:10:33.416579+0000","last_undegraded":"2023-10-16T20:10:33.416579+0000","last_fullsized":"2023-10-16T20:10:33.416579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.589018+0000","last_change":"2023-10-16T19:40:59.207796+0000","last_active":"2023-10-16T20:10:33.589018+0000","last_peered":"2023-10-16T20:10:33.589018+0000","last_clean":"2023-10-16T20:10:33.589018+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:10:33.589018+0000","last_undegraded":"2023-10-16T20:10:33.589018+0000","last_fullsized":"2023-10-16T20:10:33.589018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:28.568048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583005+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T20:10:33.583005+0000","last_peered":"2023-10-16T20:10:33.583005+0000","last_clean":"2023-10-16T20:10:33.583005+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:10:33.583005+0000","last_undegraded":"2023-10-16T20:10:33.583005+0000","last_fullsized":"2023-10-16T20:10:33.583005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587275+0000","last_change":"2023-10-16T19:40:59.159224+0000","last_active":"2023-10-16T20:10:33.587275+0000","last_peered":"2023-10-16T20:10:33.587275+0000","last_clean":"2023-10-16T20:10:33.587275+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:10:33.587275+0000","last_undegraded":"2023-10-16T20:10:33.587275+0000","last_fullsized":"2023-10-16T20:10:33.587275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:54:36.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.431746+0000","last_change":"2023-10-16T19:40:58.993807+0000","last_active":"2023-10-16T20:10:33.431746+0000","last_peered":"2023-10-16T20:10:33.431746+0000","last_clean":"2023-10-16T20:10:33.431746+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:33.431746+0000","last_undegraded":"2023-10-16T20:10:33.431746+0000","last_fullsized":"2023-10-16T20:10:33.431746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587450+0000","last_change":"2023-10-16T19:40:59.154806+0000","last_active":"2023-10-16T20:10:33.587450+0000","last_peered":"2023-10-16T20:10:33.587450+0000","last_clean":"2023-10-16T20:10:33.587450+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:10:33.587450+0000","last_undegraded":"2023-10-16T20:10:33.587450+0000","last_fullsized":"2023-10-16T20:10:33.587450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:21:02.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.409070+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T20:10:33.409070+0000","last_peered":"2023-10-16T20:10:33.409070+0000","last_clean":"2023-10-16T20:10:33.409070+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:10:33.409070+0000","last_undegraded":"2023-10-16T20:10:33.409070+0000","last_fullsized":"2023-10-16T20:10:33.409070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590410+0000","last_change":"2023-10-16T19:41:25.495312+0000","last_active":"2023-10-16T20:10:33.590410+0000","last_peered":"2023-10-16T20:10:33.590410+0000","last_clean":"2023-10-16T20:10:33.590410+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:10:33.590410+0000","last_undegraded":"2023-10-16T20:10:33.590410+0000","last_fullsized":"2023-10-16T20:10:33.590410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451662+0000","last_change":"2023-10-16T19:40:59.132855+0000","last_active":"2023-10-16T20:10:33.451662+0000","last_peered":"2023-10-16T20:10:33.451662+0000","last_clean":"2023-10-16T20:10:33.451662+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:10:33.451662+0000","last_undegraded":"2023-10-16T20:10:33.451662+0000","last_fullsized":"2023-10-16T20:10:33.451662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451221+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T20:10:33.451221+0000","last_peered":"2023-10-16T20:10:33.451221+0000","last_clean":"2023-10-16T20:10:33.451221+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:10:33.451221+0000","last_undegraded":"2023-10-16T20:10:33.451221+0000","last_fullsized":"2023-10-16T20:10:33.451221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583511+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T20:10:33.583511+0000","last_peered":"2023-10-16T20:10:33.583511+0000","last_clean":"2023-10-16T20:10:33.583511+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:10:33.583511+0000","last_undegraded":"2023-10-16T20:10:33.583511+0000","last_fullsized":"2023-10-16T20:10:33.583511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.585861+0000","last_change":"2023-10-16T19:40:59.154280+0000","last_active":"2023-10-16T20:10:33.585861+0000","last_peered":"2023-10-16T20:10:33.585861+0000","last_clean":"2023-10-16T20:10:33.585861+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:10:33.585861+0000","last_undegraded":"2023-10-16T20:10:33.585861+0000","last_fullsized":"2023-10-16T20:10:33.585861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:01.209870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.627046+0000","last_change":"2023-10-16T19:40:59.182560+0000","last_active":"2023-10-16T20:10:33.627046+0000","last_peered":"2023-10-16T20:10:33.627046+0000","last_clean":"2023-10-16T20:10:33.627046+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:33.627046+0000","last_undegraded":"2023-10-16T20:10:33.627046+0000","last_fullsized":"2023-10-16T20:10:33.627046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590788+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T20:10:33.590788+0000","last_peered":"2023-10-16T20:10:33.590788+0000","last_clean":"2023-10-16T20:10:33.590788+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:10:33.590788+0000","last_undegraded":"2023-10-16T20:10:33.590788+0000","last_fullsized":"2023-10-16T20:10:33.590788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:16.609109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":149,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.595548+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T20:10:33.595548+0000","last_peered":"2023-10-16T20:10:33.595548+0000","last_clean":"2023-10-16T20:10:33.595548+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:10:33.595548+0000","last_undegraded":"2023-10-16T20:10:33.595548+0000","last_fullsized":"2023-10-16T20:10:33.595548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2224","reported_seq":2253,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.762380+0000","last_change":"2023-10-16T19:40:56.460158+0000","last_active":"2023-10-16T20:10:33.762380+0000","last_peered":"2023-10-16T20:10:33.762380+0000","last_clean":"2023-10-16T20:10:33.762380+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:33.762380+0000","last_undegraded":"2023-10-16T20:10:33.762380+0000","last_fullsized":"2023-10-16T20:10:33.762380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584462+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T20:10:33.584462+0000","last_peered":"2023-10-16T20:10:33.584462+0000","last_clean":"2023-10-16T20:10:33.584462+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:10:33.584462+0000","last_undegraded":"2023-10-16T20:10:33.584462+0000","last_fullsized":"2023-10-16T20:10:33.584462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'121","reported_seq":258,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:30.057629+0000","last_change":"2023-10-16T19:40:56.419226+0000","last_active":"2023-10-16T20:09:30.057629+0000","last_peered":"2023-10-16T20:09:30.057629+0000","last_clean":"2023-10-16T20:09:30.057629+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:09:30.057629+0000","last_undegraded":"2023-10-16T20:09:30.057629+0000","last_fullsized":"2023-10-16T20:09:30.057629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:39.039793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'203","reported_seq":427,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.649054+0000","last_change":"2023-10-16T19:40:56.447811+0000","last_active":"2023-10-16T20:10:13.649054+0000","last_peered":"2023-10-16T20:10:13.649054+0000","last_clean":"2023-10-16T20:10:13.649054+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:13.649054+0000","last_undegraded":"2023-10-16T20:10:13.649054+0000","last_fullsized":"2023-10-16T20:10:13.649054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.503701+0000","last_change":"2023-10-16T19:40:59.177476+0000","last_active":"2023-10-16T20:10:33.503701+0000","last_peered":"2023-10-16T20:10:33.503701+0000","last_clean":"2023-10-16T20:10:33.503701+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:10:33.503701+0000","last_undegraded":"2023-10-16T20:10:33.503701+0000","last_fullsized":"2023-10-16T20:10:33.503701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'7","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:56.062806+0000","last_change":"2023-10-16T19:40:56.304306+0000","last_active":"2023-10-16T20:09:56.062806+0000","last_peered":"2023-10-16T20:09:56.062806+0000","last_clean":"2023-10-16T20:09:56.062806+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:09:56.062806+0000","last_undegraded":"2023-10-16T20:09:56.062806+0000","last_fullsized":"2023-10-16T20:09:56.062806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.447671+0000","last_change":"2023-10-16T19:40:59.131911+0000","last_active":"2023-10-16T20:10:33.447671+0000","last_peered":"2023-10-16T20:10:33.447671+0000","last_clean":"2023-10-16T20:10:33.447671+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:10:33.447671+0000","last_undegraded":"2023-10-16T20:10:33.447671+0000","last_fullsized":"2023-10-16T20:10:33.447671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'169","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.942089+0000","last_change":"2023-10-16T19:40:56.415678+0000","last_active":"2023-10-16T20:10:32.942089+0000","last_peered":"2023-10-16T20:10:32.942089+0000","last_clean":"2023-10-16T20:10:32.942089+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:10:32.942089+0000","last_undegraded":"2023-10-16T20:10:32.942089+0000","last_fullsized":"2023-10-16T20:10:32.942089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:49.903190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583115+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T20:10:33.583115+0000","last_peered":"2023-10-16T20:10:33.583115+0000","last_clean":"2023-10-16T20:10:33.583115+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:10:33.583115+0000","last_undegraded":"2023-10-16T20:10:33.583115+0000","last_fullsized":"2023-10-16T20:10:33.583115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:46.120185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'80","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:09:44.535041+0000","last_change":"2023-10-16T19:40:56.415563+0000","last_active":"2023-10-16T20:09:44.535041+0000","last_peered":"2023-10-16T20:09:44.535041+0000","last_clean":"2023-10-16T20:09:44.535041+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:09:44.535041+0000","last_undegraded":"2023-10-16T20:09:44.535041+0000","last_fullsized":"2023-10-16T20:09:44.535041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583160+0000","last_change":"2023-10-16T19:40:59.177951+0000","last_active":"2023-10-16T20:10:33.583160+0000","last_peered":"2023-10-16T20:10:33.583160+0000","last_clean":"2023-10-16T20:10:33.583160+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:10:33.583160+0000","last_undegraded":"2023-10-16T20:10:33.583160+0000","last_fullsized":"2023-10-16T20:10:33.583160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'84","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:29.600405+0000","last_change":"2023-10-16T19:40:56.396647+0000","last_active":"2023-10-16T20:10:29.600405+0000","last_peered":"2023-10-16T20:10:29.600405+0000","last_clean":"2023-10-16T20:10:29.600405+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:29.600405+0000","last_undegraded":"2023-10-16T20:10:29.600405+0000","last_fullsized":"2023-10-16T20:10:29.600405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.593448+0000","last_change":"2023-10-16T19:40:59.119893+0000","last_active":"2023-10-16T20:10:33.593448+0000","last_peered":"2023-10-16T20:10:33.593448+0000","last_clean":"2023-10-16T20:10:33.593448+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:10:33.593448+0000","last_undegraded":"2023-10-16T20:10:33.593448+0000","last_fullsized":"2023-10-16T20:10:33.593448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1226","reported_seq":1255,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.798808+0000","last_change":"2023-10-16T19:40:56.448008+0000","last_active":"2023-10-16T20:10:11.798808+0000","last_peered":"2023-10-16T20:10:11.798808+0000","last_clean":"2023-10-16T20:10:11.798808+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:10:11.798808+0000","last_undegraded":"2023-10-16T20:10:11.798808+0000","last_fullsized":"2023-10-16T20:10:11.798808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451956+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T20:10:33.451956+0000","last_peered":"2023-10-16T20:10:33.451956+0000","last_clean":"2023-10-16T20:10:33.451956+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:10:33.451956+0000","last_undegraded":"2023-10-16T20:10:33.451956+0000","last_fullsized":"2023-10-16T20:10:33.451956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:28.535948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'116","reported_seq":248,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.556453+0000","last_change":"2023-10-16T19:40:56.462739+0000","last_active":"2023-10-16T20:10:20.556453+0000","last_peered":"2023-10-16T20:10:20.556453+0000","last_clean":"2023-10-16T20:10:20.556453+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:20.556453+0000","last_undegraded":"2023-10-16T20:10:20.556453+0000","last_fullsized":"2023-10-16T20:10:20.556453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581264+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T20:10:33.581264+0000","last_peered":"2023-10-16T20:10:33.581264+0000","last_clean":"2023-10-16T20:10:33.581264+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:10:33.581264+0000","last_undegraded":"2023-10-16T20:10:33.581264+0000","last_fullsized":"2023-10-16T20:10:33.581264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'94","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.112139+0000","last_change":"2023-10-16T19:40:56.449925+0000","last_active":"2023-10-16T20:10:20.112139+0000","last_peered":"2023-10-16T20:10:20.112139+0000","last_clean":"2023-10-16T20:10:20.112139+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:10:20.112139+0000","last_undegraded":"2023-10-16T20:10:20.112139+0000","last_fullsized":"2023-10-16T20:10:20.112139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:03.663262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.405427+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T20:10:33.405427+0000","last_peered":"2023-10-16T20:10:33.405427+0000","last_clean":"2023-10-16T20:10:33.405427+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:10:33.405427+0000","last_undegraded":"2023-10-16T20:10:33.405427+0000","last_fullsized":"2023-10-16T20:10:33.405427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'915","reported_seq":944,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.946659+0000","last_change":"2023-10-16T19:40:56.417248+0000","last_active":"2023-10-16T20:10:32.946659+0000","last_peered":"2023-10-16T20:10:32.946659+0000","last_clean":"2023-10-16T20:10:32.946659+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:10:32.946659+0000","last_undegraded":"2023-10-16T20:10:32.946659+0000","last_fullsized":"2023-10-16T20:10:32.946659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:37.710069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.522059+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T20:10:33.522059+0000","last_peered":"2023-10-16T20:10:33.522059+0000","last_clean":"2023-10-16T20:10:33.522059+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:10:33.522059+0000","last_undegraded":"2023-10-16T20:10:33.522059+0000","last_fullsized":"2023-10-16T20:10:33.522059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:34.102433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'120","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:48.805794+0000","last_change":"2023-10-16T20:10:48.805896+0000","last_active":"2023-10-16T20:10:48.805794+0000","last_peered":"2023-10-16T20:10:48.805794+0000","last_clean":"2023-10-16T20:10:48.805794+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:10:48.805794+0000","last_undegraded":"2023-10-16T20:10:48.805794+0000","last_fullsized":"2023-10-16T20:10:48.805794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'120","last_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_deep_scrub":"25'120","last_deep_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_clean_scrub_stamp":"2023-10-16T20:10:48.805692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:38:07.417459+0000","scrub_duration":0.014508691000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.411939+0000","last_change":"2023-10-16T19:40:59.129110+0000","last_active":"2023-10-16T20:10:33.411939+0000","last_peered":"2023-10-16T20:10:33.411939+0000","last_clean":"2023-10-16T20:10:33.411939+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:33.411939+0000","last_undegraded":"2023-10-16T20:10:33.411939+0000","last_fullsized":"2023-10-16T20:10:33.411939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:51.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'193","reported_seq":232,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.308786+0000","last_change":"2023-10-16T20:10:52.308932+0000","last_active":"2023-10-16T20:10:52.308786+0000","last_peered":"2023-10-16T20:10:52.308786+0000","last_clean":"2023-10-16T20:10:52.308786+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:52.308786+0000","last_undegraded":"2023-10-16T20:10:52.308786+0000","last_fullsized":"2023-10-16T20:10:52.308786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.308606+0000","objects_scrubbed":2,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:05:12.902639+0000","scrub_duration":0.0076596310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.360807+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T20:10:33.360807+0000","last_peered":"2023-10-16T20:10:33.360807+0000","last_clean":"2023-10-16T20:10:33.360807+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:10:33.360807+0000","last_undegraded":"2023-10-16T20:10:33.360807+0000","last_fullsized":"2023-10-16T20:10:33.360807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:25.176509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'11","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:49.778351+0000","last_change":"2023-10-16T20:10:49.778439+0000","last_active":"2023-10-16T20:10:49.778351+0000","last_peered":"2023-10-16T20:10:49.778351+0000","last_clean":"2023-10-16T20:10:49.778351+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:49.778351+0000","last_undegraded":"2023-10-16T20:10:49.778351+0000","last_fullsized":"2023-10-16T20:10:49.778351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_clean_scrub_stamp":"2023-10-16T20:10:49.778235+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:34:46.159193+0000","scrub_duration":0.0051660639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.410999+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T20:10:33.410999+0000","last_peered":"2023-10-16T20:10:33.410999+0000","last_clean":"2023-10-16T20:10:33.410999+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:10:33.410999+0000","last_undegraded":"2023-10-16T20:10:33.410999+0000","last_fullsized":"2023-10-16T20:10:33.410999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:09.401433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.417624+0000","last_change":"2023-10-16T19:40:56.399501+0000","last_active":"2023-10-16T20:10:13.417624+0000","last_peered":"2023-10-16T20:10:13.417624+0000","last_clean":"2023-10-16T20:10:13.417624+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:10:13.417624+0000","last_undegraded":"2023-10-16T20:10:13.417624+0000","last_fullsized":"2023-10-16T20:10:13.417624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:40.976394+0000","last_change":"2023-10-16T19:41:25.728395+0000","last_active":"2023-10-16T20:10:40.976394+0000","last_peered":"2023-10-16T20:10:40.976394+0000","last_clean":"2023-10-16T20:10:40.976394+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:10:40.976394+0000","last_undegraded":"2023-10-16T20:10:40.976394+0000","last_fullsized":"2023-10-16T20:10:40.976394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'595","reported_seq":634,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.839482+0000","last_change":"2023-10-16T20:10:50.839718+0000","last_active":"2023-10-16T20:10:50.839482+0000","last_peered":"2023-10-16T20:10:50.839482+0000","last_clean":"2023-10-16T20:10:50.839482+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:50.839482+0000","last_undegraded":"2023-10-16T20:10:50.839482+0000","last_fullsized":"2023-10-16T20:10:50.839482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'595","last_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_deep_scrub":"25'595","last_deep_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.839312+0000","objects_scrubbed":3,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:26.515689+0000","scrub_duration":0.036436172000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.439287+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T20:10:33.439287+0000","last_peered":"2023-10-16T20:10:33.439287+0000","last_clean":"2023-10-16T20:10:33.439287+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:10:33.439287+0000","last_undegraded":"2023-10-16T20:10:33.439287+0000","last_fullsized":"2023-10-16T20:10:33.439287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:08:41.292217+0000","last_change":"2023-10-16T19:40:41.707702+0000","last_active":"2023-10-16T20:08:41.292217+0000","last_peered":"2023-10-16T20:08:41.292217+0000","last_clean":"2023-10-16T20:08:41.292217+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:08:41.292217+0000","last_undegraded":"2023-10-16T20:08:41.292217+0000","last_fullsized":"2023-10-16T20:08:41.292217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:38.554307+0000","last_clean_scrub_stamp":"2023-10-16T19:40:38.554307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:10.883389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:08:01.239242+0000","last_change":"2023-10-16T19:40:56.485275+0000","last_active":"2023-10-16T20:08:01.239242+0000","last_peered":"2023-10-16T20:08:01.239242+0000","last_clean":"2023-10-16T20:08:01.239242+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:08:01.239242+0000","last_undegraded":"2023-10-16T20:08:01.239242+0000","last_fullsized":"2023-10-16T20:08:01.239242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:14.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.501528+0000","last_change":"2023-10-16T19:40:59.155834+0000","last_active":"2023-10-16T20:10:33.501528+0000","last_peered":"2023-10-16T20:10:33.501528+0000","last_clean":"2023-10-16T20:10:33.501528+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:10:33.501528+0000","last_undegraded":"2023-10-16T20:10:33.501528+0000","last_fullsized":"2023-10-16T20:10:33.501528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'10","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.421795+0000","last_change":"2023-10-16T19:40:56.467650+0000","last_active":"2023-10-16T20:10:13.421795+0000","last_peered":"2023-10-16T20:10:13.421795+0000","last_clean":"2023-10-16T20:10:13.421795+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:10:13.421795+0000","last_undegraded":"2023-10-16T20:10:13.421795+0000","last_fullsized":"2023-10-16T20:10:13.421795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:26.532701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.579930+0000","last_change":"2023-10-16T19:40:59.181939+0000","last_active":"2023-10-16T20:10:33.579930+0000","last_peered":"2023-10-16T20:10:33.579930+0000","last_clean":"2023-10-16T20:10:33.579930+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:10:33.579930+0000","last_undegraded":"2023-10-16T20:10:33.579930+0000","last_fullsized":"2023-10-16T20:10:33.579930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'180","reported_seq":300,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.948172+0000","last_change":"2023-10-16T19:40:56.485533+0000","last_active":"2023-10-16T20:10:32.948172+0000","last_peered":"2023-10-16T20:10:32.948172+0000","last_clean":"2023-10-16T20:10:32.948172+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:32.948172+0000","last_undegraded":"2023-10-16T20:10:32.948172+0000","last_fullsized":"2023-10-16T20:10:32.948172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.375291+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T20:10:33.375291+0000","last_peered":"2023-10-16T20:10:33.375291+0000","last_clean":"2023-10-16T20:10:33.375291+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:10:33.375291+0000","last_undegraded":"2023-10-16T20:10:33.375291+0000","last_fullsized":"2023-10-16T20:10:33.375291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'439","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:32.949381+0000","last_change":"2023-10-16T19:40:56.397072+0000","last_active":"2023-10-16T20:10:32.949381+0000","last_peered":"2023-10-16T20:10:32.949381+0000","last_clean":"2023-10-16T20:10:32.949381+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:10:32.949381+0000","last_undegraded":"2023-10-16T20:10:32.949381+0000","last_fullsized":"2023-10-16T20:10:32.949381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596760+0000","last_change":"2023-10-16T19:40:59.182316+0000","last_active":"2023-10-16T20:10:33.596760+0000","last_peered":"2023-10-16T20:10:33.596760+0000","last_clean":"2023-10-16T20:10:33.596760+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:10:33.596760+0000","last_undegraded":"2023-10-16T20:10:33.596760+0000","last_fullsized":"2023-10-16T20:10:33.596760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.099941+0000","last_change":"2023-10-16T20:10:51.100008+0000","last_active":"2023-10-16T20:10:51.099941+0000","last_peered":"2023-10-16T20:10:51.099941+0000","last_clean":"2023-10-16T20:10:51.099941+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:51.099941+0000","last_undegraded":"2023-10-16T20:10:51.099941+0000","last_fullsized":"2023-10-16T20:10:51.099941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.099844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:15:33.686104+0000","scrub_duration":0.0037505049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586134+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T20:10:33.586134+0000","last_peered":"2023-10-16T20:10:33.586134+0000","last_clean":"2023-10-16T20:10:33.586134+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:10:33.586134+0000","last_undegraded":"2023-10-16T20:10:33.586134+0000","last_fullsized":"2023-10-16T20:10:33.586134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:23.192760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'72","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:08.061284+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T20:10:08.061284+0000","last_peered":"2023-10-16T20:10:08.061284+0000","last_clean":"2023-10-16T20:10:08.061284+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:10:08.061284+0000","last_undegraded":"2023-10-16T20:10:08.061284+0000","last_fullsized":"2023-10-16T20:10:08.061284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:22.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.384369+0000","last_change":"2023-10-16T19:40:59.178430+0000","last_active":"2023-10-16T20:10:33.384369+0000","last_peered":"2023-10-16T20:10:33.384369+0000","last_clean":"2023-10-16T20:10:33.384369+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:10:33.384369+0000","last_undegraded":"2023-10-16T20:10:33.384369+0000","last_fullsized":"2023-10-16T20:10:33.384369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'179","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:31.791158+0000","last_change":"2023-10-16T19:40:56.415756+0000","last_active":"2023-10-16T20:10:31.791158+0000","last_peered":"2023-10-16T20:10:31.791158+0000","last_clean":"2023-10-16T20:10:31.791158+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:31.791158+0000","last_undegraded":"2023-10-16T20:10:31.791158+0000","last_fullsized":"2023-10-16T20:10:31.791158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.622716+0000","last_change":"2023-10-16T19:41:25.493927+0000","last_active":"2023-10-16T20:10:33.622716+0000","last_peered":"2023-10-16T20:10:33.622716+0000","last_clean":"2023-10-16T20:10:33.622716+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:10:33.622716+0000","last_undegraded":"2023-10-16T20:10:33.622716+0000","last_fullsized":"2023-10-16T20:10:33.622716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'15","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.432292+0000","last_change":"2023-10-16T19:40:56.460051+0000","last_active":"2023-10-16T20:10:13.432292+0000","last_peered":"2023-10-16T20:10:13.432292+0000","last_clean":"2023-10-16T20:10:13.432292+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:10:13.432292+0000","last_undegraded":"2023-10-16T20:10:13.432292+0000","last_fullsized":"2023-10-16T20:10:13.432292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:26.082900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581139+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T20:10:33.581139+0000","last_peered":"2023-10-16T20:10:33.581139+0000","last_clean":"2023-10-16T20:10:33.581139+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:10:33.581139+0000","last_undegraded":"2023-10-16T20:10:33.581139+0000","last_fullsized":"2023-10-16T20:10:33.581139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:03.895071+0000","last_change":"2023-10-16T19:40:56.468503+0000","last_active":"2023-10-16T20:10:03.895071+0000","last_peered":"2023-10-16T20:10:03.895071+0000","last_clean":"2023-10-16T20:10:03.895071+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:10:03.895071+0000","last_undegraded":"2023-10-16T20:10:03.895071+0000","last_fullsized":"2023-10-16T20:10:03.895071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:25.340371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.596820+0000","last_change":"2023-10-16T19:40:59.179758+0000","last_active":"2023-10-16T20:10:33.596820+0000","last_peered":"2023-10-16T20:10:33.596820+0000","last_clean":"2023-10-16T20:10:33.596820+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:33.596820+0000","last_undegraded":"2023-10-16T20:10:33.596820+0000","last_fullsized":"2023-10-16T20:10:33.596820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'178","reported_seq":217,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:47.079466+0000","last_change":"2023-10-16T20:10:47.079655+0000","last_active":"2023-10-16T20:10:47.079466+0000","last_peered":"2023-10-16T20:10:47.079466+0000","last_clean":"2023-10-16T20:10:47.079466+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:47.079466+0000","last_undegraded":"2023-10-16T20:10:47.079466+0000","last_fullsized":"2023-10-16T20:10:47.079466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_clean_scrub_stamp":"2023-10-16T20:10:47.079299+0000","objects_scrubbed":4,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:58.646035+0000","scrub_duration":0.012090556000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.494481+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T20:10:33.494481+0000","last_peered":"2023-10-16T20:10:33.494481+0000","last_clean":"2023-10-16T20:10:33.494481+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:10:33.494481+0000","last_undegraded":"2023-10-16T20:10:33.494481+0000","last_fullsized":"2023-10-16T20:10:33.494481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'429","reported_seq":468,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.061819+0000","last_change":"2023-10-16T20:10:50.061870+0000","last_active":"2023-10-16T20:10:50.061819+0000","last_peered":"2023-10-16T20:10:50.061819+0000","last_clean":"2023-10-16T20:10:50.061819+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:50.061819+0000","last_undegraded":"2023-10-16T20:10:50.061819+0000","last_fullsized":"2023-10-16T20:10:50.061819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.061747+0000","objects_scrubbed":2,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:43.780025+0000","scrub_duration":0.007646229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504229+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T20:10:33.504229+0000","last_peered":"2023-10-16T20:10:33.504229+0000","last_clean":"2023-10-16T20:10:33.504229+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:10:33.504229+0000","last_undegraded":"2023-10-16T20:10:33.504229+0000","last_fullsized":"2023-10-16T20:10:33.504229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'12","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:11.310375+0000","last_change":"2023-10-16T19:40:56.464371+0000","last_active":"2023-10-16T20:10:11.310375+0000","last_peered":"2023-10-16T20:10:11.310375+0000","last_clean":"2023-10-16T20:10:11.310375+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:10:11.310375+0000","last_undegraded":"2023-10-16T20:10:11.310375+0000","last_fullsized":"2023-10-16T20:10:11.310375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:19.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.606147+0000","last_change":"2023-10-16T19:40:59.210100+0000","last_active":"2023-10-16T20:10:33.606147+0000","last_peered":"2023-10-16T20:10:33.606147+0000","last_clean":"2023-10-16T20:10:33.606147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:10:33.606147+0000","last_undegraded":"2023-10-16T20:10:33.606147+0000","last_fullsized":"2023-10-16T20:10:33.606147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:22.215891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590732+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T20:10:33.590732+0000","last_peered":"2023-10-16T20:10:33.590732+0000","last_clean":"2023-10-16T20:10:33.590732+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:10:33.590732+0000","last_undegraded":"2023-10-16T20:10:33.590732+0000","last_fullsized":"2023-10-16T20:10:33.590732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:48.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'10","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:13.665125+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T20:10:13.665125+0000","last_peered":"2023-10-16T20:10:13.665125+0000","last_clean":"2023-10-16T20:10:13.665125+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:10:13.665125+0000","last_undegraded":"2023-10-16T20:10:13.665125+0000","last_fullsized":"2023-10-16T20:10:13.665125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:03.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.580795+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T20:10:33.580795+0000","last_peered":"2023-10-16T20:10:33.580795+0000","last_clean":"2023-10-16T20:10:33.580795+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:10:33.580795+0000","last_undegraded":"2023-10-16T20:10:33.580795+0000","last_fullsized":"2023-10-16T20:10:33.580795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.913021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'149","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:06.159611+0000","last_change":"2023-10-16T19:40:56.463846+0000","last_active":"2023-10-16T20:10:06.159611+0000","last_peered":"2023-10-16T20:10:06.159611+0000","last_clean":"2023-10-16T20:10:06.159611+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:10:06.159611+0000","last_undegraded":"2023-10-16T20:10:06.159611+0000","last_fullsized":"2023-10-16T20:10:06.159611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:04.324663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583243+0000","last_change":"2023-10-16T19:40:59.175243+0000","last_active":"2023-10-16T20:10:33.583243+0000","last_peered":"2023-10-16T20:10:33.583243+0000","last_clean":"2023-10-16T20:10:33.583243+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:10:33.583243+0000","last_undegraded":"2023-10-16T20:10:33.583243+0000","last_fullsized":"2023-10-16T20:10:33.583243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.791061+0000","last_change":"2023-10-16T20:10:50.791172+0000","last_active":"2023-10-16T20:10:50.791061+0000","last_peered":"2023-10-16T20:10:50.791061+0000","last_clean":"2023-10-16T20:10:50.791061+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:10:50.791061+0000","last_undegraded":"2023-10-16T20:10:50.791061+0000","last_fullsized":"2023-10-16T20:10:50.791061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.790831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:27.440790+0000","scrub_duration":0.0041105270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.415331+0000","last_change":"2023-10-16T19:40:59.210481+0000","last_active":"2023-10-16T20:10:33.415331+0000","last_peered":"2023-10-16T20:10:33.415331+0000","last_clean":"2023-10-16T20:10:33.415331+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:10:33.415331+0000","last_undegraded":"2023-10-16T20:10:33.415331+0000","last_fullsized":"2023-10-16T20:10:33.415331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:46.154118+0000","last_change":"2023-10-16T20:10:46.154175+0000","last_active":"2023-10-16T20:10:46.154118+0000","last_peered":"2023-10-16T20:10:46.154118+0000","last_clean":"2023-10-16T20:10:46.154118+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:46.154118+0000","last_undegraded":"2023-10-16T20:10:46.154118+0000","last_fullsized":"2023-10-16T20:10:46.154118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_clean_scrub_stamp":"2023-10-16T20:10:46.154049+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:41:39.554198+0000","scrub_duration":0.0087997690000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":7937,"ondisk_log_size":7937,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509806,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.2010000000000001,"15min":1.173},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.5589999999999999,"5min":2.0569999999999999,"15min":2.085},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.216,"15min":1.2909999999999999},"min":{"1min":0.77300000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.8140000000000001,"5min":1.9510000000000001,"15min":2.1520000000000001},"last":0.97999999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.2330000000000001},"min":{"1min":0.70999999999999996,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.774,"5min":1.996,"15min":2.3050000000000002},"last":1.774},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2569999999999999,"15min":1.3180000000000001},"min":{"1min":0.90200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.665,"5min":1.8320000000000001,"15min":2.27},"last":1.665}]},{"osd":2,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2689999999999999,"15min":1.3200000000000001},"min":{"1min":0.83299999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7909999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.165},{"interface":"front","average":{"1min":1.264,"5min":1.377,"15min":1.4099999999999999},"min":{"1min":0.95699999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.7629999999999999,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.6080000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.4079999999999999},"min":{"1min":0.81299999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6990000000000001,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.464,"5min":1.4730000000000001,"15min":1.4990000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8140000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.3520000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3169999999999999,"15min":1.3069999999999999},"min":{"1min":0.89200000000000002,"5min":0.626,"15min":0.624},"max":{"1min":1.821,"5min":1.8759999999999999,"15min":2.375},"last":1.724},{"interface":"front","average":{"1min":1.331,"5min":1.3759999999999999,"15min":1.403},"min":{"1min":1.036,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8859999999999999,"5min":2.298,"15min":2.5459999999999998},"last":1.056}]},{"osd":5,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.454,"15min":1.456},"min":{"1min":1.083,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.9530000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.508},{"interface":"front","average":{"1min":1.403,"5min":1.5,"15min":1.5109999999999999},"min":{"1min":0.72899999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.7629999999999999,"5min":2.2490000000000001,"15min":2.4750000000000001},"last":1.552}]},{"osd":6,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.5740000000000001,"15min":1.5960000000000001},"min":{"1min":1.0860000000000001,"5min":0.82599999999999996,"15min":0.80500000000000005},"max":{"1min":1.8700000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.448},{"interface":"front","average":{"1min":1.544,"5min":1.5509999999999999,"15min":1.5640000000000001},"min":{"1min":1.1859999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9990000000000001,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.2989999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509806,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1739999999999999,"15min":1.196},"min":{"1min":0.74099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.899,"5min":1.931,"15min":2.4380000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.155,"5min":1.294,"15min":1.276},"min":{"1min":0.70899999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6759999999999999,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.008}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2170000000000001,"15min":1.2509999999999999},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7569999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.373,"15min":1.3480000000000001},"min":{"1min":0.93100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.2349999999999999,"15min":2.6680000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.393,"15min":1.413},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.0190000000000001,"5min":2.367,"15min":2.367},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.381,"15min":1.4039999999999999},"min":{"1min":0.88,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.3100000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.478,"15min":1.476},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5800000000000001,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.4650000000000001,"15min":1.4470000000000001},"min":{"1min":1.022,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":1.972,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2330000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.399,"15min":1.3660000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7729999999999999,"5min":3.415,"15min":3.415},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.4490000000000001,"15min":1.417},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8400000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.1499999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4259999999999999,"15min":1.387},"min":{"1min":1.0069999999999999,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":1.952,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.361},{"interface":"front","average":{"1min":1.536,"5min":1.6020000000000001,"15min":1.5569999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.68300000000000005},"max":{"1min":1.843,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.3919999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.96799999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.7929999999999999,"5min":3.145,"15min":3.145},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.6240000000000001,"15min":1.581},"min":{"1min":1.2889999999999999,"5min":1.044,"15min":0.98799999999999999},"max":{"1min":2.1219999999999999,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.419}]}]},{"osd":5,"up_from":15,"seq":64424509807,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82599999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8700000000000001,"5min":1.954,"15min":2.3839999999999999},"last":1.236}]},{"osd":1,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.7250000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":0.97799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0169999999999999,"5min":2.677,"15min":2.677},"last":0.97299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.397,"15min":1.347},"min":{"1min":1.026,"5min":0.83599999999999997,"15min":0.69699999999999995},"max":{"1min":1.9690000000000001,"5min":2.177,"15min":2.448},"last":1.137},{"interface":"front","average":{"1min":1.403,"5min":1.4470000000000001,"15min":1.4510000000000001},"min":{"1min":1.1200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.9039999999999999,"5min":2.476,"15min":2.6040000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4570000000000001,"15min":1.4610000000000001},"min":{"1min":1.073,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.8140000000000001,"5min":2.3370000000000002,"15min":2.3650000000000002},"last":1.387},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5449999999999999,"15min":1.526},"min":{"1min":1.3049999999999999,"5min":1.048,"15min":0.77000000000000002},"max":{"1min":1.899,"5min":2.71,"15min":2.71},"last":1.4590000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.347,"15min":1.3460000000000001},"min":{"1min":0.88400000000000001,"5min":0.628,"15min":0.628},"max":{"1min":2.149,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.95799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1080000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.6040000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5149999999999999,"15min":1.4790000000000001},"min":{"1min":1.0169999999999999,"5min":0.80500000000000005,"15min":0.79000000000000004},"max":{"1min":2.375,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":1.569},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5389999999999999,"15min":1.5149999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.169,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.5920000000000001,"15min":1.597},"min":{"1min":1.153,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":1.9350000000000001,"5min":2.6819999999999999,"15min":2.7629999999999999},"last":1.482},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.673,"15min":1.659},"min":{"1min":1.1839999999999999,"5min":1.097,"15min":0.91900000000000004},"max":{"1min":2.452,"5min":2.5979999999999999,"15min":2.867},"last":1.52}]}]},{"osd":3,"up_from":15,"seq":64424509806,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.67600000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.7350000000000001,"5min":2.274,"15min":2.7069999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.095,"5min":1.2310000000000001,"15min":1.2709999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52100000000000002},"max":{"1min":1.986,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.345,"15min":1.3740000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":2.0259999999999998,"5min":2.964,"15min":2.964},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.331,"5min":1.5669999999999999,"15min":1.579},"min":{"1min":0.754,"5min":0.68300000000000005,"15min":0.57299999999999995},"max":{"1min":1.8360000000000001,"5min":3.056,"15min":3.1779999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.611,"15min":1.669},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.52700000000000002},"max":{"1min":2.218,"5min":2.996,"15min":3.5310000000000001},"last":0.752},{"interface":"front","average":{"1min":1.431,"5min":1.681,"15min":1.7430000000000001},"min":{"1min":0.84899999999999998,"5min":0.79900000000000004,"15min":0.69499999999999995},"max":{"1min":2.137,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":0.82199999999999995}]},{"osd":4,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4970000000000001,"15min":1.5660000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.71399999999999997},"max":{"1min":1.6779999999999999,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.617,"15min":1.645},"min":{"1min":0.96899999999999997,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":1.9319999999999999,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.2949999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.6879999999999999,"15min":1.734},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.68999999999999995},"max":{"1min":1.9630000000000001,"5min":3.52,"15min":3.52},"last":1.24},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.6459999999999999,"15min":1.6839999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.64600000000000002},"max":{"1min":2.077,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.4319999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.7809999999999999,"15min":1.788},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.72199999999999998},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":3.1000000000000001},"last":1.514},{"interface":"front","average":{"1min":1.641,"5min":1.796,"15min":1.8600000000000001},"min":{"1min":1.0760000000000001,"5min":0.98999999999999999,"15min":0.73099999999999998},"max":{"1min":2.129,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.78,"15min":1.827},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.75},"max":{"1min":1.97,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.379},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.929,"15min":1.931},"min":{"1min":1.115,"5min":1.115,"15min":0.66800000000000004},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":3.2330000000000001},"last":1.258}]}]},{"osd":2,"up_from":15,"seq":64424509807,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.048,"15min":1.073},"min":{"1min":0.71599999999999997,"5min":0.437,"15min":0.437},"max":{"1min":1.7729999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.383,"15min":1.383},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0630000000000002,"5min":3.1179999999999999,"15min":3.702},"last":1.1759999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.429,"15min":1.4630000000000001},"min":{"1min":0.72499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.0019999999999998,"5min":2.4889999999999999,"15min":2.738},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.873,"5min":0.81200000000000006,"15min":0.71199999999999997},"max":{"1min":2.4660000000000002,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.6359999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.5920000000000001,"15min":1.5660000000000001},"min":{"1min":0.875,"5min":0.71299999999999997,"15min":0.61799999999999999},"max":{"1min":2.504,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.097},{"interface":"front","average":{"1min":1.486,"5min":1.6819999999999999,"15min":1.71},"min":{"1min":1.0700000000000001,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":2.1269999999999998,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.349}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.645,"15min":1.657},"min":{"1min":1.0409999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9199999999999999,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.6539999999999999,"15min":1.649},"min":{"1min":1.155,"5min":1.0369999999999999,"15min":0.98399999999999999},"max":{"1min":2.105,"5min":2.6669999999999998,"15min":3.54},"last":1.734}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6859999999999999,"15min":1.639},"min":{"1min":1.109,"5min":1.095,"15min":0.71199999999999997},"max":{"1min":2.4060000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.526},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.744,"15min":1.7749999999999999},"min":{"1min":1.181,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.056,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.46}]},{"osd":6,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.8049999999999999,"15min":1.8109999999999999},"min":{"1min":1.347,"5min":1.167,"15min":1.1020000000000001},"max":{"1min":2.2440000000000002,"5min":3.1720000000000002,"15min":3.6259999999999999},"last":1.911},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.788,"15min":1.7769999999999999},"min":{"1min":1.2569999999999999,"5min":1.147,"15min":0.877},"max":{"1min":2.423,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.2829999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.8480000000000001,"15min":1.885},"min":{"1min":1.3799999999999999,"5min":1.163,"15min":1.0109999999999999},"max":{"1min":2.3599999999999999,"5min":3.012,"15min":3.7839999999999998},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.772,"5min":1.8779999999999999,"15min":1.8700000000000001},"min":{"1min":1.413,"5min":1.359,"15min":0.89200000000000002},"max":{"1min":2.5590000000000002,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.4159999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509807,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.514,"5min":2.3690000000000002,"15min":3.1960000000000002},"last":1.147},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3500000000000001,"15min":1.373},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.9279999999999999,"5min":2.7789999999999999,"15min":2.9929999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3660000000000001,"15min":1.5049999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6830000000000001,"5min":2.8330000000000002,"15min":2.8359999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.51,"15min":1.5660000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.964,"5min":2.8769999999999998,"15min":3.3450000000000002},"last":1.0049999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3979999999999999,"15min":1.5760000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.8500000000000001,"5min":2.3599999999999999,"15min":4.6660000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7969999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":2.0819999999999999,"5min":2.9359999999999999,"15min":3.2829999999999999},"last":1.681}]},{"osd":4,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.579,"15min":1.671},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.9239999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.272},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.655,"15min":1.712},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.79700000000000004},"max":{"1min":2.1869999999999998,"5min":2.544,"15min":3.1890000000000001},"last":1.5509999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.7090000000000001,"15min":1.7310000000000001},"min":{"1min":0.96299999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.0569999999999999,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6719999999999999,"15min":1.7569999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9119999999999999,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.3899999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.788,"15min":1.863},"min":{"1min":1.115,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1789999999999998,"5min":2.8290000000000002,"15min":3.399},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.821,"15min":1.847},"min":{"1min":1.022,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":2.532,"5min":3.0649999999999999,"15min":3.46},"last":1.4950000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.913,"15min":1.9570000000000001},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1000000000000001},"max":{"1min":2.6160000000000001,"5min":3.21,"15min":3.6160000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.792,"15min":1.8939999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.3140000000000001,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.456}]}]},{"osd":4,"up_from":14,"seq":60129542511,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1990000000000001,"15min":1.1919999999999999},"min":{"1min":0.77500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.972,"5min":1.972,"15min":2.5649999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.794,"5min":1.304,"15min":1.3200000000000001},"min":{"1min":0.63900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":9.0700000000000003,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.141}]},{"osd":1,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.361,"15min":1.3360000000000001},"min":{"1min":0.93799999999999994,"5min":0.77200000000000002,"15min":0.747},"max":{"1min":9.1120000000000001,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":2.1459999999999999,"5min":1.4179999999999999,"15min":1.3580000000000001},"min":{"1min":0.746,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":17.715,"5min":17.715,"15min":17.715},"last":1.4099999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.393,"15min":1.4039999999999999},"min":{"1min":0.84799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.542},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.873,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.0780000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.4890000000000001,"15min":1.478},"min":{"1min":0.90500000000000003,"5min":0.90400000000000003,"15min":0.81200000000000006},"max":{"1min":8.2469999999999999,"5min":8.2469999999999999,"15min":8.2469999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.897,"5min":1.573,"15min":1.548},"min":{"1min":1.0860000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":8.2769999999999992,"5min":8.2769999999999992,"15min":8.2769999999999992},"last":1.8240000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.339,"15min":1.331},"min":{"1min":1.0089999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0249999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.774,"5min":1.498,"15min":1.4690000000000001},"min":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":8.1869999999999994,"5min":8.1869999999999994,"15min":8.1869999999999994},"last":1.373}]},{"osd":6,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.4830000000000001,"15min":1.45},"min":{"1min":1.046,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.724},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.53,"15min":1.5249999999999999},"min":{"1min":1.056,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":2.0859999999999999,"5min":2.512,"15min":2.601},"last":1.171}]},{"osd":7,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.921,"5min":1.641,"15min":1.587},"min":{"1min":1.0629999999999999,"5min":0.92600000000000005,"15min":0.86299999999999999},"max":{"1min":8.7769999999999992,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.2989999999999999},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.706,"15min":1.649},"min":{"1min":1.194,"5min":1.0449999999999999,"15min":0.999},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.637}]}]},{"osd":1,"up_from":14,"seq":60129542511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.145,"15min":1.1890000000000001},"min":{"1min":0.67600000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.7390000000000001,"5min":2.944,"15min":2.944},"last":1.05},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.179,"15min":1.2989999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.8,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3640000000000001,"15min":1.421},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1930000000000001,"5min":2.835,"15min":3.585},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.5009999999999999,"15min":1.5800000000000001},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.75,"5min":2.6659999999999999,"15min":2.8719999999999999},"last":1.4770000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.669,"15min":1.7130000000000001},"min":{"1min":0.747,"5min":0.63,"15min":0.63},"max":{"1min":1.9339999999999999,"5min":2.831,"15min":3.3740000000000001},"last":1.585},{"interface":"front","average":{"1min":1.369,"5min":1.5389999999999999,"15min":1.5880000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51200000000000001},"max":{"1min":1.9870000000000001,"5min":2.8370000000000002,"15min":3.234},"last":0.88800000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.5780000000000001,"15min":1.5820000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.71499999999999997},"max":{"1min":1.9259999999999999,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.673,"15min":1.6839999999999999},"min":{"1min":1.159,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":2.1459999999999999,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.772}]},{"osd":5,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.613,"15min":1.6559999999999999},"min":{"1min":0.80800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.016,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.7390000000000001,"15min":1.748},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.77400000000000002},"max":{"1min":2.1179999999999999,"5min":3.2170000000000001,"15min":3.819},"last":1.3660000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.7829999999999999,"15min":1.819},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.1930000000000001,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.512},{"interface":"front","average":{"1min":1.627,"5min":1.8220000000000001,"15min":1.8440000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.746},"max":{"1min":1.982,"5min":2.698,"15min":3.3210000000000002},"last":1.7110000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.7490000000000001,"15min":1.8220000000000001},"min":{"1min":1.1339999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1499999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.931,"15min":1.9610000000000001},"min":{"1min":1.052,"5min":1.052,"15min":0.96299999999999997},"max":{"1min":2.246,"5min":3.3239999999999998,"15min":3.923},"last":1.6399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:55.368 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.368 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.369 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.369 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.369 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.370 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.370 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.370 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.371 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.371 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.371 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.371 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.372 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.372 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.373 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.373 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.373 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.374 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.374 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.374 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.374 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.375 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.375 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.375 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.376 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.376 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.376 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.376 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.377 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.377 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.377 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.378 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.378 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.378 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.378 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.379 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.379 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.379 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.380 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.380 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.380 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.381 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.381 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.381 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.381 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.382 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.382 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.382 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.383 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.383 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.383 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.384 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.384 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.384 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.385 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.385 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.385 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.385 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.386 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.386 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.386 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-16T19:40:38.554307+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=38, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.387 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.387 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.387 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.388 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.388 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.388 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.388 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.389 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.389 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.389 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.390 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.390 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.390 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.391 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.391 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.391 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.391 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.392 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.392 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.392 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.393 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.393 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.393 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.394 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.394 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.394 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.394 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.395 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:10:55.502 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:55.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:15.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:11:15.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.630+0000 7f5a8bfff640 1 Processor -- start 2023-10-16T20:11:15.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.630+0000 7f5a8bfff640 1 -- start start 2023-10-16T20:11:15.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.632+0000 7f5a8bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a8c151040 0x7f5a8c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.632+0000 7f5a8bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c06e340 0x7f5a8c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.632+0000 7f5a8bfff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0c5340 con 0x7f5a8c06b9c0 2023-10-16T20:11:15.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.632+0000 7f5a8bfff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c7e90 con 0x7f5a8c151040 2023-10-16T20:11:15.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.632+0000 7f5a8bfff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c47e0 con 0x7f5a8c06e340 2023-10-16T20:11:15.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.633+0000 7f5a8b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5a8c06b9c0 0x7f5a8c06d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49956/0 (socket says 172.21.15.57:49956) 2023-10-16T20:11:15.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.633+0000 7f5a8b7fe640 1 -- 172.21.15.57:0/198394048 learned_addr learned my addr 172.21.15.57:0/198394048 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:11:15.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.634+0000 7f5a8affd640 1 --2- 172.21.15.57:0/198394048 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c151040 0x7f5a8c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.634+0000 7f5a827fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c06e340 0x7f5a8c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.636+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122171486 0 0) 0x7f5a8c0c5340 con 0x7f5a8c06b9c0 2023-10-16T20:11:15.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.636+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a78003520 con 0x7f5a8c06b9c0 2023-10-16T20:11:15.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3750728971 0 0) 0x7f5a78003520 con 0x7f5a8c06b9c0 2023-10-16T20:11:15.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c06e340 msgr2=0x7f5a8c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:15.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c06e340 0x7f5a8c06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c151040 msgr2=0x7f5a8c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 --2- 172.21.15.57:0/198394048 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c151040 0x7f5a8c0c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0c2c40 con 0x7f5a8c06b9c0 2023-10-16T20:11:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3204454156 0 0) 0x7f5a840019f0 con 0x7f5a8c06b9c0 2023-10-16T20:11:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 >> v1:172.21.15.57:6789/0 conn(0x7f5a8c06b9c0 legacy=0x7f5a8c06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a78003970 0x7f5a78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780047c0 0x7f5a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a78005180 0x7f5a7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c7e90 con 0x7f5a78005180 2023-10-16T20:11:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c47e0 con 0x7f5a780047c0 2023-10-16T20:11:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7800bec0 con 0x7f5a78003970 2023-10-16T20:11:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.641+0000 7f5a827fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c06e340 0x7f5a8c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:11:15.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.646+0000 7f5a8b7fe640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a78005180 0x7f5a7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.648+0000 7f5a8affd640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a78003970 0x7f5a78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.648+0000 7f5a827fc640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780047c0 0x7f5a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.654+0000 7f5a8b7fe640 1 -- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a78003970 msgr2=0x7f5a78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:15.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.654+0000 7f5a8b7fe640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a78003970 0x7f5a78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.654+0000 7f5a8b7fe640 1 -- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780047c0 msgr2=0x7f5a78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:15.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.654+0000 7f5a8b7fe640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780047c0 0x7f5a78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.654+0000 7f5a8b7fe640 1 -- 172.21.15.57:0/198394048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a78003520 con 0x7f5a78005180 2023-10-16T20:11:15.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.657+0000 7f5a8b7fe640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a78005180 0x7f5a7800b980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400a740 tx=0x7f5a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f190fb03047f733 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.664+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84034630 con 0x7f5a78005180 2023-10-16T20:11:15.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.664+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8402f070 con 0x7f5a78005180 2023-10-16T20:11:15.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.664+0000 7f5a8a7fc640 1 -- 172.21.15.57:0/198394048 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84034a70 con 0x7f5a78005180 2023-10-16T20:11:15.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.665+0000 7f5a8bfff640 1 -- 172.21.15.57:0/198394048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a78005180 msgr2=0x7f5a7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.665+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/198394048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a78005180 0x7f5a7800b980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400a740 tx=0x7f5a780057f0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.665+0000 7f5a8b7fe640 1 -- 172.21.15.57:0/198394048 reap_dead start 2023-10-16T20:11:15.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.666+0000 7f5a8bfff640 1 -- 172.21.15.57:0/198394048 shutdown_connections 2023-10-16T20:11:15.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.666+0000 7f5a8bfff640 1 -- 172.21.15.57:0/198394048 >> 172.21.15.57:0/198394048 conn(0x7f5a8c0c6f00 msgr2=0x7f5a8c0c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:15.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.666+0000 7f5a8bfff640 1 -- 172.21.15.57:0/198394048 shutdown_connections 2023-10-16T20:11:15.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.666+0000 7f5a8bfff640 1 -- 172.21.15.57:0/198394048 wait complete. 2023-10-16T20:11:15.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.668+0000 7f5a8bfff640 1 Processor -- start 2023-10-16T20:11:15.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.668+0000 7f5a8bfff640 1 -- start start 2023-10-16T20:11:15.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.670+0000 7f5a8bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a78005180 0x7f5a8c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.670+0000 7f5a8bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 0x7f5a8c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.670+0000 7f5a8bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c140780 0x7f5a8c140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.670+0000 7f5a8bfff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c141140 con 0x7f5a8c1428d0 2023-10-16T20:11:15.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.670+0000 7f5a8bfff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c143350 con 0x7f5a78005180 2023-10-16T20:11:15.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.670+0000 7f5a8bfff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1eec30 con 0x7f5a8c140780 2023-10-16T20:11:15.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.671+0000 7f5a827fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 0x7f5a8c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.671+0000 7f5a827fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 0x7f5a8c0c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40668/0 (socket says 172.21.15.57:40668) 2023-10-16T20:11:15.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.671+0000 7f5a827fc640 1 -- 172.21.15.57:0/1584301132 learned_addr learned my addr 172.21.15.57:0/1584301132 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:11:15.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.671+0000 7f5a8affd640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a78005180 0x7f5a8c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.672+0000 7f5a8b7fe640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c140780 0x7f5a8c140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.675+0000 7f5a827fc640 1 -- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c140780 msgr2=0x7f5a8c140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.675+0000 7f5a827fc640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c140780 0x7f5a8c140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.675+0000 7f5a827fc640 1 -- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a78005180 msgr2=0x7f5a8c159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.675+0000 7f5a827fc640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a78005180 0x7f5a8c159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.675+0000 7f5a827fc640 1 -- 172.21.15.57:0/1584301132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c1435f0 con 0x7f5a8c1428d0 2023-10-16T20:11:15.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.678+0000 7f5a827fc640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 0x7f5a8c0c9520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a740119d0 tx=0x7f5a74011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.684+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400faf0 con 0x7f5a8c1428d0 2023-10-16T20:11:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.684+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400fc50 con 0x7f5a8c1428d0 2023-10-16T20:11:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.684+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74014440 con 0x7f5a8c1428d0 2023-10-16T20:11:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.684+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c1438d0 con 0x7f5a8c1428d0 2023-10-16T20:11:15.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.684+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c1eef10 con 0x7f5a8c1428d0 2023-10-16T20:11:15.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.686+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c14ef90 con 0x7f5a8c1428d0 2023-10-16T20:11:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.726+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a74005990 con 0x7f5a8c1428d0 2023-10-16T20:11:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.728+0000 7f5a83fff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5a6c06aec0 0x7f5a6c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.729+0000 7f5a8affd640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5a6c06aec0 0x7f5a6c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.730+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5a740595c0 con 0x7f5a8c1428d0 2023-10-16T20:11:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:15.730+0000 7f5a8affd640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5a6c06aec0 0x7f5a6c06d380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009bc0 tx=0x7f5a7c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:16.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.034+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a74055200 con 0x7f5a8c1428d0 2023-10-16T20:11:16.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.256+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a8c15a2f0 con 0x7f5a6c06aec0 2023-10-16T20:11:16.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.268+0000 7f5a83fff640 1 -- 172.21.15.57:0/1584301132 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287790 (secure 0 0 0) 0x7f5a7c019070 con 0x7f5a6c06aec0 2023-10-16T20:11:16.275 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:11:16.276 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:11:16.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5a6c06aec0 msgr2=0x7f5a6c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:16.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5a6c06aec0 0x7f5a6c06d380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009bc0 tx=0x7f5a7c009190 comp rx=0 tx=0).stop 2023-10-16T20:11:16.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 msgr2=0x7f5a8c0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:16.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 0x7f5a8c0c9520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a740119d0 tx=0x7f5a74011dd0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 shutdown_connections 2023-10-16T20:11:16.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f5a6c06aec0 0x7f5a6c06d380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c140780 0x7f5a8c140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a8c1428d0 0x7f5a8c0c9520 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 --2- 172.21.15.57:0/1584301132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a78005180 0x7f5a8c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.274+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 >> 172.21.15.57:0/1584301132 conn(0x7f5a8c0c6f00 msgr2=0x7f5a8c0c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:16.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.275+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 shutdown_connections 2023-10-16T20:11:16.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:16.275+0000 7f5a8bfff640 1 -- 172.21.15.57:0/1584301132 wait complete. 2023-10-16T20:11:16.298 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":941,"stamp":"2023-10-16T20:11:16.244976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12917,"ondisk_log_size":12917,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005156"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.417811+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T20:10:33.417811+0000","last_peered":"2023-10-16T20:10:33.417811+0000","last_clean":"2023-10-16T20:10:33.417811+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:10:33.417811+0000","last_undegraded":"2023-10-16T20:10:33.417811+0000","last_fullsized":"2023-10-16T20:10:33.417811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.485962+0000","last_change":"2023-10-16T19:40:59.176845+0000","last_active":"2023-10-16T20:10:33.485962+0000","last_peered":"2023-10-16T20:10:33.485962+0000","last_clean":"2023-10-16T20:10:33.485962+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:10:33.485962+0000","last_undegraded":"2023-10-16T20:10:33.485962+0000","last_fullsized":"2023-10-16T20:10:33.485962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.113091+0000","last_change":"2023-10-16T20:10:58.113207+0000","last_active":"2023-10-16T20:10:58.113091+0000","last_peered":"2023-10-16T20:10:58.113091+0000","last_clean":"2023-10-16T20:10:58.113091+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:58.113091+0000","last_undegraded":"2023-10-16T20:10:58.113091+0000","last_fullsized":"2023-10-16T20:10:58.113091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.112934+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:56:36.903954+0000","scrub_duration":0.0043098260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.948125+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T20:10:51.948125+0000","last_peered":"2023-10-16T20:10:51.948125+0000","last_clean":"2023-10-16T20:10:51.948125+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:10:51.948125+0000","last_undegraded":"2023-10-16T20:10:51.948125+0000","last_fullsized":"2023-10-16T20:10:51.948125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:54.487174+0000","last_change":"2023-10-16T19:40:59.173521+0000","last_active":"2023-10-16T20:10:54.487174+0000","last_peered":"2023-10-16T20:10:54.487174+0000","last_clean":"2023-10-16T20:10:54.487174+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:10:54.487174+0000","last_undegraded":"2023-10-16T20:10:54.487174+0000","last_fullsized":"2023-10-16T20:10:54.487174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":83,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.948044+0000","last_change":"2023-10-16T19:40:59.176897+0000","last_active":"2023-10-16T20:10:51.948044+0000","last_peered":"2023-10-16T20:10:51.948044+0000","last_clean":"2023-10-16T20:10:51.948044+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:10:51.948044+0000","last_undegraded":"2023-10-16T20:10:51.948044+0000","last_fullsized":"2023-10-16T20:10:51.948044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.181264+0000","last_change":"2023-10-16T20:10:58.181264+0000","last_active":"2023-10-16T20:10:58.181264+0000","last_peered":"2023-10-16T20:10:58.181264+0000","last_clean":"2023-10-16T20:10:58.181264+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:58.181264+0000","last_undegraded":"2023-10-16T20:10:58.181264+0000","last_fullsized":"2023-10-16T20:10:58.181264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.180799+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:05.485396+0000","scrub_duration":0.0050881859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.687494+0000","last_change":"2023-10-16T20:11:15.687583+0000","last_active":"2023-10-16T20:11:15.687494+0000","last_peered":"2023-10-16T20:11:15.687494+0000","last_clean":"2023-10-16T20:11:15.687494+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:11:15.687494+0000","last_undegraded":"2023-10-16T20:11:15.687494+0000","last_fullsized":"2023-10-16T20:11:15.687494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.687367+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:48.220471+0000","scrub_duration":0.003008134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413710+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413710+0000","last_peered":"2023-10-16T20:10:33.413710+0000","last_clean":"2023-10-16T20:10:33.413710+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413710+0000","last_undegraded":"2023-10-16T20:10:33.413710+0000","last_fullsized":"2023-10-16T20:10:33.413710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.606499+0000","last_change":"2023-10-16T19:40:59.212273+0000","last_active":"2023-10-16T20:10:33.606499+0000","last_peered":"2023-10-16T20:10:33.606499+0000","last_clean":"2023-10-16T20:10:33.606499+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:10:33.606499+0000","last_undegraded":"2023-10-16T20:10:33.606499+0000","last_fullsized":"2023-10-16T20:10:33.606499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590094+0000","last_change":"2023-10-16T19:40:59.212223+0000","last_active":"2023-10-16T20:10:33.590094+0000","last_peered":"2023-10-16T20:10:33.590094+0000","last_clean":"2023-10-16T20:10:33.590094+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:10:33.590094+0000","last_undegraded":"2023-10-16T20:10:33.590094+0000","last_fullsized":"2023-10-16T20:10:33.590094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.594417+0000","last_change":"2023-10-16T19:40:59.211051+0000","last_active":"2023-10-16T20:10:33.594417+0000","last_peered":"2023-10-16T20:10:33.594417+0000","last_clean":"2023-10-16T20:10:33.594417+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:10:33.594417+0000","last_undegraded":"2023-10-16T20:10:33.594417+0000","last_fullsized":"2023-10-16T20:10:33.594417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.714932+0000","last_change":"2023-10-16T20:11:02.715055+0000","last_active":"2023-10-16T20:11:02.714932+0000","last_peered":"2023-10-16T20:11:02.714932+0000","last_clean":"2023-10-16T20:11:02.714932+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:11:02.714932+0000","last_undegraded":"2023-10-16T20:11:02.714932+0000","last_fullsized":"2023-10-16T20:11:02.714932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.714754+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:27.826289+0000","scrub_duration":0.0039065690000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.584464+0000","last_change":"2023-10-16T19:40:59.181587+0000","last_active":"2023-10-16T20:10:33.584464+0000","last_peered":"2023-10-16T20:10:33.584464+0000","last_clean":"2023-10-16T20:10:33.584464+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:10:33.584464+0000","last_undegraded":"2023-10-16T20:10:33.584464+0000","last_fullsized":"2023-10-16T20:10:33.584464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.843411+0000","last_change":"2023-10-16T20:11:05.843528+0000","last_active":"2023-10-16T20:11:05.843411+0000","last_peered":"2023-10-16T20:11:05.843411+0000","last_clean":"2023-10-16T20:11:05.843411+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:11:05.843411+0000","last_undegraded":"2023-10-16T20:11:05.843411+0000","last_fullsized":"2023-10-16T20:11:05.843411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.843246+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:20.298267+0000","scrub_duration":0.0036425199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.257654+0000","last_change":"2023-10-16T20:11:15.257761+0000","last_active":"2023-10-16T20:11:15.257654+0000","last_peered":"2023-10-16T20:11:15.257654+0000","last_clean":"2023-10-16T20:11:15.257654+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:11:15.257654+0000","last_undegraded":"2023-10-16T20:11:15.257654+0000","last_fullsized":"2023-10-16T20:11:15.257654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.257475+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:46.570775+0000","scrub_duration":0.0042286989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":96,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.587176+0000","last_change":"2023-10-16T19:40:59.159907+0000","last_active":"2023-10-16T20:10:33.587176+0000","last_peered":"2023-10-16T20:10:33.587176+0000","last_clean":"2023-10-16T20:10:33.587176+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:10:33.587176+0000","last_undegraded":"2023-10-16T20:10:33.587176+0000","last_fullsized":"2023-10-16T20:10:33.587176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.739633+0000","last_change":"2023-10-16T20:10:57.739768+0000","last_active":"2023-10-16T20:10:57.739633+0000","last_peered":"2023-10-16T20:10:57.739633+0000","last_clean":"2023-10-16T20:10:57.739633+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:57.739633+0000","last_undegraded":"2023-10-16T20:10:57.739633+0000","last_fullsized":"2023-10-16T20:10:57.739633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.739436+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:03.134324+0000","scrub_duration":0.0038318470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.416693+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T20:10:33.416693+0000","last_peered":"2023-10-16T20:10:33.416693+0000","last_clean":"2023-10-16T20:10:33.416693+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:10:33.416693+0000","last_undegraded":"2023-10-16T20:10:33.416693+0000","last_fullsized":"2023-10-16T20:10:33.416693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:11.242047+0000","last_change":"2023-10-16T20:11:11.242157+0000","last_active":"2023-10-16T20:11:11.242047+0000","last_peered":"2023-10-16T20:11:11.242047+0000","last_clean":"2023-10-16T20:11:11.242047+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:11:11.242047+0000","last_undegraded":"2023-10-16T20:11:11.242047+0000","last_fullsized":"2023-10-16T20:11:11.242047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_clean_scrub_stamp":"2023-10-16T20:11:11.241831+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:18.546428+0000","scrub_duration":0.0035476230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583005+0000","last_change":"2023-10-16T19:40:59.181219+0000","last_active":"2023-10-16T20:10:33.583005+0000","last_peered":"2023-10-16T20:10:33.583005+0000","last_clean":"2023-10-16T20:10:33.583005+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:10:33.583005+0000","last_undegraded":"2023-10-16T20:10:33.583005+0000","last_fullsized":"2023-10-16T20:10:33.583005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:14.286115+0000","last_change":"2023-10-16T20:11:14.286224+0000","last_active":"2023-10-16T20:11:14.286115+0000","last_peered":"2023-10-16T20:11:14.286115+0000","last_clean":"2023-10-16T20:11:14.286115+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:11:14.286115+0000","last_undegraded":"2023-10-16T20:11:14.286115+0000","last_fullsized":"2023-10-16T20:11:14.286115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_clean_scrub_stamp":"2023-10-16T20:11:14.285903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:28.982844+0000","scrub_duration":0.00376969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.707011+0000","last_change":"2023-10-16T20:10:56.707130+0000","last_active":"2023-10-16T20:10:56.707011+0000","last_peered":"2023-10-16T20:10:56.707011+0000","last_clean":"2023-10-16T20:10:56.707011+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:56.707011+0000","last_undegraded":"2023-10-16T20:10:56.707011+0000","last_fullsized":"2023-10-16T20:10:56.707011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.706833+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:40.887025+0000","scrub_duration":0.0036464599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.395492+0000","last_change":"2023-10-16T20:11:06.395618+0000","last_active":"2023-10-16T20:11:06.395492+0000","last_peered":"2023-10-16T20:11:06.395492+0000","last_clean":"2023-10-16T20:11:06.395492+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:11:06.395492+0000","last_undegraded":"2023-10-16T20:11:06.395492+0000","last_fullsized":"2023-10-16T20:11:06.395492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.395317+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:33.593221+0000","scrub_duration":0.0039439499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.409070+0000","last_change":"2023-10-16T19:40:58.993819+0000","last_active":"2023-10-16T20:10:33.409070+0000","last_peered":"2023-10-16T20:10:33.409070+0000","last_clean":"2023-10-16T20:10:33.409070+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:10:33.409070+0000","last_undegraded":"2023-10-16T20:10:33.409070+0000","last_fullsized":"2023-10-16T20:10:33.409070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590531+0000","last_change":"2023-10-16T19:41:25.495312+0000","last_active":"2023-10-16T20:10:33.590531+0000","last_peered":"2023-10-16T20:10:33.590531+0000","last_clean":"2023-10-16T20:10:33.590531+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:10:33.590531+0000","last_undegraded":"2023-10-16T20:10:33.590531+0000","last_fullsized":"2023-10-16T20:10:33.590531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.861452+0000","last_change":"2023-10-16T20:11:10.861599+0000","last_active":"2023-10-16T20:11:10.861452+0000","last_peered":"2023-10-16T20:11:10.861452+0000","last_clean":"2023-10-16T20:11:10.861452+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:11:10.861452+0000","last_undegraded":"2023-10-16T20:11:10.861452+0000","last_fullsized":"2023-10-16T20:11:10.861452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.861284+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:05:10.816911+0000","scrub_duration":0.0039407549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.451221+0000","last_change":"2023-10-16T19:40:58.993923+0000","last_active":"2023-10-16T20:10:33.451221+0000","last_peered":"2023-10-16T20:10:33.451221+0000","last_clean":"2023-10-16T20:10:33.451221+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:10:33.451221+0000","last_undegraded":"2023-10-16T20:10:33.451221+0000","last_fullsized":"2023-10-16T20:10:33.451221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.583511+0000","last_change":"2023-10-16T19:40:59.182533+0000","last_active":"2023-10-16T20:10:33.583511+0000","last_peered":"2023-10-16T20:10:33.583511+0000","last_clean":"2023-10-16T20:10:33.583511+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:10:33.583511+0000","last_undegraded":"2023-10-16T20:10:33.583511+0000","last_fullsized":"2023-10-16T20:10:33.583511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.429822+0000","last_change":"2023-10-16T20:11:07.429977+0000","last_active":"2023-10-16T20:11:07.429822+0000","last_peered":"2023-10-16T20:11:07.429822+0000","last_clean":"2023-10-16T20:11:07.429822+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:11:07.429822+0000","last_undegraded":"2023-10-16T20:11:07.429822+0000","last_fullsized":"2023-10-16T20:11:07.429822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.429670+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:44.961326+0000","scrub_duration":0.0040925379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.770476+0000","last_change":"2023-10-16T20:10:56.770625+0000","last_active":"2023-10-16T20:10:56.770476+0000","last_peered":"2023-10-16T20:10:56.770476+0000","last_clean":"2023-10-16T20:10:56.770476+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:56.770476+0000","last_undegraded":"2023-10-16T20:10:56.770476+0000","last_fullsized":"2023-10-16T20:10:56.770476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.770319+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:09.725801+0000","scrub_duration":0.0040022180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.590903+0000","last_change":"2023-10-16T19:40:59.210102+0000","last_active":"2023-10-16T20:10:33.590903+0000","last_peered":"2023-10-16T20:10:33.590903+0000","last_clean":"2023-10-16T20:10:33.590903+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:10:33.590903+0000","last_undegraded":"2023-10-16T20:10:33.590903+0000","last_fullsized":"2023-10-16T20:10:33.590903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":150,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.621024+0000","last_change":"2023-10-16T19:40:59.128334+0000","last_active":"2023-10-16T20:10:50.621024+0000","last_peered":"2023-10-16T20:10:50.621024+0000","last_clean":"2023-10-16T20:10:50.621024+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:10:50.621024+0000","last_undegraded":"2023-10-16T20:10:50.621024+0000","last_fullsized":"2023-10-16T20:10:50.621024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2225","reported_seq":2263,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.849760+0000","last_change":"2023-10-16T20:10:52.849760+0000","last_active":"2023-10-16T20:10:52.849760+0000","last_peered":"2023-10-16T20:10:52.849760+0000","last_clean":"2023-10-16T20:10:52.849760+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:52.849760+0000","last_undegraded":"2023-10-16T20:10:52.849760+0000","last_fullsized":"2023-10-16T20:10:52.849760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2225","last_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_deep_scrub":"25'2225","last_deep_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.849447+0000","objects_scrubbed":3,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:08.176111+0000","scrub_duration":0.079253561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:45.610073+0000","last_change":"2023-10-16T19:40:59.179191+0000","last_active":"2023-10-16T20:10:45.610073+0000","last_peered":"2023-10-16T20:10:45.610073+0000","last_clean":"2023-10-16T20:10:45.610073+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:10:45.610073+0000","last_undegraded":"2023-10-16T20:10:45.610073+0000","last_fullsized":"2023-10-16T20:10:45.610073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'125","reported_seq":272,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.179411+0000","last_change":"2023-10-16T20:10:59.179606+0000","last_active":"2023-10-16T20:10:59.179411+0000","last_peered":"2023-10-16T20:10:59.179411+0000","last_clean":"2023-10-16T20:10:59.179411+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:10:59.179411+0000","last_undegraded":"2023-10-16T20:10:59.179411+0000","last_fullsized":"2023-10-16T20:10:59.179411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'125","last_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_deep_scrub":"25'125","last_deep_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.179212+0000","objects_scrubbed":4,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:20.741211+0000","scrub_duration":0.01096723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'206","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.752869+0000","last_change":"2023-10-16T20:10:51.753006+0000","last_active":"2023-10-16T20:10:51.752869+0000","last_peered":"2023-10-16T20:10:51.752869+0000","last_clean":"2023-10-16T20:10:51.752869+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:51.752869+0000","last_undegraded":"2023-10-16T20:10:51.752869+0000","last_fullsized":"2023-10-16T20:10:51.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'206","last_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_deep_scrub":"25'206","last_deep_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.752708+0000","objects_scrubbed":3,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:32.503229+0000","scrub_duration":0.012306727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.751652+0000","last_change":"2023-10-16T20:11:05.751793+0000","last_active":"2023-10-16T20:11:05.751652+0000","last_peered":"2023-10-16T20:11:05.751652+0000","last_clean":"2023-10-16T20:11:05.751652+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:11:05.751652+0000","last_undegraded":"2023-10-16T20:11:05.751652+0000","last_fullsized":"2023-10-16T20:11:05.751652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.751451+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:52.727094+0000","scrub_duration":0.0039667890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'8","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.449048+0000","last_change":"2023-10-16T20:10:58.449301+0000","last_active":"2023-10-16T20:10:58.449048+0000","last_peered":"2023-10-16T20:10:58.449048+0000","last_clean":"2023-10-16T20:10:58.449048+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:10:58.449048+0000","last_undegraded":"2023-10-16T20:10:58.449048+0000","last_fullsized":"2023-10-16T20:10:58.449048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.448775+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:27.179352+0000","scrub_duration":0.0075077039999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.785768+0000","last_change":"2023-10-16T20:11:07.785880+0000","last_active":"2023-10-16T20:11:07.785768+0000","last_peered":"2023-10-16T20:11:07.785768+0000","last_clean":"2023-10-16T20:11:07.785768+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:11:07.785768+0000","last_undegraded":"2023-10-16T20:11:07.785768+0000","last_fullsized":"2023-10-16T20:11:07.785768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.785559+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:29.750005+0000","scrub_duration":0.0038216840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'172","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.248681+0000","last_change":"2023-10-16T20:11:04.248898+0000","last_active":"2023-10-16T20:11:04.248681+0000","last_peered":"2023-10-16T20:11:04.248681+0000","last_clean":"2023-10-16T20:11:04.248681+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:11:04.248681+0000","last_undegraded":"2023-10-16T20:11:04.248681+0000","last_fullsized":"2023-10-16T20:11:04.248681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'172","last_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_deep_scrub":"25'172","last_deep_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.248408+0000","objects_scrubbed":3,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:48.428600+0000","scrub_duration":0.011087784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.586528+0000","last_change":"2023-10-16T19:40:59.159518+0000","last_active":"2023-10-16T20:10:33.586528+0000","last_peered":"2023-10-16T20:10:33.586528+0000","last_clean":"2023-10-16T20:10:33.586528+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:10:33.586528+0000","last_undegraded":"2023-10-16T20:10:33.586528+0000","last_fullsized":"2023-10-16T20:10:33.586528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'83","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.419262+0000","last_change":"2023-10-16T20:10:59.419479+0000","last_active":"2023-10-16T20:10:59.419262+0000","last_peered":"2023-10-16T20:10:59.419262+0000","last_clean":"2023-10-16T20:10:59.419262+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:10:59.419262+0000","last_undegraded":"2023-10-16T20:10:59.419262+0000","last_fullsized":"2023-10-16T20:10:59.419262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.419026+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:10.718293+0000","scrub_duration":0.0094841230000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.062378+0000","last_change":"2023-10-16T20:11:05.062502+0000","last_active":"2023-10-16T20:11:05.062378+0000","last_peered":"2023-10-16T20:11:05.062378+0000","last_clean":"2023-10-16T20:11:05.062378+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:11:05.062378+0000","last_undegraded":"2023-10-16T20:11:05.062378+0000","last_fullsized":"2023-10-16T20:11:05.062378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'95","last_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_deep_scrub":"25'95","last_deep_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.062206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:49.242398+0000","scrub_duration":0.0047295150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'87","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.090482+0000","last_change":"2023-10-16T20:10:57.090726+0000","last_active":"2023-10-16T20:10:57.090482+0000","last_peered":"2023-10-16T20:10:57.090482+0000","last_clean":"2023-10-16T20:10:57.090482+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:57.090482+0000","last_undegraded":"2023-10-16T20:10:57.090482+0000","last_fullsized":"2023-10-16T20:10:57.090482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.090239+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:45.060366+0000","scrub_duration":0.010685826000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.424970+0000","last_change":"2023-10-16T20:11:07.425093+0000","last_active":"2023-10-16T20:11:07.424970+0000","last_peered":"2023-10-16T20:11:07.424970+0000","last_clean":"2023-10-16T20:11:07.424970+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:11:07.424970+0000","last_undegraded":"2023-10-16T20:11:07.424970+0000","last_fullsized":"2023-10-16T20:11:07.424970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.424696+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:09:24.485886+0000","scrub_duration":0.0038308159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1232","reported_seq":1270,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.345739+0000","last_change":"2023-10-16T20:11:05.345878+0000","last_active":"2023-10-16T20:11:05.345739+0000","last_peered":"2023-10-16T20:11:05.345739+0000","last_clean":"2023-10-16T20:11:05.345739+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:11:05.345739+0000","last_undegraded":"2023-10-16T20:11:05.345739+0000","last_fullsized":"2023-10-16T20:11:05.345739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1232","last_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_deep_scrub":"25'1232","last_deep_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.345578+0000","objects_scrubbed":6,"log_size":1232,"log_dups_size":0,"ondisk_log_size":1232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:26:15.503390+0000","scrub_duration":0.062660380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.452103+0000","last_change":"2023-10-16T19:40:59.124729+0000","last_active":"2023-10-16T20:10:33.452103+0000","last_peered":"2023-10-16T20:10:33.452103+0000","last_clean":"2023-10-16T20:10:33.452103+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:10:33.452103+0000","last_undegraded":"2023-10-16T20:10:33.452103+0000","last_fullsized":"2023-10-16T20:10:33.452103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'123","reported_seq":264,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.225726+0000","last_change":"2023-10-16T20:10:52.225726+0000","last_active":"2023-10-16T20:10:52.225726+0000","last_peered":"2023-10-16T20:10:52.225726+0000","last_clean":"2023-10-16T20:10:52.225726+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:52.225726+0000","last_undegraded":"2023-10-16T20:10:52.225726+0000","last_fullsized":"2023-10-16T20:10:52.225726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'123","last_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_deep_scrub":"25'123","last_deep_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.225528+0000","objects_scrubbed":7,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:59.684729+0000","scrub_duration":0.012038705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581264+0000","last_change":"2023-10-16T19:40:59.178314+0000","last_active":"2023-10-16T20:10:33.581264+0000","last_peered":"2023-10-16T20:10:33.581264+0000","last_clean":"2023-10-16T20:10:33.581264+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:10:33.581264+0000","last_undegraded":"2023-10-16T20:10:33.581264+0000","last_fullsized":"2023-10-16T20:10:33.581264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'97","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.447251+0000","last_change":"2023-10-16T20:11:04.447251+0000","last_active":"2023-10-16T20:11:04.447251+0000","last_peered":"2023-10-16T20:11:04.447251+0000","last_clean":"2023-10-16T20:11:04.447251+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:11:04.447251+0000","last_undegraded":"2023-10-16T20:11:04.447251+0000","last_fullsized":"2023-10-16T20:11:04.447251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.446964+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:34.698139+0000","scrub_duration":0.0098213269999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.405532+0000","last_change":"2023-10-16T19:40:59.128505+0000","last_active":"2023-10-16T20:10:33.405532+0000","last_peered":"2023-10-16T20:10:33.405532+0000","last_clean":"2023-10-16T20:10:33.405532+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:10:33.405532+0000","last_undegraded":"2023-10-16T20:10:33.405532+0000","last_fullsized":"2023-10-16T20:10:33.405532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'917","reported_seq":956,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.216412+0000","last_change":"2023-10-16T20:11:00.216412+0000","last_active":"2023-10-16T20:11:00.216412+0000","last_peered":"2023-10-16T20:11:00.216412+0000","last_clean":"2023-10-16T20:11:00.216412+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:11:00.216412+0000","last_undegraded":"2023-10-16T20:11:00.216412+0000","last_fullsized":"2023-10-16T20:11:00.216412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'917","last_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_deep_scrub":"25'917","last_deep_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.216120+0000","objects_scrubbed":3,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:40.966640+0000","scrub_duration":0.039363331000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.523509+0000","last_change":"2023-10-16T19:40:59.208982+0000","last_active":"2023-10-16T20:10:33.523509+0000","last_peered":"2023-10-16T20:10:33.523509+0000","last_clean":"2023-10-16T20:10:33.523509+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:10:33.523509+0000","last_undegraded":"2023-10-16T20:10:33.523509+0000","last_fullsized":"2023-10-16T20:10:33.523509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'120","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:48.805896+0000","last_change":"2023-10-16T20:10:48.805896+0000","last_active":"2023-10-16T20:10:48.805896+0000","last_peered":"2023-10-16T20:10:48.805896+0000","last_clean":"2023-10-16T20:10:48.805896+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:10:48.805896+0000","last_undegraded":"2023-10-16T20:10:48.805896+0000","last_fullsized":"2023-10-16T20:10:48.805896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'120","last_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_deep_scrub":"25'120","last_deep_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_clean_scrub_stamp":"2023-10-16T20:10:48.805692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:38:07.417459+0000","scrub_duration":0.014508691000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.193863+0000","last_change":"2023-10-16T20:10:57.194070+0000","last_active":"2023-10-16T20:10:57.193863+0000","last_peered":"2023-10-16T20:10:57.193863+0000","last_clean":"2023-10-16T20:10:57.193863+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:57.193863+0000","last_undegraded":"2023-10-16T20:10:57.193863+0000","last_fullsized":"2023-10-16T20:10:57.193863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.193654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:57:44.185542+0000","scrub_duration":0.004328302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'193","reported_seq":232,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.308786+0000","last_change":"2023-10-16T20:10:52.308932+0000","last_active":"2023-10-16T20:10:52.308786+0000","last_peered":"2023-10-16T20:10:52.308786+0000","last_clean":"2023-10-16T20:10:52.308786+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:52.308786+0000","last_undegraded":"2023-10-16T20:10:52.308786+0000","last_fullsized":"2023-10-16T20:10:52.308786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.308606+0000","objects_scrubbed":2,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:05:12.902639+0000","scrub_duration":0.0076596310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.399843+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T20:10:33.399843+0000","last_peered":"2023-10-16T20:10:33.399843+0000","last_clean":"2023-10-16T20:10:33.399843+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:10:33.399843+0000","last_undegraded":"2023-10-16T20:10:33.399843+0000","last_fullsized":"2023-10-16T20:10:33.399843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'11","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:49.778351+0000","last_change":"2023-10-16T20:10:49.778439+0000","last_active":"2023-10-16T20:10:49.778351+0000","last_peered":"2023-10-16T20:10:49.778351+0000","last_clean":"2023-10-16T20:10:49.778351+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:49.778351+0000","last_undegraded":"2023-10-16T20:10:49.778351+0000","last_fullsized":"2023-10-16T20:10:49.778351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_clean_scrub_stamp":"2023-10-16T20:10:49.778235+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:34:46.159193+0000","scrub_duration":0.0051660639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413606+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T20:10:33.413606+0000","last_peered":"2023-10-16T20:10:33.413606+0000","last_clean":"2023-10-16T20:10:33.413606+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:10:33.413606+0000","last_undegraded":"2023-10-16T20:10:33.413606+0000","last_fullsized":"2023-10-16T20:10:33.413606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'7","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:01.947796+0000","last_change":"2023-10-16T20:11:01.947921+0000","last_active":"2023-10-16T20:11:01.947796+0000","last_peered":"2023-10-16T20:11:01.947796+0000","last_clean":"2023-10-16T20:11:01.947796+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:11:01.947796+0000","last_undegraded":"2023-10-16T20:11:01.947796+0000","last_fullsized":"2023-10-16T20:11:01.947796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_clean_scrub_stamp":"2023-10-16T20:11:01.947627+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:38.925238+0000","scrub_duration":0.0085375859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.755300+0000","last_change":"2023-10-16T20:11:04.755418+0000","last_active":"2023-10-16T20:11:04.755300+0000","last_peered":"2023-10-16T20:11:04.755300+0000","last_clean":"2023-10-16T20:11:04.755300+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:11:04.755300+0000","last_undegraded":"2023-10-16T20:11:04.755300+0000","last_fullsized":"2023-10-16T20:11:04.755300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.755134+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:21.886819+0000","scrub_duration":0.0038213980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'595","reported_seq":634,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.839482+0000","last_change":"2023-10-16T20:10:50.839718+0000","last_active":"2023-10-16T20:10:50.839482+0000","last_peered":"2023-10-16T20:10:50.839482+0000","last_clean":"2023-10-16T20:10:50.839482+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:50.839482+0000","last_undegraded":"2023-10-16T20:10:50.839482+0000","last_fullsized":"2023-10-16T20:10:50.839482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'595","last_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_deep_scrub":"25'595","last_deep_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.839312+0000","objects_scrubbed":3,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:26.515689+0000","scrub_duration":0.036436172000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.439685+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T20:10:33.439685+0000","last_peered":"2023-10-16T20:10:33.439685+0000","last_clean":"2023-10-16T20:10:33.439685+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:10:33.439685+0000","last_undegraded":"2023-10-16T20:10:33.439685+0000","last_fullsized":"2023-10-16T20:10:33.439685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.197315+0000","last_change":"2023-10-16T20:10:59.197457+0000","last_active":"2023-10-16T20:10:59.197315+0000","last_peered":"2023-10-16T20:10:59.197315+0000","last_clean":"2023-10-16T20:10:59.197315+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:10:59.197315+0000","last_undegraded":"2023-10-16T20:10:59.197315+0000","last_fullsized":"2023-10-16T20:10:59.197315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.197159+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:04.377504+0000","scrub_duration":0.013745998000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'11","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.405936+0000","last_change":"2023-10-16T20:11:03.406084+0000","last_active":"2023-10-16T20:11:03.405936+0000","last_peered":"2023-10-16T20:11:03.405936+0000","last_clean":"2023-10-16T20:11:03.405936+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:11:03.405936+0000","last_undegraded":"2023-10-16T20:11:03.405936+0000","last_fullsized":"2023-10-16T20:11:03.405936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.405741+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:50.381384+0000","scrub_duration":0.012053975999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.643028+0000","last_change":"2023-10-16T20:11:00.643141+0000","last_active":"2023-10-16T20:11:00.643028+0000","last_peered":"2023-10-16T20:11:00.643028+0000","last_clean":"2023-10-16T20:11:00.643028+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:11:00.643028+0000","last_undegraded":"2023-10-16T20:11:00.643028+0000","last_fullsized":"2023-10-16T20:11:00.643028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.642786+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:29.373362+0000","scrub_duration":0.004474586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'11","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.224693+0000","last_change":"2023-10-16T20:11:00.224693+0000","last_active":"2023-10-16T20:11:00.224693+0000","last_peered":"2023-10-16T20:11:00.224693+0000","last_clean":"2023-10-16T20:11:00.224693+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:11:00.224693+0000","last_undegraded":"2023-10-16T20:11:00.224693+0000","last_fullsized":"2023-10-16T20:11:00.224693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.224425+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:44.355933+0000","scrub_duration":0.0071850550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.053355+0000","last_change":"2023-10-16T20:11:03.053556+0000","last_active":"2023-10-16T20:11:03.053355+0000","last_peered":"2023-10-16T20:11:03.053355+0000","last_clean":"2023-10-16T20:11:03.053355+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:11:03.053355+0000","last_undegraded":"2023-10-16T20:11:03.053355+0000","last_fullsized":"2023-10-16T20:11:03.053355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.053085+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:18.379749+0000","scrub_duration":0.0044426120000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'182","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.785504+0000","last_change":"2023-10-16T20:10:52.785600+0000","last_active":"2023-10-16T20:10:52.785504+0000","last_peered":"2023-10-16T20:10:52.785504+0000","last_clean":"2023-10-16T20:10:52.785504+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:52.785504+0000","last_undegraded":"2023-10-16T20:10:52.785504+0000","last_fullsized":"2023-10-16T20:10:52.785504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.785411+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:41:36.044719+0000","scrub_duration":0.014410586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:46.885124+0000","last_change":"2023-10-16T19:40:59.181086+0000","last_active":"2023-10-16T20:10:46.885124+0000","last_peered":"2023-10-16T20:10:46.885124+0000","last_clean":"2023-10-16T20:10:46.885124+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:10:46.885124+0000","last_undegraded":"2023-10-16T20:10:46.885124+0000","last_fullsized":"2023-10-16T20:10:46.885124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'441","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.423359+0000","last_change":"2023-10-16T20:11:05.423502+0000","last_active":"2023-10-16T20:11:05.423359+0000","last_peered":"2023-10-16T20:11:05.423359+0000","last_clean":"2023-10-16T20:11:05.423359+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:11:05.423359+0000","last_undegraded":"2023-10-16T20:11:05.423359+0000","last_fullsized":"2023-10-16T20:11:05.423359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'441","last_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_deep_scrub":"25'441","last_deep_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.423201+0000","objects_scrubbed":2,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.561417+0000","scrub_duration":0.028676314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.313204+0000","last_change":"2023-10-16T20:11:03.313319+0000","last_active":"2023-10-16T20:11:03.313204+0000","last_peered":"2023-10-16T20:11:03.313204+0000","last_clean":"2023-10-16T20:11:03.313204+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:11:03.313204+0000","last_undegraded":"2023-10-16T20:11:03.313204+0000","last_fullsized":"2023-10-16T20:11:03.313204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'88","last_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_deep_scrub":"25'88","last_deep_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.313054+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:27:31.752491+0000","scrub_duration":0.0037970629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.099941+0000","last_change":"2023-10-16T20:10:51.100008+0000","last_active":"2023-10-16T20:10:51.099941+0000","last_peered":"2023-10-16T20:10:51.099941+0000","last_clean":"2023-10-16T20:10:51.099941+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:51.099941+0000","last_undegraded":"2023-10-16T20:10:51.099941+0000","last_fullsized":"2023-10-16T20:10:51.099941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.099844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:15:33.686104+0000","scrub_duration":0.0037505049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.588029+0000","last_change":"2023-10-16T19:40:59.155550+0000","last_active":"2023-10-16T20:10:33.588029+0000","last_peered":"2023-10-16T20:10:33.588029+0000","last_clean":"2023-10-16T20:10:33.588029+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:10:33.588029+0000","last_undegraded":"2023-10-16T20:10:33.588029+0000","last_fullsized":"2023-10-16T20:10:33.588029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'72","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:20.093804+0000","last_change":"2023-10-16T19:40:56.466885+0000","last_active":"2023-10-16T20:10:20.093804+0000","last_peered":"2023-10-16T20:10:20.093804+0000","last_clean":"2023-10-16T20:10:20.093804+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:10:20.093804+0000","last_undegraded":"2023-10-16T20:10:20.093804+0000","last_fullsized":"2023-10-16T20:10:20.093804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.916838+0000","last_change":"2023-10-16T20:11:02.916971+0000","last_active":"2023-10-16T20:11:02.916838+0000","last_peered":"2023-10-16T20:11:02.916838+0000","last_clean":"2023-10-16T20:11:02.916838+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:11:02.916838+0000","last_undegraded":"2023-10-16T20:11:02.916838+0000","last_fullsized":"2023-10-16T20:11:02.916838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.916667+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:00.488332+0000","scrub_duration":0.004083677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'182","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.058071+0000","last_change":"2023-10-16T20:10:58.058213+0000","last_active":"2023-10-16T20:10:58.058071+0000","last_peered":"2023-10-16T20:10:58.058071+0000","last_clean":"2023-10-16T20:10:58.058071+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:58.058071+0000","last_undegraded":"2023-10-16T20:10:58.058071+0000","last_fullsized":"2023-10-16T20:10:58.058071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.057907+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:35.465191+0000","scrub_duration":0.0099141170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.714110+0000","last_change":"2023-10-16T20:11:05.714234+0000","last_active":"2023-10-16T20:11:05.714110+0000","last_peered":"2023-10-16T20:11:05.714110+0000","last_clean":"2023-10-16T20:11:05.714110+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:11:05.714110+0000","last_undegraded":"2023-10-16T20:11:05.714110+0000","last_fullsized":"2023-10-16T20:11:05.714110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.713860+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:42.363819+0000","scrub_duration":0.0043101069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'19","reported_seq":59,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.204431+0000","last_change":"2023-10-16T20:11:02.204431+0000","last_active":"2023-10-16T20:11:02.204431+0000","last_peered":"2023-10-16T20:11:02.204431+0000","last_clean":"2023-10-16T20:11:02.204431+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:11:02.204431+0000","last_undegraded":"2023-10-16T20:11:02.204431+0000","last_fullsized":"2023-10-16T20:11:02.204431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.204019+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:43.393039+0000","scrub_duration":0.010984687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.581139+0000","last_change":"2023-10-16T19:40:59.174050+0000","last_active":"2023-10-16T20:10:33.581139+0000","last_peered":"2023-10-16T20:10:33.581139+0000","last_clean":"2023-10-16T20:10:33.581139+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:10:33.581139+0000","last_undegraded":"2023-10-16T20:10:33.581139+0000","last_fullsized":"2023-10-16T20:10:33.581139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'7","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.299518+0000","last_change":"2023-10-16T20:11:09.299518+0000","last_active":"2023-10-16T20:11:09.299518+0000","last_peered":"2023-10-16T20:11:09.299518+0000","last_clean":"2023-10-16T20:11:09.299518+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:11:09.299518+0000","last_undegraded":"2023-10-16T20:11:09.299518+0000","last_fullsized":"2023-10-16T20:11:09.299518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.299250+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:50.359476+0000","scrub_duration":0.0074289619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.434042+0000","last_change":"2023-10-16T20:10:57.434160+0000","last_active":"2023-10-16T20:10:57.434042+0000","last_peered":"2023-10-16T20:10:57.434042+0000","last_clean":"2023-10-16T20:10:57.434042+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:57.434042+0000","last_undegraded":"2023-10-16T20:10:57.434042+0000","last_fullsized":"2023-10-16T20:10:57.434042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.433829+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:14.317205+0000","scrub_duration":0.0042212430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'178","reported_seq":217,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:47.079466+0000","last_change":"2023-10-16T20:10:47.079655+0000","last_active":"2023-10-16T20:10:47.079466+0000","last_peered":"2023-10-16T20:10:47.079466+0000","last_clean":"2023-10-16T20:10:47.079466+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:47.079466+0000","last_undegraded":"2023-10-16T20:10:47.079466+0000","last_fullsized":"2023-10-16T20:10:47.079466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_clean_scrub_stamp":"2023-10-16T20:10:47.079299+0000","objects_scrubbed":4,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:58.646035+0000","scrub_duration":0.012090556000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.494481+0000","last_change":"2023-10-16T19:40:59.129106+0000","last_active":"2023-10-16T20:10:33.494481+0000","last_peered":"2023-10-16T20:10:33.494481+0000","last_clean":"2023-10-16T20:10:33.494481+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:10:33.494481+0000","last_undegraded":"2023-10-16T20:10:33.494481+0000","last_fullsized":"2023-10-16T20:10:33.494481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'429","reported_seq":468,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.061819+0000","last_change":"2023-10-16T20:10:50.061870+0000","last_active":"2023-10-16T20:10:50.061819+0000","last_peered":"2023-10-16T20:10:50.061819+0000","last_clean":"2023-10-16T20:10:50.061819+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:50.061819+0000","last_undegraded":"2023-10-16T20:10:50.061819+0000","last_fullsized":"2023-10-16T20:10:50.061819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.061747+0000","objects_scrubbed":2,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:43.780025+0000","scrub_duration":0.007646229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.504229+0000","last_change":"2023-10-16T19:40:59.183020+0000","last_active":"2023-10-16T20:10:33.504229+0000","last_peered":"2023-10-16T20:10:33.504229+0000","last_clean":"2023-10-16T20:10:33.504229+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:10:33.504229+0000","last_undegraded":"2023-10-16T20:10:33.504229+0000","last_fullsized":"2023-10-16T20:10:33.504229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'14","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.287527+0000","last_change":"2023-10-16T20:11:12.287646+0000","last_active":"2023-10-16T20:11:12.287527+0000","last_peered":"2023-10-16T20:11:12.287527+0000","last_clean":"2023-10-16T20:11:12.287527+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:11:12.287527+0000","last_undegraded":"2023-10-16T20:11:12.287527+0000","last_fullsized":"2023-10-16T20:11:12.287527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'14","last_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_deep_scrub":"25'14","last_deep_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.287330+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:43.600630+0000","scrub_duration":0.0075854269999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.281957+0000","last_change":"2023-10-16T20:11:09.282147+0000","last_active":"2023-10-16T20:11:09.281957+0000","last_peered":"2023-10-16T20:11:09.281957+0000","last_clean":"2023-10-16T20:11:09.281957+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:11:09.281957+0000","last_undegraded":"2023-10-16T20:11:09.281957+0000","last_fullsized":"2023-10-16T20:11:09.281957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.281641+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:34.393175+0000","scrub_duration":0.0045042149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.947697+0000","last_change":"2023-10-16T19:40:59.155451+0000","last_active":"2023-10-16T20:10:51.947697+0000","last_peered":"2023-10-16T20:10:51.947697+0000","last_clean":"2023-10-16T20:10:51.947697+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:10:51.947697+0000","last_undegraded":"2023-10-16T20:10:51.947697+0000","last_fullsized":"2023-10-16T20:10:51.947697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'10","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:54.486599+0000","last_change":"2023-10-16T19:40:56.464413+0000","last_active":"2023-10-16T20:10:54.486599+0000","last_peered":"2023-10-16T20:10:54.486599+0000","last_clean":"2023-10-16T20:10:54.486599+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:10:54.486599+0000","last_undegraded":"2023-10-16T20:10:54.486599+0000","last_fullsized":"2023-10-16T20:10:54.486599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:54.814849+0000","last_clean_scrub_stamp":"2023-10-16T19:40:54.814849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.947819+0000","last_change":"2023-10-16T19:40:59.155864+0000","last_active":"2023-10-16T20:10:51.947819+0000","last_peered":"2023-10-16T20:10:51.947819+0000","last_clean":"2023-10-16T20:10:51.947819+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:10:51.947819+0000","last_undegraded":"2023-10-16T20:10:51.947819+0000","last_fullsized":"2023-10-16T20:10:51.947819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'156","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.267670+0000","last_change":"2023-10-16T20:11:10.267809+0000","last_active":"2023-10-16T20:11:10.267670+0000","last_peered":"2023-10-16T20:11:10.267670+0000","last_clean":"2023-10-16T20:11:10.267670+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:11:10.267670+0000","last_undegraded":"2023-10-16T20:11:10.267670+0000","last_fullsized":"2023-10-16T20:11:10.267670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'156","last_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_deep_scrub":"25'156","last_deep_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.267479+0000","objects_scrubbed":7,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:24.964421+0000","scrub_duration":0.014645241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":135,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.071221+0000","last_change":"2023-10-16T20:11:06.071341+0000","last_active":"2023-10-16T20:11:06.071221+0000","last_peered":"2023-10-16T20:11:06.071221+0000","last_clean":"2023-10-16T20:11:06.071221+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:11:06.071221+0000","last_undegraded":"2023-10-16T20:11:06.071221+0000","last_fullsized":"2023-10-16T20:11:06.071221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.071033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:51:02.947576+0000","scrub_duration":0.0042787709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.791172+0000","last_change":"2023-10-16T20:10:50.791172+0000","last_active":"2023-10-16T20:10:50.791172+0000","last_peered":"2023-10-16T20:10:50.791172+0000","last_clean":"2023-10-16T20:10:50.791172+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:10:50.791172+0000","last_undegraded":"2023-10-16T20:10:50.791172+0000","last_fullsized":"2023-10-16T20:10:50.791172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.790831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:27.440790+0000","scrub_duration":0.0041105270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.684963+0000","last_change":"2023-10-16T20:11:12.685085+0000","last_active":"2023-10-16T20:11:12.684963+0000","last_peered":"2023-10-16T20:11:12.684963+0000","last_clean":"2023-10-16T20:11:12.684963+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:11:12.684963+0000","last_undegraded":"2023-10-16T20:11:12.684963+0000","last_fullsized":"2023-10-16T20:11:12.684963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.684788+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:39.823004+0000","scrub_duration":0.0045610140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:46.154118+0000","last_change":"2023-10-16T20:10:46.154175+0000","last_active":"2023-10-16T20:10:46.154118+0000","last_peered":"2023-10-16T20:10:46.154118+0000","last_clean":"2023-10-16T20:10:46.154118+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:46.154118+0000","last_undegraded":"2023-10-16T20:10:46.154118+0000","last_fullsized":"2023-10-16T20:10:46.154118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_clean_scrub_stamp":"2023-10-16T20:10:46.154049+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:41:39.554198+0000","scrub_duration":0.0087997690000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":8001,"ondisk_log_size":8001,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509811,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.2010000000000001,"15min":1.173},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.5589999999999999,"5min":2.0569999999999999,"15min":2.085},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.216,"15min":1.2909999999999999},"min":{"1min":0.77300000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.8140000000000001,"5min":1.9510000000000001,"15min":2.1520000000000001},"last":0.997}]},{"osd":1,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.2330000000000001},"min":{"1min":0.70999999999999996,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.774,"5min":1.996,"15min":2.3050000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2569999999999999,"15min":1.3180000000000001},"min":{"1min":0.90200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.665,"5min":1.8320000000000001,"15min":2.27},"last":1.1379999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2689999999999999,"15min":1.3200000000000001},"min":{"1min":0.83299999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7909999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.9490000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.377,"15min":1.4099999999999999},"min":{"1min":0.95699999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.7629999999999999,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.472}]},{"osd":3,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.4079999999999999},"min":{"1min":0.81299999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6990000000000001,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.4730000000000001,"15min":1.4990000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8140000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.639}]},{"osd":4,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3169999999999999,"15min":1.3069999999999999},"min":{"1min":0.89200000000000002,"5min":0.626,"15min":0.624},"max":{"1min":1.821,"5min":1.8759999999999999,"15min":2.375},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3759999999999999,"15min":1.403},"min":{"1min":1.036,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8859999999999999,"5min":2.298,"15min":2.5459999999999998},"last":2.1859999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.454,"15min":1.456},"min":{"1min":1.083,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.9530000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.5,"15min":1.5109999999999999},"min":{"1min":0.72899999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.7629999999999999,"5min":2.2490000000000001,"15min":2.4750000000000001},"last":1.5760000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.5740000000000001,"15min":1.5960000000000001},"min":{"1min":1.0860000000000001,"5min":0.82599999999999996,"15min":0.80500000000000005},"max":{"1min":1.8700000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.696},{"interface":"front","average":{"1min":1.544,"5min":1.5509999999999999,"15min":1.5640000000000001},"min":{"1min":1.1859999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9990000000000001,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":2.0779999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509811,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1739999999999999,"15min":1.196},"min":{"1min":0.74099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.899,"5min":1.931,"15min":2.4380000000000002},"last":1.472},{"interface":"front","average":{"1min":1.155,"5min":1.294,"15min":1.276},"min":{"1min":0.70899999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6759999999999999,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.266}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2170000000000001,"15min":1.2509999999999999},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7569999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.373,"15min":1.3480000000000001},"min":{"1min":0.93100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.2349999999999999,"15min":2.6680000000000001},"last":1.355}]},{"osd":2,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.393,"15min":1.413},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.0190000000000001,"5min":2.367,"15min":2.367},"last":1.093},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.381,"15min":1.4039999999999999},"min":{"1min":0.88,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.419}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.478,"15min":1.476},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5800000000000001,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.4650000000000001,"15min":1.4470000000000001},"min":{"1min":1.022,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":1.972,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.1659999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.399,"15min":1.3660000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7729999999999999,"5min":3.415,"15min":3.415},"last":1.204},{"interface":"front","average":{"1min":1.343,"5min":1.4490000000000001,"15min":1.417},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8400000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.034}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4259999999999999,"15min":1.387},"min":{"1min":1.0069999999999999,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":1.952,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.6020000000000001,"15min":1.5569999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.68300000000000005},"max":{"1min":1.843,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.534}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.96799999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.7929999999999999,"5min":3.145,"15min":3.145},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.6240000000000001,"15min":1.581},"min":{"1min":1.2889999999999999,"5min":1.044,"15min":0.98799999999999999},"max":{"1min":2.1219999999999999,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.3120000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509812,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":1.464},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82599999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8700000000000001,"5min":1.954,"15min":2.3839999999999999},"last":0.96099999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.7250000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.093},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":0.97799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0169999999999999,"5min":2.677,"15min":2.677},"last":1.3640000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.397,"15min":1.347},"min":{"1min":1.026,"5min":0.83599999999999997,"15min":0.69699999999999995},"max":{"1min":1.9690000000000001,"5min":2.177,"15min":2.448},"last":1.417},{"interface":"front","average":{"1min":1.403,"5min":1.4470000000000001,"15min":1.4510000000000001},"min":{"1min":1.1200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.9039999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.004}]},{"osd":3,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4570000000000001,"15min":1.4610000000000001},"min":{"1min":1.073,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.8140000000000001,"5min":2.3370000000000002,"15min":2.3650000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5449999999999999,"15min":1.526},"min":{"1min":1.3049999999999999,"5min":1.048,"15min":0.77000000000000002},"max":{"1min":1.899,"5min":2.71,"15min":2.71},"last":1.3300000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.347,"15min":1.3460000000000001},"min":{"1min":0.88400000000000001,"5min":0.628,"15min":0.628},"max":{"1min":2.149,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.95799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1080000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.5089999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5149999999999999,"15min":1.4790000000000001},"min":{"1min":1.0169999999999999,"5min":0.80500000000000005,"15min":0.79000000000000004},"max":{"1min":2.375,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5389999999999999,"15min":1.5149999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.169,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.151}]},{"osd":7,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.5920000000000001,"15min":1.597},"min":{"1min":1.153,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":1.9350000000000001,"5min":2.6819999999999999,"15min":2.7629999999999999},"last":1.274},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.673,"15min":1.659},"min":{"1min":1.1839999999999999,"5min":1.097,"15min":0.91900000000000004},"max":{"1min":2.452,"5min":2.5979999999999999,"15min":2.867},"last":1.2190000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509811,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.67600000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.7350000000000001,"5min":2.274,"15min":2.7069999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.2310000000000001,"15min":1.2709999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52100000000000002},"max":{"1min":1.986,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":1.2809999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.345,"15min":1.3740000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":2.0259999999999998,"5min":2.964,"15min":2.964},"last":1.036},{"interface":"front","average":{"1min":1.331,"5min":1.5669999999999999,"15min":1.579},"min":{"1min":0.754,"5min":0.68300000000000005,"15min":0.57299999999999995},"max":{"1min":1.8360000000000001,"5min":3.056,"15min":3.1779999999999999},"last":1.2110000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.611,"15min":1.669},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.52700000000000002},"max":{"1min":2.218,"5min":2.996,"15min":3.5310000000000001},"last":1.167},{"interface":"front","average":{"1min":1.431,"5min":1.681,"15min":1.7430000000000001},"min":{"1min":0.84899999999999998,"5min":0.79900000000000004,"15min":0.69499999999999995},"max":{"1min":2.137,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":1.446}]},{"osd":4,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4970000000000001,"15min":1.5660000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.71399999999999997},"max":{"1min":1.6779999999999999,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.113},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.617,"15min":1.645},"min":{"1min":0.96899999999999997,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":1.9319999999999999,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.6879999999999999,"15min":1.734},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.68999999999999995},"max":{"1min":1.9630000000000001,"5min":3.52,"15min":3.52},"last":1.333},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.6459999999999999,"15min":1.6839999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.64600000000000002},"max":{"1min":2.077,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.3919999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.7809999999999999,"15min":1.788},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.72199999999999998},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":3.1000000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.641,"5min":1.796,"15min":1.8600000000000001},"min":{"1min":1.0760000000000001,"5min":0.98999999999999999,"15min":0.73099999999999998},"max":{"1min":2.129,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.5680000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.78,"15min":1.827},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.75},"max":{"1min":1.97,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.929,"15min":1.931},"min":{"1min":1.115,"5min":1.115,"15min":0.66800000000000004},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":3.2330000000000001},"last":1.7310000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509812,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.048,"15min":1.073},"min":{"1min":0.71599999999999997,"5min":0.437,"15min":0.437},"max":{"1min":1.7729999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.383,"15min":1.383},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0630000000000002,"5min":3.1179999999999999,"15min":3.702},"last":1.2050000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.429,"15min":1.4630000000000001},"min":{"1min":0.72499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.0019999999999998,"5min":2.4889999999999999,"15min":2.738},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.873,"5min":0.81200000000000006,"15min":0.71199999999999997},"max":{"1min":2.4660000000000002,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.0700000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.5920000000000001,"15min":1.5660000000000001},"min":{"1min":0.875,"5min":0.71299999999999997,"15min":0.61799999999999999},"max":{"1min":2.504,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.6819999999999999,"15min":1.71},"min":{"1min":1.0700000000000001,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":2.1269999999999998,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.6160000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.645,"15min":1.657},"min":{"1min":1.0409999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9199999999999999,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.569},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.6539999999999999,"15min":1.649},"min":{"1min":1.155,"5min":1.0369999999999999,"15min":0.98399999999999999},"max":{"1min":2.105,"5min":2.6669999999999998,"15min":3.54},"last":1.6539999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6859999999999999,"15min":1.639},"min":{"1min":1.109,"5min":1.095,"15min":0.71199999999999997},"max":{"1min":2.4060000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.163},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.744,"15min":1.7749999999999999},"min":{"1min":1.181,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.056,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.496}]},{"osd":6,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.8049999999999999,"15min":1.8109999999999999},"min":{"1min":1.347,"5min":1.167,"15min":1.1020000000000001},"max":{"1min":2.2440000000000002,"5min":3.1720000000000002,"15min":3.6259999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.788,"15min":1.7769999999999999},"min":{"1min":1.2569999999999999,"5min":1.147,"15min":0.877},"max":{"1min":2.423,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.2729999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.8480000000000001,"15min":1.885},"min":{"1min":1.3799999999999999,"5min":1.163,"15min":1.0109999999999999},"max":{"1min":2.3599999999999999,"5min":3.012,"15min":3.7839999999999998},"last":1.534},{"interface":"front","average":{"1min":1.772,"5min":1.8779999999999999,"15min":1.8700000000000001},"min":{"1min":1.413,"5min":1.359,"15min":0.89200000000000002},"max":{"1min":2.5590000000000002,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.353}]}]},{"osd":0,"up_from":15,"seq":64424509812,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.514,"5min":2.3690000000000002,"15min":3.1960000000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3500000000000001,"15min":1.373},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.9279999999999999,"5min":2.7789999999999999,"15min":2.9929999999999999},"last":1.129}]},{"osd":2,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3660000000000001,"15min":1.5049999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6830000000000001,"5min":2.8330000000000002,"15min":2.8359999999999999},"last":1.171},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.51,"15min":1.5660000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.964,"5min":2.8769999999999998,"15min":3.3450000000000002},"last":2.0049999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3979999999999999,"15min":1.5760000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.8500000000000001,"5min":2.3599999999999999,"15min":4.6660000000000004},"last":1.085},{"interface":"front","average":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7969999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":2.0819999999999999,"5min":2.9359999999999999,"15min":3.2829999999999999},"last":1.8640000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.579,"15min":1.671},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.9239999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.411},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.655,"15min":1.712},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.79700000000000004},"max":{"1min":2.1869999999999998,"5min":2.544,"15min":3.1890000000000001},"last":1.4730000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.7090000000000001,"15min":1.7310000000000001},"min":{"1min":0.96299999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.0569999999999999,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6719999999999999,"15min":1.7569999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9119999999999999,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.208}]},{"osd":6,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.788,"15min":1.863},"min":{"1min":1.115,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1789999999999998,"5min":2.8290000000000002,"15min":3.399},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.821,"15min":1.847},"min":{"1min":1.022,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":2.532,"5min":3.0649999999999999,"15min":3.46},"last":1.54}]},{"osd":7,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.913,"15min":1.9570000000000001},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1000000000000001},"max":{"1min":2.6160000000000001,"5min":3.21,"15min":3.6160000000000001},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.629,"5min":1.792,"15min":1.8939999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.3140000000000001,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.7490000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542515,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1990000000000001,"15min":1.1919999999999999},"min":{"1min":0.77500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.972,"5min":1.972,"15min":2.5649999999999999},"last":1.248},{"interface":"front","average":{"1min":1.794,"5min":1.304,"15min":1.3200000000000001},"min":{"1min":0.63900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":9.0700000000000003,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":0.95699999999999996}]},{"osd":1,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.361,"15min":1.3360000000000001},"min":{"1min":0.93799999999999994,"5min":0.77200000000000002,"15min":0.747},"max":{"1min":9.1120000000000001,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":2.1459999999999999,"5min":1.4179999999999999,"15min":1.3580000000000001},"min":{"1min":0.746,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":17.715,"5min":17.715,"15min":17.715},"last":1.4610000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.393,"15min":1.4039999999999999},"min":{"1min":0.84799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.873,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.6279999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.4890000000000001,"15min":1.478},"min":{"1min":0.90500000000000003,"5min":0.90400000000000003,"15min":0.81200000000000006},"max":{"1min":8.2469999999999999,"5min":8.2469999999999999,"15min":8.2469999999999999},"last":1.411},{"interface":"front","average":{"1min":1.897,"5min":1.573,"15min":1.548},"min":{"1min":1.0860000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":8.2769999999999992,"5min":8.2769999999999992,"15min":8.2769999999999992},"last":1.677}]},{"osd":5,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.339,"15min":1.331},"min":{"1min":1.0089999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0249999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.373},{"interface":"front","average":{"1min":1.774,"5min":1.498,"15min":1.4690000000000001},"min":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":8.1869999999999994,"5min":8.1869999999999994,"15min":8.1869999999999994},"last":1.1160000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.4830000000000001,"15min":1.45},"min":{"1min":1.046,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.53,"15min":1.5249999999999999},"min":{"1min":1.056,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":2.0859999999999999,"5min":2.512,"15min":2.601},"last":1.5229999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.921,"5min":1.641,"15min":1.587},"min":{"1min":1.0629999999999999,"5min":0.92600000000000005,"15min":0.86299999999999999},"max":{"1min":8.7769999999999992,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.319},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.706,"15min":1.649},"min":{"1min":1.194,"5min":1.0449999999999999,"15min":0.999},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.7869999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.145,"15min":1.1890000000000001},"min":{"1min":0.67600000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.7390000000000001,"5min":2.944,"15min":2.944},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.179,"15min":1.2989999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.8,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.532}]},{"osd":2,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3640000000000001,"15min":1.421},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1930000000000001,"5min":2.835,"15min":3.585},"last":1.056},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.5009999999999999,"15min":1.5800000000000001},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.75,"5min":2.6659999999999999,"15min":2.8719999999999999},"last":1.49}]},{"osd":3,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.669,"15min":1.7130000000000001},"min":{"1min":0.747,"5min":0.63,"15min":0.63},"max":{"1min":1.9339999999999999,"5min":2.831,"15min":3.3740000000000001},"last":1.145},{"interface":"front","average":{"1min":1.369,"5min":1.5389999999999999,"15min":1.5880000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51200000000000001},"max":{"1min":1.9870000000000001,"5min":2.8370000000000002,"15min":3.234},"last":1.7170000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.5780000000000001,"15min":1.5820000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.71499999999999997},"max":{"1min":1.9259999999999999,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.673,"15min":1.6839999999999999},"min":{"1min":1.159,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":2.1459999999999999,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.28}]},{"osd":5,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.613,"15min":1.6559999999999999},"min":{"1min":0.80800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.016,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.401},{"interface":"front","average":{"1min":1.512,"5min":1.7390000000000001,"15min":1.748},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.77400000000000002},"max":{"1min":2.1179999999999999,"5min":3.2170000000000001,"15min":3.819},"last":1.5880000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.7829999999999999,"15min":1.819},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.1930000000000001,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.9279999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.8220000000000001,"15min":1.8440000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.746},"max":{"1min":1.982,"5min":2.698,"15min":3.3210000000000002},"last":1.6679999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.7490000000000001,"15min":1.8220000000000001},"min":{"1min":1.1339999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1499999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.931,"15min":1.9610000000000001},"min":{"1min":1.052,"5min":1.052,"15min":0.96299999999999997},"max":{"1min":2.246,"5min":3.3239999999999998,"15min":3.923},"last":1.851}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:11:16.305 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.305 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.305 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.306 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.306 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.306 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.307 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.307 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.307 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.307 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.308 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.308 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.308 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.309 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.309 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.309 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.310 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.310 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.310 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.311 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.311 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.311 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.312 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.312 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.312 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.313 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.313 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.313 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.314 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.314 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.314 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.315 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.315 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.315 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.315 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.316 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-10-16T19:40:54.814849+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=54, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.316 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:16.316 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:11:25.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:25.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:35.054 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:31:34.614 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.070 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:31:34.630 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.155 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:31:34.703 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.159 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:31:34.707 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.166 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:31:34.714 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.175 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:31:34.724 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.224 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:31:34.784 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.278 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:31:34.826 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:35.293 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:31:34.841 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:11:36.318 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:11:36.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.540+0000 7fc38d02e640 1 Processor -- start 2023-10-16T20:11:36.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.540+0000 7fc38d02e640 1 -- start start 2023-10-16T20:11:36.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.542+0000 7fc38d02e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3880c7a20 0x7fc38806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.542+0000 7fc38d02e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3880c5f10 0x7fc3880c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.542+0000 7fc38d02e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3881502c0 con 0x7fc38814fee0 2023-10-16T20:11:36.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.542+0000 7fc38d02e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880c6860 con 0x7fc3880c7a20 2023-10-16T20:11:36.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.542+0000 7fc38d02e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38806fc00 con 0x7fc3880c5f10 2023-10-16T20:11:36.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.542+0000 7fc37ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3880c7a20 0x7fc38806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.543+0000 7fc37ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3880c7a20 0x7fc38806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38996/0 (socket says 172.21.15.57:38996) 2023-10-16T20:11:36.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.543+0000 7fc37ffff640 1 -- 172.21.15.57:0/3423720185 learned_addr learned my addr 172.21.15.57:0/3423720185 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:11:36.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.544+0000 7fc38c82d640 1 --2- 172.21.15.57:0/3423720185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3880c5f10 0x7fc3880c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.546+0000 7fc37ffff640 1 -- 172.21.15.57:0/3423720185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3880c5f10 msgr2=0x7fc3880c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:36.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.546+0000 7fc37ffff640 1 --2- 172.21.15.57:0/3423720185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3880c5f10 0x7fc3880c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.546+0000 7fc37ffff640 1 -- 172.21.15.57:0/3423720185 >> v1:172.21.15.110:6789/0 conn(0x7fc38814fee0 legacy=0x7fc3880c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.546+0000 7fc37ffff640 1 -- 172.21.15.57:0/3423720185 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880c4830 con 0x7fc3880c7a20 2023-10-16T20:11:36.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.549+0000 7fc37ffff640 1 --2- 172.21.15.57:0/3423720185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc38806cf40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc370009850 tx=0x7fc37002ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2855b5f804e52e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.554+0000 7fc3877fe640 1 -- 172.21.15.57:0/3423720185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370004230 con 0x7fc3880c7a20 2023-10-16T20:11:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.554+0000 7fc3877fe640 1 -- 172.21.15.57:0/3423720185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370004390 con 0x7fc3880c7a20 2023-10-16T20:11:36.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.554+0000 7fc3877fe640 1 -- 172.21.15.57:0/3423720185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37002f820 con 0x7fc3880c7a20 2023-10-16T20:11:36.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 -- 172.21.15.57:0/3423720185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 msgr2=0x7fc38806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3423720185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc38806cf40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc370009850 tx=0x7fc37002ba00 comp rx=0 tx=0).stop 2023-10-16T20:11:36.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 -- 172.21.15.57:0/3423720185 shutdown_connections 2023-10-16T20:11:36.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3423720185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3880c5f10 0x7fc3880c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3423720185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc38806cf40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 -- 172.21.15.57:0/3423720185 >> 172.21.15.57:0/3423720185 conn(0x7fc3880c6f00 msgr2=0x7fc3880c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 -- 172.21.15.57:0/3423720185 shutdown_connections 2023-10-16T20:11:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.555+0000 7fc38d02e640 1 -- 172.21.15.57:0/3423720185 wait complete. 2023-10-16T20:11:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.557+0000 7fc38d02e640 1 Processor -- start 2023-10-16T20:11:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.557+0000 7fc38d02e640 1 -- start start 2023-10-16T20:11:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.558+0000 7fc38d02e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3880c5f10 0x7fc3881ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.558+0000 7fc38d02e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc3881e8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.558+0000 7fc38d02e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc38814fee0 0x7fc388157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.558+0000 7fc38d02e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388154820 con 0x7fc3880c7a20 2023-10-16T20:11:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.558+0000 7fc38d02e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388154b00 con 0x7fc3880c5f10 2023-10-16T20:11:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.558+0000 7fc38d02e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388154de0 con 0x7fc38814fee0 2023-10-16T20:11:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.559+0000 7fc37ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc3881e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.560+0000 7fc37ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc3881e8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38998/0 (socket says 172.21.15.57:38998) 2023-10-16T20:11:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.560+0000 7fc37ffff640 1 -- 172.21.15.57:0/3810261597 learned_addr learned my addr 172.21.15.57:0/3810261597 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:11:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.560+0000 7fc38c82d640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc38814fee0 0x7fc388157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.560+0000 7fc387fff640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3880c5f10 0x7fc3881ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.564+0000 7fc37ffff640 1 -- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc38814fee0 msgr2=0x7fc388157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.564+0000 7fc37ffff640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc38814fee0 0x7fc388157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.564+0000 7fc37ffff640 1 -- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3880c5f10 msgr2=0x7fc3881ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.564+0000 7fc37ffff640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3880c5f10 0x7fc3881ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.564+0000 7fc37ffff640 1 -- 172.21.15.57:0/3810261597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370009460 con 0x7fc3880c7a20 2023-10-16T20:11:36.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.566+0000 7fc37ffff640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc3881e8360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc37002ba40 tx=0x7fc3700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.571+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37003d070 con 0x7fc3880c7a20 2023-10-16T20:11:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.571+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370004500 con 0x7fc3880c7a20 2023-10-16T20:11:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.571+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37002fd80 con 0x7fc3880c7a20 2023-10-16T20:11:36.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.571+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3881eed90 con 0x7fc3880c7a20 2023-10-16T20:11:36.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.571+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3881ef350 con 0x7fc3880c7a20 2023-10-16T20:11:36.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.572+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38804e160 con 0x7fc3880c7a20 2023-10-16T20:11:36.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.597+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc37002d040 con 0x7fc3880c7a20 2023-10-16T20:11:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.600+0000 7fc3857fa640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc36806aec0 0x7fc36806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.600+0000 7fc387fff640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc36806aec0 0x7fc36806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.601+0000 7fc387fff640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc36806aec0 0x7fc36806d380 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3780016e0 tx=0x7fc378009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.892+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc37007a530 con 0x7fc3880c7a20 2023-10-16T20:11:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:36.894+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc370076870 con 0x7fc3880c7a20 2023-10-16T20:11:37.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.098+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc388159140 con 0x7fc36806aec0 2023-10-16T20:11:37.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.121+0000 7fc3857fa640 1 -- 172.21.15.57:0/3810261597 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289552 (secure 0 0 0) 0x7fc378001cc0 con 0x7fc36806aec0 2023-10-16T20:11:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:11:37.129 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:11:37.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc36806aec0 msgr2=0x7fc36806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:37.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc36806aec0 0x7fc36806d380 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3780016e0 tx=0x7fc378009040 comp rx=0 tx=0).stop 2023-10-16T20:11:37.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 msgr2=0x7fc3881e8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:37.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc3881e8360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc37002ba40 tx=0x7fc3700046c0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 shutdown_connections 2023-10-16T20:11:37.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc36806aec0 0x7fc36806d380 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc38814fee0 0x7fc388157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3880c7a20 0x7fc3881e8360 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 --2- 172.21.15.57:0/3810261597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3880c5f10 0x7fc3881ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 >> 172.21.15.57:0/3810261597 conn(0x7fc3880c6f00 msgr2=0x7fc388071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:37.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 shutdown_connections 2023-10-16T20:11:37.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:37.127+0000 7fc38d02e640 1 -- 172.21.15.57:0/3810261597 wait complete. 2023-10-16T20:11:37.151 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":951,"stamp":"2023-10-16T20:11:36.253072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12923,"ondisk_log_size":12923,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004783"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.417811+0000","last_change":"2023-10-16T19:40:59.208429+0000","last_active":"2023-10-16T20:10:33.417811+0000","last_peered":"2023-10-16T20:10:33.417811+0000","last_clean":"2023-10-16T20:10:33.417811+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:10:33.417811+0000","last_undegraded":"2023-10-16T20:10:33.417811+0000","last_fullsized":"2023-10-16T20:10:33.417811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.930291+0000","last_change":"2023-10-16T20:11:12.930525+0000","last_active":"2023-10-16T20:11:12.930291+0000","last_peered":"2023-10-16T20:11:12.930291+0000","last_clean":"2023-10-16T20:11:12.930291+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:11:12.930291+0000","last_undegraded":"2023-10-16T20:11:12.930291+0000","last_fullsized":"2023-10-16T20:11:12.930291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2023-10-16T20:11:12.930105+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2023-10-16T20:11:12.930105+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.930105+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:43:27.862335+0000","scrub_duration":0.0038562230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.113091+0000","last_change":"2023-10-16T20:10:58.113207+0000","last_active":"2023-10-16T20:10:58.113091+0000","last_peered":"2023-10-16T20:10:58.113091+0000","last_clean":"2023-10-16T20:10:58.113091+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:58.113091+0000","last_undegraded":"2023-10-16T20:10:58.113091+0000","last_fullsized":"2023-10-16T20:10:58.113091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.112934+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:56:36.903954+0000","scrub_duration":0.0043098260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.948125+0000","last_change":"2023-10-16T19:40:59.157680+0000","last_active":"2023-10-16T20:10:51.948125+0000","last_peered":"2023-10-16T20:10:51.948125+0000","last_clean":"2023-10-16T20:10:51.948125+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:10:51.948125+0000","last_undegraded":"2023-10-16T20:10:51.948125+0000","last_fullsized":"2023-10-16T20:10:51.948125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:27.225077+0000","last_change":"2023-10-16T20:11:27.225191+0000","last_active":"2023-10-16T20:11:27.225077+0000","last_peered":"2023-10-16T20:11:27.225077+0000","last_clean":"2023-10-16T20:11:27.225077+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:11:27.225077+0000","last_undegraded":"2023-10-16T20:11:27.225077+0000","last_fullsized":"2023-10-16T20:11:27.225077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:27.224877+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:27.224877+0000","last_clean_scrub_stamp":"2023-10-16T20:11:27.224877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:49.148104+0000","scrub_duration":0.003599349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:23.213667+0000","last_change":"2023-10-16T20:11:23.213775+0000","last_active":"2023-10-16T20:11:23.213667+0000","last_peered":"2023-10-16T20:11:23.213667+0000","last_clean":"2023-10-16T20:11:23.213667+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:11:23.213667+0000","last_undegraded":"2023-10-16T20:11:23.213667+0000","last_fullsized":"2023-10-16T20:11:23.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'55","last_scrub_stamp":"2023-10-16T20:11:23.213508+0000","last_deep_scrub":"25'55","last_deep_scrub_stamp":"2023-10-16T20:11:23.213508+0000","last_clean_scrub_stamp":"2023-10-16T20:11:23.213508+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:58:19.674889+0000","scrub_duration":0.003811713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.181264+0000","last_change":"2023-10-16T20:10:58.181264+0000","last_active":"2023-10-16T20:10:58.181264+0000","last_peered":"2023-10-16T20:10:58.181264+0000","last_clean":"2023-10-16T20:10:58.181264+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:58.181264+0000","last_undegraded":"2023-10-16T20:10:58.181264+0000","last_fullsized":"2023-10-16T20:10:58.181264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.180799+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:05.485396+0000","scrub_duration":0.0050881859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.687494+0000","last_change":"2023-10-16T20:11:15.687583+0000","last_active":"2023-10-16T20:11:15.687494+0000","last_peered":"2023-10-16T20:11:15.687494+0000","last_clean":"2023-10-16T20:11:15.687494+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:11:15.687494+0000","last_undegraded":"2023-10-16T20:11:15.687494+0000","last_fullsized":"2023-10-16T20:11:15.687494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.687367+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:48.220471+0000","scrub_duration":0.003008134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413710+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413710+0000","last_peered":"2023-10-16T20:10:33.413710+0000","last_clean":"2023-10-16T20:10:33.413710+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413710+0000","last_undegraded":"2023-10-16T20:10:33.413710+0000","last_fullsized":"2023-10-16T20:10:33.413710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.264046+0000","last_change":"2023-10-16T20:11:26.264157+0000","last_active":"2023-10-16T20:11:26.264046+0000","last_peered":"2023-10-16T20:11:26.264046+0000","last_clean":"2023-10-16T20:11:26.264046+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:11:26.264046+0000","last_undegraded":"2023-10-16T20:11:26.264046+0000","last_fullsized":"2023-10-16T20:11:26.264046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:26.263830+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:26.263830+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.263830+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:57.577129+0000","scrub_duration":0.0038091370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.289871+0000","last_change":"2023-10-16T20:11:16.290019+0000","last_active":"2023-10-16T20:11:16.289871+0000","last_peered":"2023-10-16T20:11:16.289871+0000","last_clean":"2023-10-16T20:11:16.289871+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:11:16.289871+0000","last_undegraded":"2023-10-16T20:11:16.289871+0000","last_fullsized":"2023-10-16T20:11:16.289871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'76","last_scrub_stamp":"2023-10-16T20:11:16.289702+0000","last_deep_scrub":"25'76","last_deep_scrub_stamp":"2023-10-16T20:11:16.289702+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.289702+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:21.470047+0000","scrub_duration":0.0035382479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:13.447001+0000","last_change":"2023-10-16T20:11:13.447113+0000","last_active":"2023-10-16T20:11:13.447001+0000","last_peered":"2023-10-16T20:11:13.447001+0000","last_clean":"2023-10-16T20:11:13.447001+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:11:13.447001+0000","last_undegraded":"2023-10-16T20:11:13.447001+0000","last_fullsized":"2023-10-16T20:11:13.447001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2023-10-16T20:11:13.446811+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2023-10-16T20:11:13.446811+0000","last_clean_scrub_stamp":"2023-10-16T20:11:13.446811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:28.423434+0000","scrub_duration":0.003574317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.714932+0000","last_change":"2023-10-16T20:11:02.715055+0000","last_active":"2023-10-16T20:11:02.714932+0000","last_peered":"2023-10-16T20:11:02.714932+0000","last_clean":"2023-10-16T20:11:02.714932+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:11:02.714932+0000","last_undegraded":"2023-10-16T20:11:02.714932+0000","last_fullsized":"2023-10-16T20:11:02.714932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.714754+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:27.826289+0000","scrub_duration":0.0039065690000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:31.943796+0000","last_change":"2023-10-16T20:11:31.944010+0000","last_active":"2023-10-16T20:11:31.943796+0000","last_peered":"2023-10-16T20:11:31.943796+0000","last_clean":"2023-10-16T20:11:31.943796+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:11:31.943796+0000","last_undegraded":"2023-10-16T20:11:31.943796+0000","last_fullsized":"2023-10-16T20:11:31.943796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:31.943475+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:31.943475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:31.943475+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:13.003702+0000","scrub_duration":0.0042240350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.843528+0000","last_change":"2023-10-16T20:11:05.843528+0000","last_active":"2023-10-16T20:11:05.843528+0000","last_peered":"2023-10-16T20:11:05.843528+0000","last_clean":"2023-10-16T20:11:05.843528+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:11:05.843528+0000","last_undegraded":"2023-10-16T20:11:05.843528+0000","last_fullsized":"2023-10-16T20:11:05.843528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.843246+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:20.298267+0000","scrub_duration":0.0036425199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.257761+0000","last_change":"2023-10-16T20:11:15.257761+0000","last_active":"2023-10-16T20:11:15.257761+0000","last_peered":"2023-10-16T20:11:15.257761+0000","last_clean":"2023-10-16T20:11:15.257761+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:11:15.257761+0000","last_undegraded":"2023-10-16T20:11:15.257761+0000","last_fullsized":"2023-10-16T20:11:15.257761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.257475+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:46.570775+0000","scrub_duration":0.0042286989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:25.205679+0000","last_change":"2023-10-16T20:11:25.205870+0000","last_active":"2023-10-16T20:11:25.205679+0000","last_peered":"2023-10-16T20:11:25.205679+0000","last_clean":"2023-10-16T20:11:25.205679+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:11:25.205679+0000","last_undegraded":"2023-10-16T20:11:25.205679+0000","last_fullsized":"2023-10-16T20:11:25.205679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:25.205501+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:25.205501+0000","last_clean_scrub_stamp":"2023-10-16T20:11:25.205501+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:18.398131+0000","scrub_duration":0.0038602850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.739768+0000","last_change":"2023-10-16T20:10:57.739768+0000","last_active":"2023-10-16T20:10:57.739768+0000","last_peered":"2023-10-16T20:10:57.739768+0000","last_clean":"2023-10-16T20:10:57.739768+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:57.739768+0000","last_undegraded":"2023-10-16T20:10:57.739768+0000","last_fullsized":"2023-10-16T20:10:57.739768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.739436+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:03.134324+0000","scrub_duration":0.0038318470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.416693+0000","last_change":"2023-10-16T19:40:59.180027+0000","last_active":"2023-10-16T20:10:33.416693+0000","last_peered":"2023-10-16T20:10:33.416693+0000","last_clean":"2023-10-16T20:10:33.416693+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:10:33.416693+0000","last_undegraded":"2023-10-16T20:10:33.416693+0000","last_fullsized":"2023-10-16T20:10:33.416693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:11.242047+0000","last_change":"2023-10-16T20:11:11.242157+0000","last_active":"2023-10-16T20:11:11.242047+0000","last_peered":"2023-10-16T20:11:11.242047+0000","last_clean":"2023-10-16T20:11:11.242047+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:11:11.242047+0000","last_undegraded":"2023-10-16T20:11:11.242047+0000","last_fullsized":"2023-10-16T20:11:11.242047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_clean_scrub_stamp":"2023-10-16T20:11:11.241831+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:18.546428+0000","scrub_duration":0.0035476230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:33.995521+0000","last_change":"2023-10-16T20:11:33.995674+0000","last_active":"2023-10-16T20:11:33.995521+0000","last_peered":"2023-10-16T20:11:33.995521+0000","last_clean":"2023-10-16T20:11:33.995521+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:11:33.995521+0000","last_undegraded":"2023-10-16T20:11:33.995521+0000","last_fullsized":"2023-10-16T20:11:33.995521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'82","last_scrub_stamp":"2023-10-16T20:11:33.995352+0000","last_deep_scrub":"25'82","last_deep_scrub_stamp":"2023-10-16T20:11:33.995352+0000","last_clean_scrub_stamp":"2023-10-16T20:11:33.995352+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:36.617577+0000","scrub_duration":0.0047927760000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:14.286115+0000","last_change":"2023-10-16T20:11:14.286224+0000","last_active":"2023-10-16T20:11:14.286115+0000","last_peered":"2023-10-16T20:11:14.286115+0000","last_clean":"2023-10-16T20:11:14.286115+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:11:14.286115+0000","last_undegraded":"2023-10-16T20:11:14.286115+0000","last_fullsized":"2023-10-16T20:11:14.286115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_clean_scrub_stamp":"2023-10-16T20:11:14.285903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:28.982844+0000","scrub_duration":0.00376969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.707011+0000","last_change":"2023-10-16T20:10:56.707130+0000","last_active":"2023-10-16T20:10:56.707011+0000","last_peered":"2023-10-16T20:10:56.707011+0000","last_clean":"2023-10-16T20:10:56.707011+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:56.707011+0000","last_undegraded":"2023-10-16T20:10:56.707011+0000","last_fullsized":"2023-10-16T20:10:56.707011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.706833+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:40.887025+0000","scrub_duration":0.0036464599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.395618+0000","last_change":"2023-10-16T20:11:06.395618+0000","last_active":"2023-10-16T20:11:06.395618+0000","last_peered":"2023-10-16T20:11:06.395618+0000","last_clean":"2023-10-16T20:11:06.395618+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:11:06.395618+0000","last_undegraded":"2023-10-16T20:11:06.395618+0000","last_fullsized":"2023-10-16T20:11:06.395618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.395317+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:33.593221+0000","scrub_duration":0.0039439499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:19.665454+0000","last_change":"2023-10-16T20:11:19.665454+0000","last_active":"2023-10-16T20:11:19.665454+0000","last_peered":"2023-10-16T20:11:19.665454+0000","last_clean":"2023-10-16T20:11:19.665454+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:11:19.665454+0000","last_undegraded":"2023-10-16T20:11:19.665454+0000","last_fullsized":"2023-10-16T20:11:19.665454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2023-10-16T20:11:19.665138+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2023-10-16T20:11:19.665138+0000","last_clean_scrub_stamp":"2023-10-16T20:11:19.665138+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:34.362079+0000","scrub_duration":0.0039841809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:24.270386+0000","last_change":"2023-10-16T20:11:24.270571+0000","last_active":"2023-10-16T20:11:24.270386+0000","last_peered":"2023-10-16T20:11:24.270386+0000","last_clean":"2023-10-16T20:11:24.270386+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:11:24.270386+0000","last_undegraded":"2023-10-16T20:11:24.270386+0000","last_fullsized":"2023-10-16T20:11:24.270386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:11:24.270212+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:11:24.270212+0000","last_clean_scrub_stamp":"2023-10-16T20:11:24.270212+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:18.933573+0000","scrub_duration":0.0038560790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.861599+0000","last_change":"2023-10-16T20:11:10.861599+0000","last_active":"2023-10-16T20:11:10.861599+0000","last_peered":"2023-10-16T20:11:10.861599+0000","last_clean":"2023-10-16T20:11:10.861599+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:11:10.861599+0000","last_undegraded":"2023-10-16T20:11:10.861599+0000","last_fullsized":"2023-10-16T20:11:10.861599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.861284+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:05:10.816911+0000","scrub_duration":0.0039407549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.659928+0000","last_change":"2023-10-16T20:11:22.660048+0000","last_active":"2023-10-16T20:11:22.659928+0000","last_peered":"2023-10-16T20:11:22.659928+0000","last_clean":"2023-10-16T20:11:22.659928+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:11:22.659928+0000","last_undegraded":"2023-10-16T20:11:22.659928+0000","last_fullsized":"2023-10-16T20:11:22.659928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2023-10-16T20:11:22.659757+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2023-10-16T20:11:22.659757+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.659757+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:06.032503+0000","scrub_duration":0.0041348829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:23.073415+0000","last_change":"2023-10-16T20:11:23.073530+0000","last_active":"2023-10-16T20:11:23.073415+0000","last_peered":"2023-10-16T20:11:23.073415+0000","last_clean":"2023-10-16T20:11:23.073415+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:11:23.073415+0000","last_undegraded":"2023-10-16T20:11:23.073415+0000","last_fullsized":"2023-10-16T20:11:23.073415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:23.073248+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:23.073248+0000","last_clean_scrub_stamp":"2023-10-16T20:11:23.073248+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:07.204756+0000","scrub_duration":0.003780743,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.429822+0000","last_change":"2023-10-16T20:11:07.429977+0000","last_active":"2023-10-16T20:11:07.429822+0000","last_peered":"2023-10-16T20:11:07.429822+0000","last_clean":"2023-10-16T20:11:07.429822+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:11:07.429822+0000","last_undegraded":"2023-10-16T20:11:07.429822+0000","last_fullsized":"2023-10-16T20:11:07.429822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.429670+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:44.961326+0000","scrub_duration":0.0040925379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.770476+0000","last_change":"2023-10-16T20:10:56.770625+0000","last_active":"2023-10-16T20:10:56.770476+0000","last_peered":"2023-10-16T20:10:56.770476+0000","last_clean":"2023-10-16T20:10:56.770476+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:56.770476+0000","last_undegraded":"2023-10-16T20:10:56.770476+0000","last_fullsized":"2023-10-16T20:10:56.770476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.770319+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:09.725801+0000","scrub_duration":0.0040022180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.235127+0000","last_change":"2023-10-16T20:11:18.235236+0000","last_active":"2023-10-16T20:11:18.235127+0000","last_peered":"2023-10-16T20:11:18.235127+0000","last_clean":"2023-10-16T20:11:18.235127+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:11:18.235127+0000","last_undegraded":"2023-10-16T20:11:18.235127+0000","last_fullsized":"2023-10-16T20:11:18.235127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:18.234972+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:18.234972+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.234972+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:45.432876+0000","scrub_duration":0.003821283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.379491+0000","last_change":"2023-10-16T20:11:22.379607+0000","last_active":"2023-10-16T20:11:22.379491+0000","last_peered":"2023-10-16T20:11:22.379491+0000","last_clean":"2023-10-16T20:11:22.379491+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:11:22.379491+0000","last_undegraded":"2023-10-16T20:11:22.379491+0000","last_fullsized":"2023-10-16T20:11:22.379491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'122","last_scrub_stamp":"2023-10-16T20:11:22.379322+0000","last_deep_scrub":"25'122","last_deep_scrub_stamp":"2023-10-16T20:11:22.379322+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.379322+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:56:16.097600+0000","scrub_duration":0.0043956230000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2225","reported_seq":2263,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.849760+0000","last_change":"2023-10-16T20:10:52.849760+0000","last_active":"2023-10-16T20:10:52.849760+0000","last_peered":"2023-10-16T20:10:52.849760+0000","last_clean":"2023-10-16T20:10:52.849760+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:52.849760+0000","last_undegraded":"2023-10-16T20:10:52.849760+0000","last_fullsized":"2023-10-16T20:10:52.849760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2225","last_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_deep_scrub":"25'2225","last_deep_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.849447+0000","objects_scrubbed":3,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:08.176111+0000","scrub_duration":0.079253561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.087828+0000","last_change":"2023-10-16T20:11:18.087962+0000","last_active":"2023-10-16T20:11:18.087828+0000","last_peered":"2023-10-16T20:11:18.087828+0000","last_clean":"2023-10-16T20:11:18.087828+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:11:18.087828+0000","last_undegraded":"2023-10-16T20:11:18.087828+0000","last_fullsized":"2023-10-16T20:11:18.087828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2023-10-16T20:11:18.087653+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2023-10-16T20:11:18.087653+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.087653+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:48.338828+0000","scrub_duration":0.0039221890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'125","reported_seq":272,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.179411+0000","last_change":"2023-10-16T20:10:59.179606+0000","last_active":"2023-10-16T20:10:59.179411+0000","last_peered":"2023-10-16T20:10:59.179411+0000","last_clean":"2023-10-16T20:10:59.179411+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:10:59.179411+0000","last_undegraded":"2023-10-16T20:10:59.179411+0000","last_fullsized":"2023-10-16T20:10:59.179411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'125","last_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_deep_scrub":"25'125","last_deep_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.179212+0000","objects_scrubbed":4,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:20.741211+0000","scrub_duration":0.01096723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'206","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.752869+0000","last_change":"2023-10-16T20:10:51.753006+0000","last_active":"2023-10-16T20:10:51.752869+0000","last_peered":"2023-10-16T20:10:51.752869+0000","last_clean":"2023-10-16T20:10:51.752869+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:51.752869+0000","last_undegraded":"2023-10-16T20:10:51.752869+0000","last_fullsized":"2023-10-16T20:10:51.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'206","last_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_deep_scrub":"25'206","last_deep_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.752708+0000","objects_scrubbed":3,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:32.503229+0000","scrub_duration":0.012306727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.751652+0000","last_change":"2023-10-16T20:11:05.751793+0000","last_active":"2023-10-16T20:11:05.751652+0000","last_peered":"2023-10-16T20:11:05.751652+0000","last_clean":"2023-10-16T20:11:05.751652+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:11:05.751652+0000","last_undegraded":"2023-10-16T20:11:05.751652+0000","last_fullsized":"2023-10-16T20:11:05.751652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.751451+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:52.727094+0000","scrub_duration":0.0039667890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'8","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.449048+0000","last_change":"2023-10-16T20:10:58.449301+0000","last_active":"2023-10-16T20:10:58.449048+0000","last_peered":"2023-10-16T20:10:58.449048+0000","last_clean":"2023-10-16T20:10:58.449048+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:10:58.449048+0000","last_undegraded":"2023-10-16T20:10:58.449048+0000","last_fullsized":"2023-10-16T20:10:58.449048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.448775+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:27.179352+0000","scrub_duration":0.0075077039999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.785768+0000","last_change":"2023-10-16T20:11:07.785880+0000","last_active":"2023-10-16T20:11:07.785768+0000","last_peered":"2023-10-16T20:11:07.785768+0000","last_clean":"2023-10-16T20:11:07.785768+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:11:07.785768+0000","last_undegraded":"2023-10-16T20:11:07.785768+0000","last_fullsized":"2023-10-16T20:11:07.785768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.785559+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:29.750005+0000","scrub_duration":0.0038216840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'172","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.248681+0000","last_change":"2023-10-16T20:11:04.248898+0000","last_active":"2023-10-16T20:11:04.248681+0000","last_peered":"2023-10-16T20:11:04.248681+0000","last_clean":"2023-10-16T20:11:04.248681+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:11:04.248681+0000","last_undegraded":"2023-10-16T20:11:04.248681+0000","last_fullsized":"2023-10-16T20:11:04.248681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'172","last_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_deep_scrub":"25'172","last_deep_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.248408+0000","objects_scrubbed":3,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:48.428600+0000","scrub_duration":0.011087784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.182531+0000","last_change":"2023-10-16T20:11:26.182647+0000","last_active":"2023-10-16T20:11:26.182531+0000","last_peered":"2023-10-16T20:11:26.182531+0000","last_clean":"2023-10-16T20:11:26.182531+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:11:26.182531+0000","last_undegraded":"2023-10-16T20:11:26.182531+0000","last_fullsized":"2023-10-16T20:11:26.182531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:26.182366+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:26.182366+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.182366+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:55.197352+0000","scrub_duration":0.003793963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'83","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.419262+0000","last_change":"2023-10-16T20:10:59.419479+0000","last_active":"2023-10-16T20:10:59.419262+0000","last_peered":"2023-10-16T20:10:59.419262+0000","last_clean":"2023-10-16T20:10:59.419262+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:10:59.419262+0000","last_undegraded":"2023-10-16T20:10:59.419262+0000","last_fullsized":"2023-10-16T20:10:59.419262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.419026+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:10.718293+0000","scrub_duration":0.0094841230000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.062378+0000","last_change":"2023-10-16T20:11:05.062502+0000","last_active":"2023-10-16T20:11:05.062378+0000","last_peered":"2023-10-16T20:11:05.062378+0000","last_clean":"2023-10-16T20:11:05.062378+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:11:05.062378+0000","last_undegraded":"2023-10-16T20:11:05.062378+0000","last_fullsized":"2023-10-16T20:11:05.062378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'95","last_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_deep_scrub":"25'95","last_deep_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.062206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:49.242398+0000","scrub_duration":0.0047295150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'87","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.090482+0000","last_change":"2023-10-16T20:10:57.090726+0000","last_active":"2023-10-16T20:10:57.090482+0000","last_peered":"2023-10-16T20:10:57.090482+0000","last_clean":"2023-10-16T20:10:57.090482+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:57.090482+0000","last_undegraded":"2023-10-16T20:10:57.090482+0000","last_fullsized":"2023-10-16T20:10:57.090482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.090239+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:45.060366+0000","scrub_duration":0.010685826000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.425093+0000","last_change":"2023-10-16T20:11:07.425093+0000","last_active":"2023-10-16T20:11:07.425093+0000","last_peered":"2023-10-16T20:11:07.425093+0000","last_clean":"2023-10-16T20:11:07.425093+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:11:07.425093+0000","last_undegraded":"2023-10-16T20:11:07.425093+0000","last_fullsized":"2023-10-16T20:11:07.425093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.424696+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:09:24.485886+0000","scrub_duration":0.0038308159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1232","reported_seq":1271,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.345878+0000","last_change":"2023-10-16T20:11:05.345878+0000","last_active":"2023-10-16T20:11:05.345878+0000","last_peered":"2023-10-16T20:11:05.345878+0000","last_clean":"2023-10-16T20:11:05.345878+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:11:05.345878+0000","last_undegraded":"2023-10-16T20:11:05.345878+0000","last_fullsized":"2023-10-16T20:11:05.345878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1232","last_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_deep_scrub":"25'1232","last_deep_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.345578+0000","objects_scrubbed":6,"log_size":1232,"log_dups_size":0,"ondisk_log_size":1232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:26:15.503390+0000","scrub_duration":0.062660380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:29.232032+0000","last_change":"2023-10-16T20:11:29.232217+0000","last_active":"2023-10-16T20:11:29.232032+0000","last_peered":"2023-10-16T20:11:29.232032+0000","last_clean":"2023-10-16T20:11:29.232032+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:11:29.232032+0000","last_undegraded":"2023-10-16T20:11:29.232032+0000","last_fullsized":"2023-10-16T20:11:29.232032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:11:29.231761+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:11:29.231761+0000","last_clean_scrub_stamp":"2023-10-16T20:11:29.231761+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:21:56.521637+0000","scrub_duration":0.0044564460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'123","reported_seq":264,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.225726+0000","last_change":"2023-10-16T20:10:52.225726+0000","last_active":"2023-10-16T20:10:52.225726+0000","last_peered":"2023-10-16T20:10:52.225726+0000","last_clean":"2023-10-16T20:10:52.225726+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:52.225726+0000","last_undegraded":"2023-10-16T20:10:52.225726+0000","last_fullsized":"2023-10-16T20:10:52.225726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'123","last_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_deep_scrub":"25'123","last_deep_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.225528+0000","objects_scrubbed":7,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:59.684729+0000","scrub_duration":0.012038705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.015002+0000","last_change":"2023-10-16T20:11:26.015214+0000","last_active":"2023-10-16T20:11:26.015002+0000","last_peered":"2023-10-16T20:11:26.015002+0000","last_clean":"2023-10-16T20:11:26.015002+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:11:26.015002+0000","last_undegraded":"2023-10-16T20:11:26.015002+0000","last_fullsized":"2023-10-16T20:11:26.015002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:26.014810+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:26.014810+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.014810+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:58.547915+0000","scrub_duration":0.0042904199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'97","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.447251+0000","last_change":"2023-10-16T20:11:04.447251+0000","last_active":"2023-10-16T20:11:04.447251+0000","last_peered":"2023-10-16T20:11:04.447251+0000","last_clean":"2023-10-16T20:11:04.447251+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:11:04.447251+0000","last_undegraded":"2023-10-16T20:11:04.447251+0000","last_fullsized":"2023-10-16T20:11:04.447251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.446964+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:34.698139+0000","scrub_duration":0.0098213269999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:28.230089+0000","last_change":"2023-10-16T20:11:28.230205+0000","last_active":"2023-10-16T20:11:28.230089+0000","last_peered":"2023-10-16T20:11:28.230089+0000","last_clean":"2023-10-16T20:11:28.230089+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:11:28.230089+0000","last_undegraded":"2023-10-16T20:11:28.230089+0000","last_fullsized":"2023-10-16T20:11:28.230089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:28.229902+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:28.229902+0000","last_clean_scrub_stamp":"2023-10-16T20:11:28.229902+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:15.264662+0000","scrub_duration":0.0046017439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'917","reported_seq":956,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.216412+0000","last_change":"2023-10-16T20:11:00.216412+0000","last_active":"2023-10-16T20:11:00.216412+0000","last_peered":"2023-10-16T20:11:00.216412+0000","last_clean":"2023-10-16T20:11:00.216412+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:11:00.216412+0000","last_undegraded":"2023-10-16T20:11:00.216412+0000","last_fullsized":"2023-10-16T20:11:00.216412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'917","last_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_deep_scrub":"25'917","last_deep_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.216120+0000","objects_scrubbed":3,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:40.966640+0000","scrub_duration":0.039363331000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:19.261823+0000","last_change":"2023-10-16T20:11:19.261823+0000","last_active":"2023-10-16T20:11:19.261823+0000","last_peered":"2023-10-16T20:11:19.261823+0000","last_clean":"2023-10-16T20:11:19.261823+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:11:19.261823+0000","last_undegraded":"2023-10-16T20:11:19.261823+0000","last_fullsized":"2023-10-16T20:11:19.261823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:19.261537+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:19.261537+0000","last_clean_scrub_stamp":"2023-10-16T20:11:19.261537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:56.793193+0000","scrub_duration":0.003903255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'120","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:48.805896+0000","last_change":"2023-10-16T20:10:48.805896+0000","last_active":"2023-10-16T20:10:48.805896+0000","last_peered":"2023-10-16T20:10:48.805896+0000","last_clean":"2023-10-16T20:10:48.805896+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:10:48.805896+0000","last_undegraded":"2023-10-16T20:10:48.805896+0000","last_fullsized":"2023-10-16T20:10:48.805896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'120","last_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_deep_scrub":"25'120","last_deep_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_clean_scrub_stamp":"2023-10-16T20:10:48.805692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:38:07.417459+0000","scrub_duration":0.014508691000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.194070+0000","last_change":"2023-10-16T20:10:57.194070+0000","last_active":"2023-10-16T20:10:57.194070+0000","last_peered":"2023-10-16T20:10:57.194070+0000","last_clean":"2023-10-16T20:10:57.194070+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:57.194070+0000","last_undegraded":"2023-10-16T20:10:57.194070+0000","last_fullsized":"2023-10-16T20:10:57.194070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.193654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:57:44.185542+0000","scrub_duration":0.004328302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'193","reported_seq":232,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.308786+0000","last_change":"2023-10-16T20:10:52.308932+0000","last_active":"2023-10-16T20:10:52.308786+0000","last_peered":"2023-10-16T20:10:52.308786+0000","last_clean":"2023-10-16T20:10:52.308786+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:52.308786+0000","last_undegraded":"2023-10-16T20:10:52.308786+0000","last_fullsized":"2023-10-16T20:10:52.308786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.308606+0000","objects_scrubbed":2,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:05:12.902639+0000","scrub_duration":0.0076596310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.399843+0000","last_change":"2023-10-16T19:40:59.128278+0000","last_active":"2023-10-16T20:10:33.399843+0000","last_peered":"2023-10-16T20:10:33.399843+0000","last_clean":"2023-10-16T20:10:33.399843+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:10:33.399843+0000","last_undegraded":"2023-10-16T20:10:33.399843+0000","last_fullsized":"2023-10-16T20:10:33.399843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'11","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:49.778351+0000","last_change":"2023-10-16T20:10:49.778439+0000","last_active":"2023-10-16T20:10:49.778351+0000","last_peered":"2023-10-16T20:10:49.778351+0000","last_clean":"2023-10-16T20:10:49.778351+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:49.778351+0000","last_undegraded":"2023-10-16T20:10:49.778351+0000","last_fullsized":"2023-10-16T20:10:49.778351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_clean_scrub_stamp":"2023-10-16T20:10:49.778235+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:34:46.159193+0000","scrub_duration":0.0051660639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413606+0000","last_change":"2023-10-16T19:40:59.127356+0000","last_active":"2023-10-16T20:10:33.413606+0000","last_peered":"2023-10-16T20:10:33.413606+0000","last_clean":"2023-10-16T20:10:33.413606+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:10:33.413606+0000","last_undegraded":"2023-10-16T20:10:33.413606+0000","last_fullsized":"2023-10-16T20:10:33.413606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'7","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:01.947796+0000","last_change":"2023-10-16T20:11:01.947921+0000","last_active":"2023-10-16T20:11:01.947796+0000","last_peered":"2023-10-16T20:11:01.947796+0000","last_clean":"2023-10-16T20:11:01.947796+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:11:01.947796+0000","last_undegraded":"2023-10-16T20:11:01.947796+0000","last_fullsized":"2023-10-16T20:11:01.947796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_clean_scrub_stamp":"2023-10-16T20:11:01.947627+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:38.925238+0000","scrub_duration":0.0085375859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.755300+0000","last_change":"2023-10-16T20:11:04.755418+0000","last_active":"2023-10-16T20:11:04.755300+0000","last_peered":"2023-10-16T20:11:04.755300+0000","last_clean":"2023-10-16T20:11:04.755300+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:11:04.755300+0000","last_undegraded":"2023-10-16T20:11:04.755300+0000","last_fullsized":"2023-10-16T20:11:04.755300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.755134+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:21.886819+0000","scrub_duration":0.0038213980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'595","reported_seq":634,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.839482+0000","last_change":"2023-10-16T20:10:50.839718+0000","last_active":"2023-10-16T20:10:50.839482+0000","last_peered":"2023-10-16T20:10:50.839482+0000","last_clean":"2023-10-16T20:10:50.839482+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:50.839482+0000","last_undegraded":"2023-10-16T20:10:50.839482+0000","last_fullsized":"2023-10-16T20:10:50.839482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'595","last_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_deep_scrub":"25'595","last_deep_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.839312+0000","objects_scrubbed":3,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:26.515689+0000","scrub_duration":0.036436172000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.439685+0000","last_change":"2023-10-16T19:40:59.157486+0000","last_active":"2023-10-16T20:10:33.439685+0000","last_peered":"2023-10-16T20:10:33.439685+0000","last_clean":"2023-10-16T20:10:33.439685+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:10:33.439685+0000","last_undegraded":"2023-10-16T20:10:33.439685+0000","last_fullsized":"2023-10-16T20:10:33.439685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.197315+0000","last_change":"2023-10-16T20:10:59.197457+0000","last_active":"2023-10-16T20:10:59.197315+0000","last_peered":"2023-10-16T20:10:59.197315+0000","last_clean":"2023-10-16T20:10:59.197315+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:10:59.197315+0000","last_undegraded":"2023-10-16T20:10:59.197315+0000","last_fullsized":"2023-10-16T20:10:59.197315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.197159+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:04.377504+0000","scrub_duration":0.013745998000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'11","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.405936+0000","last_change":"2023-10-16T20:11:03.406084+0000","last_active":"2023-10-16T20:11:03.405936+0000","last_peered":"2023-10-16T20:11:03.405936+0000","last_clean":"2023-10-16T20:11:03.405936+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:11:03.405936+0000","last_undegraded":"2023-10-16T20:11:03.405936+0000","last_fullsized":"2023-10-16T20:11:03.405936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.405741+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:50.381384+0000","scrub_duration":0.012053975999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.643028+0000","last_change":"2023-10-16T20:11:00.643141+0000","last_active":"2023-10-16T20:11:00.643028+0000","last_peered":"2023-10-16T20:11:00.643028+0000","last_clean":"2023-10-16T20:11:00.643028+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:11:00.643028+0000","last_undegraded":"2023-10-16T20:11:00.643028+0000","last_fullsized":"2023-10-16T20:11:00.643028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.642786+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:29.373362+0000","scrub_duration":0.004474586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'11","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.224693+0000","last_change":"2023-10-16T20:11:00.224693+0000","last_active":"2023-10-16T20:11:00.224693+0000","last_peered":"2023-10-16T20:11:00.224693+0000","last_clean":"2023-10-16T20:11:00.224693+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:11:00.224693+0000","last_undegraded":"2023-10-16T20:11:00.224693+0000","last_fullsized":"2023-10-16T20:11:00.224693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.224425+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:44.355933+0000","scrub_duration":0.0071850550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.053355+0000","last_change":"2023-10-16T20:11:03.053556+0000","last_active":"2023-10-16T20:11:03.053355+0000","last_peered":"2023-10-16T20:11:03.053355+0000","last_clean":"2023-10-16T20:11:03.053355+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:11:03.053355+0000","last_undegraded":"2023-10-16T20:11:03.053355+0000","last_fullsized":"2023-10-16T20:11:03.053355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.053085+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:18.379749+0000","scrub_duration":0.0044426120000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'182","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.785504+0000","last_change":"2023-10-16T20:10:52.785600+0000","last_active":"2023-10-16T20:10:52.785504+0000","last_peered":"2023-10-16T20:10:52.785504+0000","last_clean":"2023-10-16T20:10:52.785504+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:52.785504+0000","last_undegraded":"2023-10-16T20:10:52.785504+0000","last_fullsized":"2023-10-16T20:10:52.785504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.785411+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:41:36.044719+0000","scrub_duration":0.014410586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.886972+0000","last_change":"2023-10-16T20:11:16.887104+0000","last_active":"2023-10-16T20:11:16.886972+0000","last_peered":"2023-10-16T20:11:16.886972+0000","last_clean":"2023-10-16T20:11:16.886972+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:11:16.886972+0000","last_undegraded":"2023-10-16T20:11:16.886972+0000","last_fullsized":"2023-10-16T20:11:16.886972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:16.886795+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:16.886795+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.886795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:43.385781+0000","scrub_duration":0.0037474850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'441","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.423359+0000","last_change":"2023-10-16T20:11:05.423502+0000","last_active":"2023-10-16T20:11:05.423359+0000","last_peered":"2023-10-16T20:11:05.423359+0000","last_clean":"2023-10-16T20:11:05.423359+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:11:05.423359+0000","last_undegraded":"2023-10-16T20:11:05.423359+0000","last_fullsized":"2023-10-16T20:11:05.423359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'441","last_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_deep_scrub":"25'441","last_deep_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.423201+0000","objects_scrubbed":2,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.561417+0000","scrub_duration":0.028676314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.313204+0000","last_change":"2023-10-16T20:11:03.313319+0000","last_active":"2023-10-16T20:11:03.313204+0000","last_peered":"2023-10-16T20:11:03.313204+0000","last_clean":"2023-10-16T20:11:03.313204+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:11:03.313204+0000","last_undegraded":"2023-10-16T20:11:03.313204+0000","last_fullsized":"2023-10-16T20:11:03.313204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'88","last_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_deep_scrub":"25'88","last_deep_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.313054+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:27:31.752491+0000","scrub_duration":0.0037970629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.099941+0000","last_change":"2023-10-16T20:10:51.100008+0000","last_active":"2023-10-16T20:10:51.099941+0000","last_peered":"2023-10-16T20:10:51.099941+0000","last_clean":"2023-10-16T20:10:51.099941+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:51.099941+0000","last_undegraded":"2023-10-16T20:10:51.099941+0000","last_fullsized":"2023-10-16T20:10:51.099941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.099844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:15:33.686104+0000","scrub_duration":0.0037505049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.251613+0000","last_change":"2023-10-16T20:11:16.251822+0000","last_active":"2023-10-16T20:11:16.251613+0000","last_peered":"2023-10-16T20:11:16.251613+0000","last_clean":"2023-10-16T20:11:16.251613+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:11:16.251613+0000","last_undegraded":"2023-10-16T20:11:16.251613+0000","last_fullsized":"2023-10-16T20:11:16.251613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:16.251413+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:16.251413+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.251413+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:59.624160+0000","scrub_duration":0.0040611930000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.227417+0000","last_change":"2023-10-16T20:11:26.227552+0000","last_active":"2023-10-16T20:11:26.227417+0000","last_peered":"2023-10-16T20:11:26.227417+0000","last_clean":"2023-10-16T20:11:26.227417+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:11:26.227417+0000","last_undegraded":"2023-10-16T20:11:26.227417+0000","last_fullsized":"2023-10-16T20:11:26.227417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:26.227263+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:26.227263+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.227263+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:38:19.565166+0000","scrub_duration":0.010291702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.916838+0000","last_change":"2023-10-16T20:11:02.916971+0000","last_active":"2023-10-16T20:11:02.916838+0000","last_peered":"2023-10-16T20:11:02.916838+0000","last_clean":"2023-10-16T20:11:02.916838+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:11:02.916838+0000","last_undegraded":"2023-10-16T20:11:02.916838+0000","last_fullsized":"2023-10-16T20:11:02.916838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.916667+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:00.488332+0000","scrub_duration":0.004083677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'182","reported_seq":222,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.058213+0000","last_change":"2023-10-16T20:10:58.058213+0000","last_active":"2023-10-16T20:10:58.058213+0000","last_peered":"2023-10-16T20:10:58.058213+0000","last_clean":"2023-10-16T20:10:58.058213+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:58.058213+0000","last_undegraded":"2023-10-16T20:10:58.058213+0000","last_fullsized":"2023-10-16T20:10:58.058213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.057907+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:35.465191+0000","scrub_duration":0.0099141170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.714110+0000","last_change":"2023-10-16T20:11:05.714234+0000","last_active":"2023-10-16T20:11:05.714110+0000","last_peered":"2023-10-16T20:11:05.714110+0000","last_clean":"2023-10-16T20:11:05.714110+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:11:05.714110+0000","last_undegraded":"2023-10-16T20:11:05.714110+0000","last_fullsized":"2023-10-16T20:11:05.714110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.713860+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:42.363819+0000","scrub_duration":0.0043101069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'19","reported_seq":59,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.204431+0000","last_change":"2023-10-16T20:11:02.204431+0000","last_active":"2023-10-16T20:11:02.204431+0000","last_peered":"2023-10-16T20:11:02.204431+0000","last_clean":"2023-10-16T20:11:02.204431+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:11:02.204431+0000","last_undegraded":"2023-10-16T20:11:02.204431+0000","last_fullsized":"2023-10-16T20:11:02.204431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.204019+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:43.393039+0000","scrub_duration":0.010984687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:17.119707+0000","last_change":"2023-10-16T20:11:17.119707+0000","last_active":"2023-10-16T20:11:17.119707+0000","last_peered":"2023-10-16T20:11:17.119707+0000","last_clean":"2023-10-16T20:11:17.119707+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:11:17.119707+0000","last_undegraded":"2023-10-16T20:11:17.119707+0000","last_fullsized":"2023-10-16T20:11:17.119707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'48","last_scrub_stamp":"2023-10-16T20:11:17.119304+0000","last_deep_scrub":"25'48","last_deep_scrub_stamp":"2023-10-16T20:11:17.119304+0000","last_clean_scrub_stamp":"2023-10-16T20:11:17.119304+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:04.111192+0000","scrub_duration":0.0037991639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'7","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.299518+0000","last_change":"2023-10-16T20:11:09.299518+0000","last_active":"2023-10-16T20:11:09.299518+0000","last_peered":"2023-10-16T20:11:09.299518+0000","last_clean":"2023-10-16T20:11:09.299518+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:11:09.299518+0000","last_undegraded":"2023-10-16T20:11:09.299518+0000","last_fullsized":"2023-10-16T20:11:09.299518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.299250+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:50.359476+0000","scrub_duration":0.0074289619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.434160+0000","last_change":"2023-10-16T20:10:57.434160+0000","last_active":"2023-10-16T20:10:57.434160+0000","last_peered":"2023-10-16T20:10:57.434160+0000","last_clean":"2023-10-16T20:10:57.434160+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:57.434160+0000","last_undegraded":"2023-10-16T20:10:57.434160+0000","last_fullsized":"2023-10-16T20:10:57.434160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.433829+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:14.317205+0000","scrub_duration":0.0042212430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'178","reported_seq":218,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:47.079655+0000","last_change":"2023-10-16T20:10:47.079655+0000","last_active":"2023-10-16T20:10:47.079655+0000","last_peered":"2023-10-16T20:10:47.079655+0000","last_clean":"2023-10-16T20:10:47.079655+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:47.079655+0000","last_undegraded":"2023-10-16T20:10:47.079655+0000","last_fullsized":"2023-10-16T20:10:47.079655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_clean_scrub_stamp":"2023-10-16T20:10:47.079299+0000","objects_scrubbed":4,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:58.646035+0000","scrub_duration":0.012090556000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:20.688314+0000","last_change":"2023-10-16T20:11:20.688314+0000","last_active":"2023-10-16T20:11:20.688314+0000","last_peered":"2023-10-16T20:11:20.688314+0000","last_clean":"2023-10-16T20:11:20.688314+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:11:20.688314+0000","last_undegraded":"2023-10-16T20:11:20.688314+0000","last_fullsized":"2023-10-16T20:11:20.688314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2023-10-16T20:11:20.688032+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2023-10-16T20:11:20.688032+0000","last_clean_scrub_stamp":"2023-10-16T20:11:20.688032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:52.001332+0000","scrub_duration":0.0039269320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'429","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.061870+0000","last_change":"2023-10-16T20:10:50.061870+0000","last_active":"2023-10-16T20:10:50.061870+0000","last_peered":"2023-10-16T20:10:50.061870+0000","last_clean":"2023-10-16T20:10:50.061870+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:50.061870+0000","last_undegraded":"2023-10-16T20:10:50.061870+0000","last_fullsized":"2023-10-16T20:10:50.061870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.061747+0000","objects_scrubbed":2,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:43.780025+0000","scrub_duration":0.007646229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.684325+0000","last_change":"2023-10-16T20:11:18.684441+0000","last_active":"2023-10-16T20:11:18.684325+0000","last_peered":"2023-10-16T20:11:18.684325+0000","last_clean":"2023-10-16T20:11:18.684325+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:11:18.684325+0000","last_undegraded":"2023-10-16T20:11:18.684325+0000","last_fullsized":"2023-10-16T20:11:18.684325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:11:18.684142+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:11:18.684142+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.684142+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:25.921862+0000","scrub_duration":0.003750738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'14","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.287527+0000","last_change":"2023-10-16T20:11:12.287646+0000","last_active":"2023-10-16T20:11:12.287527+0000","last_peered":"2023-10-16T20:11:12.287527+0000","last_clean":"2023-10-16T20:11:12.287527+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:11:12.287527+0000","last_undegraded":"2023-10-16T20:11:12.287527+0000","last_fullsized":"2023-10-16T20:11:12.287527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'14","last_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_deep_scrub":"25'14","last_deep_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.287330+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:43.600630+0000","scrub_duration":0.0075854269999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.282147+0000","last_change":"2023-10-16T20:11:09.282147+0000","last_active":"2023-10-16T20:11:09.282147+0000","last_peered":"2023-10-16T20:11:09.282147+0000","last_clean":"2023-10-16T20:11:09.282147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:11:09.282147+0000","last_undegraded":"2023-10-16T20:11:09.282147+0000","last_fullsized":"2023-10-16T20:11:09.282147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.281641+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:34.393175+0000","scrub_duration":0.0045042149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:35.068448+0000","last_change":"2023-10-16T20:11:35.068635+0000","last_active":"2023-10-16T20:11:35.068448+0000","last_peered":"2023-10-16T20:11:35.068448+0000","last_clean":"2023-10-16T20:11:35.068448+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:11:35.068448+0000","last_undegraded":"2023-10-16T20:11:35.068448+0000","last_fullsized":"2023-10-16T20:11:35.068448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:35.068212+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:35.068212+0000","last_clean_scrub_stamp":"2023-10-16T20:11:35.068212+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:29.407569+0000","scrub_duration":0.0046133959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'13","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.246697+0000","last_change":"2023-10-16T20:11:22.246759+0000","last_active":"2023-10-16T20:11:22.246697+0000","last_peered":"2023-10-16T20:11:22.246697+0000","last_clean":"2023-10-16T20:11:22.246697+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:11:22.246697+0000","last_undegraded":"2023-10-16T20:11:22.246697+0000","last_fullsized":"2023-10-16T20:11:22.246697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-10-16T20:11:22.246620+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-10-16T20:11:22.246620+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.246620+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:20.946031+0000","scrub_duration":0.010463379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:32.085198+0000","last_change":"2023-10-16T20:11:32.085319+0000","last_active":"2023-10-16T20:11:32.085198+0000","last_peered":"2023-10-16T20:11:32.085198+0000","last_clean":"2023-10-16T20:11:32.085198+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:11:32.085198+0000","last_undegraded":"2023-10-16T20:11:32.085198+0000","last_fullsized":"2023-10-16T20:11:32.085198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:32.085036+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:32.085036+0000","last_clean_scrub_stamp":"2023-10-16T20:11:32.085036+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:19.119797+0000","scrub_duration":0.0038365719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'156","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.267670+0000","last_change":"2023-10-16T20:11:10.267809+0000","last_active":"2023-10-16T20:11:10.267670+0000","last_peered":"2023-10-16T20:11:10.267670+0000","last_clean":"2023-10-16T20:11:10.267670+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:11:10.267670+0000","last_undegraded":"2023-10-16T20:11:10.267670+0000","last_fullsized":"2023-10-16T20:11:10.267670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'156","last_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_deep_scrub":"25'156","last_deep_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.267479+0000","objects_scrubbed":7,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:24.964421+0000","scrub_duration":0.014645241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":135,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.071221+0000","last_change":"2023-10-16T20:11:06.071341+0000","last_active":"2023-10-16T20:11:06.071221+0000","last_peered":"2023-10-16T20:11:06.071221+0000","last_clean":"2023-10-16T20:11:06.071221+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:11:06.071221+0000","last_undegraded":"2023-10-16T20:11:06.071221+0000","last_fullsized":"2023-10-16T20:11:06.071221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.071033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:51:02.947576+0000","scrub_duration":0.0042787709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.791172+0000","last_change":"2023-10-16T20:10:50.791172+0000","last_active":"2023-10-16T20:10:50.791172+0000","last_peered":"2023-10-16T20:10:50.791172+0000","last_clean":"2023-10-16T20:10:50.791172+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:10:50.791172+0000","last_undegraded":"2023-10-16T20:10:50.791172+0000","last_fullsized":"2023-10-16T20:10:50.791172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.790831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:27.440790+0000","scrub_duration":0.0041105270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.684963+0000","last_change":"2023-10-16T20:11:12.685085+0000","last_active":"2023-10-16T20:11:12.684963+0000","last_peered":"2023-10-16T20:11:12.684963+0000","last_clean":"2023-10-16T20:11:12.684963+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:11:12.684963+0000","last_undegraded":"2023-10-16T20:11:12.684963+0000","last_fullsized":"2023-10-16T20:11:12.684963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.684788+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:39.823004+0000","scrub_duration":0.0045610140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:46.154118+0000","last_change":"2023-10-16T20:10:46.154175+0000","last_active":"2023-10-16T20:10:46.154118+0000","last_peered":"2023-10-16T20:10:46.154118+0000","last_clean":"2023-10-16T20:10:46.154118+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:46.154118+0000","last_undegraded":"2023-10-16T20:10:46.154118+0000","last_fullsized":"2023-10-16T20:10:46.154118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_clean_scrub_stamp":"2023-10-16T20:10:46.154049+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:41:39.554198+0000","scrub_duration":0.0087997690000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":8007,"ondisk_log_size":8007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509815,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.2010000000000001,"15min":1.173},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.5589999999999999,"5min":2.0569999999999999,"15min":2.085},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.216,"15min":1.2909999999999999},"min":{"1min":0.77300000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.8140000000000001,"5min":1.9510000000000001,"15min":2.1520000000000001},"last":1.478}]},{"osd":1,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.216,"15min":1.2330000000000001},"min":{"1min":0.70999999999999996,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.774,"5min":1.996,"15min":2.3050000000000002},"last":1.202},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2569999999999999,"15min":1.3180000000000001},"min":{"1min":0.90200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.665,"5min":1.8320000000000001,"15min":2.27},"last":1.401}]},{"osd":2,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2689999999999999,"15min":1.3200000000000001},"min":{"1min":0.83299999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7909999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.377,"15min":1.4099999999999999},"min":{"1min":0.95699999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.7629999999999999,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.5289999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.4079999999999999},"min":{"1min":0.81299999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6990000000000001,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.363},{"interface":"front","average":{"1min":1.464,"5min":1.4730000000000001,"15min":1.4990000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8140000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.4510000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3169999999999999,"15min":1.3069999999999999},"min":{"1min":0.89200000000000002,"5min":0.626,"15min":0.624},"max":{"1min":1.821,"5min":1.8759999999999999,"15min":2.375},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3759999999999999,"15min":1.403},"min":{"1min":1.036,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8859999999999999,"5min":2.298,"15min":2.5459999999999998},"last":0.95799999999999996}]},{"osd":5,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.454,"15min":1.456},"min":{"1min":1.083,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.9530000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.5,"15min":1.5109999999999999},"min":{"1min":0.72899999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.7629999999999999,"5min":2.2490000000000001,"15min":2.4750000000000001},"last":1.8009999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:49 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.5740000000000001,"15min":1.5960000000000001},"min":{"1min":1.0860000000000001,"5min":0.82599999999999996,"15min":0.80500000000000005},"max":{"1min":1.8700000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.575},{"interface":"front","average":{"1min":1.544,"5min":1.5509999999999999,"15min":1.5640000000000001},"min":{"1min":1.1859999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9990000000000001,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.236}]}]},{"osd":6,"up_from":15,"seq":64424509815,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1739999999999999,"15min":1.196},"min":{"1min":0.74099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.899,"5min":1.931,"15min":2.4380000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.155,"5min":1.294,"15min":1.276},"min":{"1min":0.70899999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6759999999999999,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.1910000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2170000000000001,"15min":1.2509999999999999},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7569999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.254},{"interface":"front","average":{"1min":1.264,"5min":1.373,"15min":1.3480000000000001},"min":{"1min":0.93100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.2349999999999999,"15min":2.6680000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.393,"15min":1.413},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.0190000000000001,"5min":2.367,"15min":2.367},"last":1.038},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.381,"15min":1.4039999999999999},"min":{"1min":0.88,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.7410000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.01}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.478,"15min":1.476},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5800000000000001,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.093},{"interface":"front","average":{"1min":1.319,"5min":1.4650000000000001,"15min":1.4470000000000001},"min":{"1min":1.022,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":1.972,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.5089999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.399,"15min":1.3660000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7729999999999999,"5min":3.415,"15min":3.415},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.343,"5min":1.4490000000000001,"15min":1.417},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8400000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.89700000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4259999999999999,"15min":1.387},"min":{"1min":1.0069999999999999,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":1.952,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.6020000000000001,"15min":1.5569999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.68300000000000005},"max":{"1min":1.843,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.877}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.96799999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.7929999999999999,"5min":3.145,"15min":3.145},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.552,"5min":1.6240000000000001,"15min":1.581},"min":{"1min":1.2889999999999999,"5min":1.044,"15min":0.98799999999999999},"max":{"1min":2.1219999999999999,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.431}]}]},{"osd":5,"up_from":15,"seq":64424509816,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":1.454},{"interface":"front","average":{"1min":1.252,"5min":1.262,"15min":1.2769999999999999},"min":{"1min":0.82599999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8700000000000001,"5min":1.954,"15min":2.3839999999999999},"last":1.7350000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.7250000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":0.97799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.0169999999999999,"5min":2.677,"15min":2.677},"last":1.6459999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.397,"15min":1.347},"min":{"1min":1.026,"5min":0.83599999999999997,"15min":0.69699999999999995},"max":{"1min":1.9690000000000001,"5min":2.177,"15min":2.448},"last":1.127},{"interface":"front","average":{"1min":1.403,"5min":1.4470000000000001,"15min":1.4510000000000001},"min":{"1min":1.1200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.9039999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.5880000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4570000000000001,"15min":1.4610000000000001},"min":{"1min":1.073,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.8140000000000001,"5min":2.3370000000000002,"15min":2.3650000000000002},"last":1.363},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5449999999999999,"15min":1.526},"min":{"1min":1.3049999999999999,"5min":1.048,"15min":0.77000000000000002},"max":{"1min":1.899,"5min":2.71,"15min":2.71},"last":1.788}]},{"osd":4,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.347,"15min":1.3460000000000001},"min":{"1min":0.88400000000000001,"5min":0.628,"15min":0.628},"max":{"1min":2.149,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.966},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.95799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1080000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.887}]},{"osd":6,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5149999999999999,"15min":1.4790000000000001},"min":{"1min":1.0169999999999999,"5min":0.80500000000000005,"15min":0.79000000000000004},"max":{"1min":2.375,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":1.704},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5389999999999999,"15min":1.5149999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.169,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":2.1989999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:10:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.5920000000000001,"15min":1.597},"min":{"1min":1.153,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":1.9350000000000001,"5min":2.6819999999999999,"15min":2.7629999999999999},"last":2.0329999999999999},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.673,"15min":1.659},"min":{"1min":1.1839999999999999,"5min":1.097,"15min":0.91900000000000004},"max":{"1min":2.452,"5min":2.5979999999999999,"15min":2.867},"last":1.9179999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509815,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.67600000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"max":{"1min":1.7350000000000001,"5min":2.274,"15min":2.7069999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.2310000000000001,"15min":1.2709999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52100000000000002},"max":{"1min":1.986,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":0.93799999999999994}]},{"osd":1,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.345,"15min":1.3740000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":2.0259999999999998,"5min":2.964,"15min":2.964},"last":1.292},{"interface":"front","average":{"1min":1.331,"5min":1.5669999999999999,"15min":1.579},"min":{"1min":0.754,"5min":0.68300000000000005,"15min":0.57299999999999995},"max":{"1min":1.8360000000000001,"5min":3.056,"15min":3.1779999999999999},"last":1.3740000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.611,"15min":1.669},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.52700000000000002},"max":{"1min":2.218,"5min":2.996,"15min":3.5310000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.681,"15min":1.7430000000000001},"min":{"1min":0.84899999999999998,"5min":0.79900000000000004,"15min":0.69499999999999995},"max":{"1min":2.137,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":1.4930000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4970000000000001,"15min":1.5660000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.71399999999999997},"max":{"1min":1.6779999999999999,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.617,"15min":1.645},"min":{"1min":0.96899999999999997,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":1.9319999999999999,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.593}]},{"osd":5,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.6879999999999999,"15min":1.734},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.68999999999999995},"max":{"1min":1.9630000000000001,"5min":3.52,"15min":3.52},"last":1.744},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.6459999999999999,"15min":1.6839999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.64600000000000002},"max":{"1min":2.077,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.5780000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.7809999999999999,"15min":1.788},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.72199999999999998},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":3.1000000000000001},"last":2.0179999999999998},{"interface":"front","average":{"1min":1.641,"5min":1.796,"15min":1.8600000000000001},"min":{"1min":1.0760000000000001,"5min":0.98999999999999999,"15min":0.73099999999999998},"max":{"1min":2.129,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":2.1240000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.78,"15min":1.827},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.75},"max":{"1min":1.97,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.929,"15min":1.931},"min":{"1min":1.115,"5min":1.115,"15min":0.66800000000000004},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":3.2330000000000001},"last":1.9450000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509816,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.048,"15min":1.073},"min":{"1min":0.71599999999999997,"5min":0.437,"15min":0.437},"max":{"1min":1.7729999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.278,"5min":1.383,"15min":1.383},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0630000000000002,"5min":3.1179999999999999,"15min":3.702},"last":1.9319999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.429,"15min":1.4630000000000001},"min":{"1min":0.72499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.0019999999999998,"5min":2.4889999999999999,"15min":2.738},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.873,"5min":0.81200000000000006,"15min":0.71199999999999997},"max":{"1min":2.4660000000000002,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.867}]},{"osd":3,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.5920000000000001,"15min":1.5660000000000001},"min":{"1min":0.875,"5min":0.71299999999999997,"15min":0.61799999999999999},"max":{"1min":2.504,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.093},{"interface":"front","average":{"1min":1.486,"5min":1.6819999999999999,"15min":1.71},"min":{"1min":1.0700000000000001,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":2.1269999999999998,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.171}]},{"osd":4,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.645,"15min":1.657},"min":{"1min":1.0409999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9199999999999999,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.6539999999999999,"15min":1.649},"min":{"1min":1.155,"5min":1.0369999999999999,"15min":0.98399999999999999},"max":{"1min":2.105,"5min":2.6669999999999998,"15min":3.54},"last":1.3460000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6859999999999999,"15min":1.639},"min":{"1min":1.109,"5min":1.095,"15min":0.71199999999999997},"max":{"1min":2.4060000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.744,"15min":1.7749999999999999},"min":{"1min":1.181,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.056,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.2989999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.8049999999999999,"15min":1.8109999999999999},"min":{"1min":1.347,"5min":1.167,"15min":1.1020000000000001},"max":{"1min":2.2440000000000002,"5min":3.1720000000000002,"15min":3.6259999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.788,"15min":1.7769999999999999},"min":{"1min":1.2569999999999999,"5min":1.147,"15min":0.877},"max":{"1min":2.423,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.246}]},{"osd":7,"last update":"Mon Oct 16 20:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.8480000000000001,"15min":1.885},"min":{"1min":1.3799999999999999,"5min":1.163,"15min":1.0109999999999999},"max":{"1min":2.3599999999999999,"5min":3.012,"15min":3.7839999999999998},"last":1.746},{"interface":"front","average":{"1min":1.772,"5min":1.8779999999999999,"15min":1.8700000000000001},"min":{"1min":1.413,"5min":1.359,"15min":0.89200000000000002},"max":{"1min":2.5590000000000002,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.681}]}]},{"osd":0,"up_from":15,"seq":64424509816,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.514,"5min":2.3690000000000002,"15min":3.1960000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.3500000000000001,"15min":1.373},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.9279999999999999,"5min":2.7789999999999999,"15min":2.9929999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3660000000000001,"15min":1.5049999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6830000000000001,"5min":2.8330000000000002,"15min":2.8359999999999999},"last":1.127},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.51,"15min":1.5660000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.964,"5min":2.8769999999999998,"15min":3.3450000000000002},"last":1.4450000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3979999999999999,"15min":1.5760000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.8500000000000001,"5min":2.3599999999999999,"15min":4.6660000000000004},"last":1.194},{"interface":"front","average":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7969999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":2.0819999999999999,"5min":2.9359999999999999,"15min":3.2829999999999999},"last":1.3069999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.579,"15min":1.671},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.9239999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.655,"15min":1.712},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.79700000000000004},"max":{"1min":2.1869999999999998,"5min":2.544,"15min":3.1890000000000001},"last":1.534}]},{"osd":5,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.7090000000000001,"15min":1.7310000000000001},"min":{"1min":0.96299999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.0569999999999999,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.71},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.6719999999999999,"15min":1.7569999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9119999999999999,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.496}]},{"osd":6,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.788,"15min":1.863},"min":{"1min":1.115,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1789999999999998,"5min":2.8290000000000002,"15min":3.399},"last":1.8},{"interface":"front","average":{"1min":1.72,"5min":1.821,"15min":1.847},"min":{"1min":1.022,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":2.532,"5min":3.0649999999999999,"15min":3.46},"last":1.8480000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:44 2023","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.913,"15min":1.9570000000000001},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1000000000000001},"max":{"1min":2.6160000000000001,"5min":3.21,"15min":3.6160000000000001},"last":1.9279999999999999},{"interface":"front","average":{"1min":1.629,"5min":1.792,"15min":1.8939999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.3140000000000001,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.647}]}]},{"osd":4,"up_from":14,"seq":60129542519,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1990000000000001,"15min":1.1919999999999999},"min":{"1min":0.77500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.972,"5min":1.972,"15min":2.5649999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.794,"5min":1.304,"15min":1.3200000000000001},"min":{"1min":0.63900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":9.0700000000000003,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.534}]},{"osd":1,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.361,"15min":1.3360000000000001},"min":{"1min":0.93799999999999994,"5min":0.77200000000000002,"15min":0.747},"max":{"1min":9.1120000000000001,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":1.264},{"interface":"front","average":{"1min":2.1459999999999999,"5min":1.4179999999999999,"15min":1.3580000000000001},"min":{"1min":0.746,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":17.715,"5min":17.715,"15min":17.715},"last":1.3560000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.393,"15min":1.4039999999999999},"min":{"1min":0.84799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.502},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.90700000000000003,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.873,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":0.99099999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.4890000000000001,"15min":1.478},"min":{"1min":0.90500000000000003,"5min":0.90400000000000003,"15min":0.81200000000000006},"max":{"1min":8.2469999999999999,"5min":8.2469999999999999,"15min":8.2469999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.897,"5min":1.573,"15min":1.548},"min":{"1min":1.0860000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":8.2769999999999992,"5min":8.2769999999999992,"15min":8.2769999999999992},"last":1.5569999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.339,"15min":1.331},"min":{"1min":1.0089999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0249999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.774,"5min":1.498,"15min":1.4690000000000001},"min":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":8.1869999999999994,"5min":8.1869999999999994,"15min":8.1869999999999994},"last":0.91000000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.4830000000000001,"15min":1.45},"min":{"1min":1.046,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.53,"15min":1.5249999999999999},"min":{"1min":1.056,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":2.0859999999999999,"5min":2.512,"15min":2.601},"last":1.389}]},{"osd":7,"last update":"Mon Oct 16 20:10:42 2023","interfaces":[{"interface":"back","average":{"1min":1.921,"5min":1.641,"15min":1.587},"min":{"1min":1.0629999999999999,"5min":0.92600000000000005,"15min":0.86299999999999999},"max":{"1min":8.7769999999999992,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.421},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.706,"15min":1.649},"min":{"1min":1.194,"5min":1.0449999999999999,"15min":0.999},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.446}]}]},{"osd":1,"up_from":14,"seq":60129542519,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.145,"15min":1.1890000000000001},"min":{"1min":0.67600000000000005,"5min":0.373,"15min":0.373},"max":{"1min":1.7390000000000001,"5min":2.944,"15min":2.944},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.179,"15min":1.2989999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.8,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.272}]},{"osd":2,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3640000000000001,"15min":1.421},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1930000000000001,"5min":2.835,"15min":3.585},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.5009999999999999,"15min":1.5800000000000001},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.75,"5min":2.6659999999999999,"15min":2.8719999999999999},"last":1.575}]},{"osd":3,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.669,"15min":1.7130000000000001},"min":{"1min":0.747,"5min":0.63,"15min":0.63},"max":{"1min":1.9339999999999999,"5min":2.831,"15min":3.3740000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.5389999999999999,"15min":1.5880000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51200000000000001},"max":{"1min":1.9870000000000001,"5min":2.8370000000000002,"15min":3.234},"last":1.3660000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.5780000000000001,"15min":1.5820000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.71499999999999997},"max":{"1min":1.9259999999999999,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.673,"15min":1.6839999999999999},"min":{"1min":1.159,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":2.1459999999999999,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.226}]},{"osd":5,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.613,"15min":1.6559999999999999},"min":{"1min":0.80800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.016,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.7390000000000001,"15min":1.748},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.77400000000000002},"max":{"1min":2.1179999999999999,"5min":3.2170000000000001,"15min":3.819},"last":1.6200000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.7829999999999999,"15min":1.819},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.1930000000000001,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.627,"5min":1.8220000000000001,"15min":1.8440000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.746},"max":{"1min":1.982,"5min":2.698,"15min":3.3210000000000002},"last":1.4330000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.7490000000000001,"15min":1.8220000000000001},"min":{"1min":1.1339999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1499999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.931,"15min":1.9610000000000001},"min":{"1min":1.052,"5min":1.052,"15min":0.96299999999999997},"max":{"1min":2.246,"5min":3.3239999999999998,"15min":3.923},"last":1.6919999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:11:37.158 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.158 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.158 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.159 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.160 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.160 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.160 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:37.161 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:11:55.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:55.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:57.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:11:57.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.394+0000 7f9de730f640 1 Processor -- start 2023-10-16T20:11:57.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.394+0000 7f9de730f640 1 -- start start 2023-10-16T20:11:57.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.396+0000 7f9de730f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9de0151190 0x7f9de00c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:57.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.396+0000 7f9de730f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:57.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.396+0000 7f9de730f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de0151570 con 0x7f9de00c12f0 2023-10-16T20:11:57.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.396+0000 7f9de730f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de00c4010 con 0x7f9de0151190 2023-10-16T20:11:57.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.396+0000 7f9de730f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00c1ce0 con 0x7f9de00c2aa0 2023-10-16T20:11:57.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.398+0000 7f9de50ab640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9de0151190 0x7f9de00c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:57.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.398+0000 7f9de58ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:57.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.398+0000 7f9de50ab640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9de0151190 0x7f9de00c2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58518/0 (socket says 172.21.15.57:58518) 2023-10-16T20:11:57.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.398+0000 7f9de50ab640 1 -- 172.21.15.57:0/2934632885 learned_addr learned my addr 172.21.15.57:0/2934632885 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:11:57.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.402+0000 7f9de50ab640 1 -- 172.21.15.57:0/2934632885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 msgr2=0x7f9de006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:57.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.402+0000 7f9de50ab640 1 --2- 172.21.15.57:0/2934632885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de006dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:57.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.402+0000 7f9de50ab640 1 -- 172.21.15.57:0/2934632885 >> v1:172.21.15.57:6789/0 conn(0x7f9de00c12f0 legacy=0x7f9de006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:57.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.402+0000 7f9de50ab640 1 -- 172.21.15.57:0/2934632885 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00c5530 con 0x7f9de0151190 2023-10-16T20:11:57.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.405+0000 7f9de50ab640 1 --2- 172.21.15.57:0/2934632885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de0151190 0x7f9de00c2560 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9de00c4150 tx=0x7f9ddc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9ed405ac6ad858 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:57.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.411+0000 7f9dd7fff640 1 -- 172.21.15.57:0/2934632885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc030840 con 0x7f9de0151190 2023-10-16T20:11:57.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.411+0000 7f9dd7fff640 1 -- 172.21.15.57:0/2934632885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0309a0 con 0x7f9de0151190 2023-10-16T20:11:57.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.411+0000 7f9dd7fff640 1 -- 172.21.15.57:0/2934632885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc030d30 con 0x7f9de0151190 2023-10-16T20:11:57.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.411+0000 7f9de730f640 1 -- 172.21.15.57:0/2934632885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de0151190 msgr2=0x7f9de00c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:57.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.411+0000 7f9de730f640 1 --2- 172.21.15.57:0/2934632885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de0151190 0x7f9de00c2560 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9de00c4150 tx=0x7f9ddc02b980 comp rx=0 tx=0).stop 2023-10-16T20:11:57.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.412+0000 7f9de730f640 1 -- 172.21.15.57:0/2934632885 shutdown_connections 2023-10-16T20:11:57.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.412+0000 7f9de730f640 1 --2- 172.21.15.57:0/2934632885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de006dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:57.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.412+0000 7f9de730f640 1 --2- 172.21.15.57:0/2934632885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de0151190 0x7f9de00c2560 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:57.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.412+0000 7f9de730f640 1 -- 172.21.15.57:0/2934632885 >> 172.21.15.57:0/2934632885 conn(0x7f9de006c430 msgr2=0x7f9de0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:57.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.412+0000 7f9de730f640 1 -- 172.21.15.57:0/2934632885 shutdown_connections 2023-10-16T20:11:57.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.412+0000 7f9de730f640 1 -- 172.21.15.57:0/2934632885 wait complete. 2023-10-16T20:11:57.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.415+0000 7f9de730f640 1 Processor -- start 2023-10-16T20:11:57.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.415+0000 7f9de730f640 1 -- start start 2023-10-16T20:11:57.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.416+0000 7f9de730f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 0x7f9de0158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:57.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.416+0000 7f9de730f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de00ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:57.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.417+0000 7f9de730f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9de0151190 0x7f9de01521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:57.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.417+0000 7f9de730f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0158430 con 0x7f9de00c12f0 2023-10-16T20:11:57.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.417+0000 7f9de730f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0153f00 con 0x7f9de0151190 2023-10-16T20:11:57.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.417+0000 7f9de730f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0157f40 con 0x7f9de00c2aa0 2023-10-16T20:11:57.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.417+0000 7f9de50ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 0x7f9de0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:57.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.418+0000 7f9de50ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 0x7f9de0158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58532/0 (socket says 172.21.15.57:58532) 2023-10-16T20:11:57.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.418+0000 7f9de50ab640 1 -- 172.21.15.57:0/2706871063 learned_addr learned my addr 172.21.15.57:0/2706871063 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:11:57.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.418+0000 7f9de48aa640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de00ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:57.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.418+0000 7f9de58ac640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9de0151190 0x7f9de01521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:57.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.423+0000 7f9de50ab640 1 -- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 msgr2=0x7f9de00ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:57.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.423+0000 7f9de50ab640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de00ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:57.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.423+0000 7f9de50ab640 1 -- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9de0151190 msgr2=0x7f9de01521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:57.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.423+0000 7f9de50ab640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9de0151190 0x7f9de01521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:57.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.423+0000 7f9de50ab640 1 -- 172.21.15.57:0/2706871063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0094d0 con 0x7f9de00c12f0 2023-10-16T20:11:57.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.426+0000 7f9de50ab640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 0x7f9de0158870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009960 tx=0x7f9ddc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:57.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.431+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc039a90 con 0x7f9de00c12f0 2023-10-16T20:11:57.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.431+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de01eec80 con 0x7f9de00c12f0 2023-10-16T20:11:57.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.431+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de00cad60 con 0x7f9de00c12f0 2023-10-16T20:11:57.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.432+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc039bf0 con 0x7f9de00c12f0 2023-10-16T20:11:57.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.432+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc04d440 con 0x7f9de00c12f0 2023-10-16T20:11:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.433+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc0005250 con 0x7f9de00c12f0 2023-10-16T20:11:57.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.741+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ddc04d5a0 con 0x7f9de00c12f0 2023-10-16T20:11:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.743+0000 7f9dd5ffb640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9dc406ae70 0x7f9dc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.744+0000 7f9de48aa640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9dc406ae70 0x7f9dc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.746+0000 7f9de48aa640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9dc406ae70 0x7f9dc406d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9de01e8d60 tx=0x7f9dd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:57.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.779+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9ddc07adc0 con 0x7f9de00c12f0 2023-10-16T20:11:57.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.786+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ddc077100 con 0x7f9de00c12f0 2023-10-16T20:11:57.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:57.994+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9dc0000bc0 con 0x7f9dc406ae70 2023-10-16T20:11:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.020+0000 7f9dd5ffb640 1 -- 172.21.15.57:0/2706871063 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289737 (secure 0 0 0) 0x7f9dc0000bc0 con 0x7f9dc406ae70 2023-10-16T20:11:58.024 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:11:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:11:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9dc406ae70 msgr2=0x7f9dc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9dc406ae70 0x7f9dc406d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9de01e8d60 tx=0x7f9dd0009040 comp rx=0 tx=0).stop 2023-10-16T20:11:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 msgr2=0x7f9de0158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 0x7f9de0158870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009960 tx=0x7f9ddc004730 comp rx=0 tx=0).stop 2023-10-16T20:11:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 shutdown_connections 2023-10-16T20:11:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f9dc406ae70 0x7f9dc406d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9de0151190 0x7f9de01521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9de00c2aa0 0x7f9de00ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:58.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 --2- 172.21.15.57:0/2706871063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9de00c12f0 0x7f9de0158870 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:58.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 >> 172.21.15.57:0/2706871063 conn(0x7f9de006c430 msgr2=0x7f9de006dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:58.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 shutdown_connections 2023-10-16T20:11:58.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:11:58.029+0000 7f9de730f640 1 -- 172.21.15.57:0/2706871063 wait complete. 2023-10-16T20:11:58.056 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":961,"stamp":"2023-10-16T20:11:56.261662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12923,"ondisk_log_size":12923,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004885"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:40.282632+0000","last_change":"2023-10-16T20:11:40.282749+0000","last_active":"2023-10-16T20:11:40.282632+0000","last_peered":"2023-10-16T20:11:40.282632+0000","last_clean":"2023-10-16T20:11:40.282632+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:11:40.282632+0000","last_undegraded":"2023-10-16T20:11:40.282632+0000","last_fullsized":"2023-10-16T20:11:40.282632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2023-10-16T20:11:40.282461+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2023-10-16T20:11:40.282461+0000","last_clean_scrub_stamp":"2023-10-16T20:11:40.282461+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:06.022999+0000","scrub_duration":0.0039075719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.930291+0000","last_change":"2023-10-16T20:11:12.930525+0000","last_active":"2023-10-16T20:11:12.930291+0000","last_peered":"2023-10-16T20:11:12.930291+0000","last_clean":"2023-10-16T20:11:12.930291+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:11:12.930291+0000","last_undegraded":"2023-10-16T20:11:12.930291+0000","last_fullsized":"2023-10-16T20:11:12.930291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2023-10-16T20:11:12.930105+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2023-10-16T20:11:12.930105+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.930105+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:43:27.862335+0000","scrub_duration":0.0038562230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.113091+0000","last_change":"2023-10-16T20:10:58.113207+0000","last_active":"2023-10-16T20:10:58.113091+0000","last_peered":"2023-10-16T20:10:58.113091+0000","last_clean":"2023-10-16T20:10:58.113091+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:58.113091+0000","last_undegraded":"2023-10-16T20:10:58.113091+0000","last_fullsized":"2023-10-16T20:10:58.113091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.112934+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:56:36.903954+0000","scrub_duration":0.0043098260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:38.057280+0000","last_change":"2023-10-16T20:11:38.057459+0000","last_active":"2023-10-16T20:11:38.057280+0000","last_peered":"2023-10-16T20:11:38.057280+0000","last_clean":"2023-10-16T20:11:38.057280+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:11:38.057280+0000","last_undegraded":"2023-10-16T20:11:38.057280+0000","last_fullsized":"2023-10-16T20:11:38.057280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:11:38.057039+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:11:38.057039+0000","last_clean_scrub_stamp":"2023-10-16T20:11:38.057039+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:31:37.576742+0000","scrub_duration":0.0042427519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:27.225077+0000","last_change":"2023-10-16T20:11:27.225191+0000","last_active":"2023-10-16T20:11:27.225077+0000","last_peered":"2023-10-16T20:11:27.225077+0000","last_clean":"2023-10-16T20:11:27.225077+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:11:27.225077+0000","last_undegraded":"2023-10-16T20:11:27.225077+0000","last_fullsized":"2023-10-16T20:11:27.225077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:27.224877+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:27.224877+0000","last_clean_scrub_stamp":"2023-10-16T20:11:27.224877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:49.148104+0000","scrub_duration":0.003599349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:23.213667+0000","last_change":"2023-10-16T20:11:23.213775+0000","last_active":"2023-10-16T20:11:23.213667+0000","last_peered":"2023-10-16T20:11:23.213667+0000","last_clean":"2023-10-16T20:11:23.213667+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:11:23.213667+0000","last_undegraded":"2023-10-16T20:11:23.213667+0000","last_fullsized":"2023-10-16T20:11:23.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'55","last_scrub_stamp":"2023-10-16T20:11:23.213508+0000","last_deep_scrub":"25'55","last_deep_scrub_stamp":"2023-10-16T20:11:23.213508+0000","last_clean_scrub_stamp":"2023-10-16T20:11:23.213508+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:58:19.674889+0000","scrub_duration":0.003811713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.181264+0000","last_change":"2023-10-16T20:10:58.181264+0000","last_active":"2023-10-16T20:10:58.181264+0000","last_peered":"2023-10-16T20:10:58.181264+0000","last_clean":"2023-10-16T20:10:58.181264+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:58.181264+0000","last_undegraded":"2023-10-16T20:10:58.181264+0000","last_fullsized":"2023-10-16T20:10:58.181264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.180799+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:05.485396+0000","scrub_duration":0.0050881859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.687494+0000","last_change":"2023-10-16T20:11:15.687583+0000","last_active":"2023-10-16T20:11:15.687494+0000","last_peered":"2023-10-16T20:11:15.687494+0000","last_clean":"2023-10-16T20:11:15.687494+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:11:15.687494+0000","last_undegraded":"2023-10-16T20:11:15.687494+0000","last_fullsized":"2023-10-16T20:11:15.687494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.687367+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:48.220471+0000","scrub_duration":0.003008134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:33.413710+0000","last_change":"2023-10-16T19:41:25.496884+0000","last_active":"2023-10-16T20:10:33.413710+0000","last_peered":"2023-10-16T20:10:33.413710+0000","last_clean":"2023-10-16T20:10:33.413710+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:10:33.413710+0000","last_undegraded":"2023-10-16T20:10:33.413710+0000","last_fullsized":"2023-10-16T20:10:33.413710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:40:57.305449+0000","last_clean_scrub_stamp":"2023-10-16T19:40:57.305449+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.264046+0000","last_change":"2023-10-16T20:11:26.264157+0000","last_active":"2023-10-16T20:11:26.264046+0000","last_peered":"2023-10-16T20:11:26.264046+0000","last_clean":"2023-10-16T20:11:26.264046+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:11:26.264046+0000","last_undegraded":"2023-10-16T20:11:26.264046+0000","last_fullsized":"2023-10-16T20:11:26.264046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:26.263830+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:26.263830+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.263830+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:57.577129+0000","scrub_duration":0.0038091370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.289871+0000","last_change":"2023-10-16T20:11:16.290019+0000","last_active":"2023-10-16T20:11:16.289871+0000","last_peered":"2023-10-16T20:11:16.289871+0000","last_clean":"2023-10-16T20:11:16.289871+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:11:16.289871+0000","last_undegraded":"2023-10-16T20:11:16.289871+0000","last_fullsized":"2023-10-16T20:11:16.289871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'76","last_scrub_stamp":"2023-10-16T20:11:16.289702+0000","last_deep_scrub":"25'76","last_deep_scrub_stamp":"2023-10-16T20:11:16.289702+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.289702+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:21.470047+0000","scrub_duration":0.0035382479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:13.447001+0000","last_change":"2023-10-16T20:11:13.447113+0000","last_active":"2023-10-16T20:11:13.447001+0000","last_peered":"2023-10-16T20:11:13.447001+0000","last_clean":"2023-10-16T20:11:13.447001+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:11:13.447001+0000","last_undegraded":"2023-10-16T20:11:13.447001+0000","last_fullsized":"2023-10-16T20:11:13.447001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2023-10-16T20:11:13.446811+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2023-10-16T20:11:13.446811+0000","last_clean_scrub_stamp":"2023-10-16T20:11:13.446811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:28.423434+0000","scrub_duration":0.003574317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.714932+0000","last_change":"2023-10-16T20:11:02.715055+0000","last_active":"2023-10-16T20:11:02.714932+0000","last_peered":"2023-10-16T20:11:02.714932+0000","last_clean":"2023-10-16T20:11:02.714932+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:11:02.714932+0000","last_undegraded":"2023-10-16T20:11:02.714932+0000","last_fullsized":"2023-10-16T20:11:02.714932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.714754+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:27.826289+0000","scrub_duration":0.0039065690000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:31.943796+0000","last_change":"2023-10-16T20:11:31.944010+0000","last_active":"2023-10-16T20:11:31.943796+0000","last_peered":"2023-10-16T20:11:31.943796+0000","last_clean":"2023-10-16T20:11:31.943796+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:11:31.943796+0000","last_undegraded":"2023-10-16T20:11:31.943796+0000","last_fullsized":"2023-10-16T20:11:31.943796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:31.943475+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:31.943475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:31.943475+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:13.003702+0000","scrub_duration":0.0042240350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.843528+0000","last_change":"2023-10-16T20:11:05.843528+0000","last_active":"2023-10-16T20:11:05.843528+0000","last_peered":"2023-10-16T20:11:05.843528+0000","last_clean":"2023-10-16T20:11:05.843528+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:11:05.843528+0000","last_undegraded":"2023-10-16T20:11:05.843528+0000","last_fullsized":"2023-10-16T20:11:05.843528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.843246+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:20.298267+0000","scrub_duration":0.0036425199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.257761+0000","last_change":"2023-10-16T20:11:15.257761+0000","last_active":"2023-10-16T20:11:15.257761+0000","last_peered":"2023-10-16T20:11:15.257761+0000","last_clean":"2023-10-16T20:11:15.257761+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:11:15.257761+0000","last_undegraded":"2023-10-16T20:11:15.257761+0000","last_fullsized":"2023-10-16T20:11:15.257761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.257475+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:46.570775+0000","scrub_duration":0.0042286989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:25.205679+0000","last_change":"2023-10-16T20:11:25.205870+0000","last_active":"2023-10-16T20:11:25.205679+0000","last_peered":"2023-10-16T20:11:25.205679+0000","last_clean":"2023-10-16T20:11:25.205679+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:11:25.205679+0000","last_undegraded":"2023-10-16T20:11:25.205679+0000","last_fullsized":"2023-10-16T20:11:25.205679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:25.205501+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:25.205501+0000","last_clean_scrub_stamp":"2023-10-16T20:11:25.205501+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:18.398131+0000","scrub_duration":0.0038602850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.739768+0000","last_change":"2023-10-16T20:10:57.739768+0000","last_active":"2023-10-16T20:10:57.739768+0000","last_peered":"2023-10-16T20:10:57.739768+0000","last_clean":"2023-10-16T20:10:57.739768+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:57.739768+0000","last_undegraded":"2023-10-16T20:10:57.739768+0000","last_fullsized":"2023-10-16T20:10:57.739768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.739436+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:03.134324+0000","scrub_duration":0.0038318470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:49.375706+0000","last_change":"2023-10-16T20:11:49.375898+0000","last_active":"2023-10-16T20:11:49.375706+0000","last_peered":"2023-10-16T20:11:49.375706+0000","last_clean":"2023-10-16T20:11:49.375706+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:11:49.375706+0000","last_undegraded":"2023-10-16T20:11:49.375706+0000","last_fullsized":"2023-10-16T20:11:49.375706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:49.375526+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:49.375526+0000","last_clean_scrub_stamp":"2023-10-16T20:11:49.375526+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:31.515696+0000","scrub_duration":0.0041958730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:11.242047+0000","last_change":"2023-10-16T20:11:11.242157+0000","last_active":"2023-10-16T20:11:11.242047+0000","last_peered":"2023-10-16T20:11:11.242047+0000","last_clean":"2023-10-16T20:11:11.242047+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:11:11.242047+0000","last_undegraded":"2023-10-16T20:11:11.242047+0000","last_fullsized":"2023-10-16T20:11:11.242047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_clean_scrub_stamp":"2023-10-16T20:11:11.241831+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:18.546428+0000","scrub_duration":0.0035476230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:33.995521+0000","last_change":"2023-10-16T20:11:33.995674+0000","last_active":"2023-10-16T20:11:33.995521+0000","last_peered":"2023-10-16T20:11:33.995521+0000","last_clean":"2023-10-16T20:11:33.995521+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:11:33.995521+0000","last_undegraded":"2023-10-16T20:11:33.995521+0000","last_fullsized":"2023-10-16T20:11:33.995521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'82","last_scrub_stamp":"2023-10-16T20:11:33.995352+0000","last_deep_scrub":"25'82","last_deep_scrub_stamp":"2023-10-16T20:11:33.995352+0000","last_clean_scrub_stamp":"2023-10-16T20:11:33.995352+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:36.617577+0000","scrub_duration":0.0047927760000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:14.286115+0000","last_change":"2023-10-16T20:11:14.286224+0000","last_active":"2023-10-16T20:11:14.286115+0000","last_peered":"2023-10-16T20:11:14.286115+0000","last_clean":"2023-10-16T20:11:14.286115+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:11:14.286115+0000","last_undegraded":"2023-10-16T20:11:14.286115+0000","last_fullsized":"2023-10-16T20:11:14.286115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_clean_scrub_stamp":"2023-10-16T20:11:14.285903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:28.982844+0000","scrub_duration":0.00376969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.707011+0000","last_change":"2023-10-16T20:10:56.707130+0000","last_active":"2023-10-16T20:10:56.707011+0000","last_peered":"2023-10-16T20:10:56.707011+0000","last_clean":"2023-10-16T20:10:56.707011+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:56.707011+0000","last_undegraded":"2023-10-16T20:10:56.707011+0000","last_fullsized":"2023-10-16T20:10:56.707011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.706833+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:40.887025+0000","scrub_duration":0.0036464599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.395618+0000","last_change":"2023-10-16T20:11:06.395618+0000","last_active":"2023-10-16T20:11:06.395618+0000","last_peered":"2023-10-16T20:11:06.395618+0000","last_clean":"2023-10-16T20:11:06.395618+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:11:06.395618+0000","last_undegraded":"2023-10-16T20:11:06.395618+0000","last_fullsized":"2023-10-16T20:11:06.395618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.395317+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:33.593221+0000","scrub_duration":0.0039439499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:19.665454+0000","last_change":"2023-10-16T20:11:19.665454+0000","last_active":"2023-10-16T20:11:19.665454+0000","last_peered":"2023-10-16T20:11:19.665454+0000","last_clean":"2023-10-16T20:11:19.665454+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:11:19.665454+0000","last_undegraded":"2023-10-16T20:11:19.665454+0000","last_fullsized":"2023-10-16T20:11:19.665454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2023-10-16T20:11:19.665138+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2023-10-16T20:11:19.665138+0000","last_clean_scrub_stamp":"2023-10-16T20:11:19.665138+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:34.362079+0000","scrub_duration":0.0039841809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:24.270386+0000","last_change":"2023-10-16T20:11:24.270571+0000","last_active":"2023-10-16T20:11:24.270386+0000","last_peered":"2023-10-16T20:11:24.270386+0000","last_clean":"2023-10-16T20:11:24.270386+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:11:24.270386+0000","last_undegraded":"2023-10-16T20:11:24.270386+0000","last_fullsized":"2023-10-16T20:11:24.270386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:11:24.270212+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:11:24.270212+0000","last_clean_scrub_stamp":"2023-10-16T20:11:24.270212+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:18.933573+0000","scrub_duration":0.0038560790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.861599+0000","last_change":"2023-10-16T20:11:10.861599+0000","last_active":"2023-10-16T20:11:10.861599+0000","last_peered":"2023-10-16T20:11:10.861599+0000","last_clean":"2023-10-16T20:11:10.861599+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:11:10.861599+0000","last_undegraded":"2023-10-16T20:11:10.861599+0000","last_fullsized":"2023-10-16T20:11:10.861599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.861284+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:05:10.816911+0000","scrub_duration":0.0039407549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.659928+0000","last_change":"2023-10-16T20:11:22.660048+0000","last_active":"2023-10-16T20:11:22.659928+0000","last_peered":"2023-10-16T20:11:22.659928+0000","last_clean":"2023-10-16T20:11:22.659928+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:11:22.659928+0000","last_undegraded":"2023-10-16T20:11:22.659928+0000","last_fullsized":"2023-10-16T20:11:22.659928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2023-10-16T20:11:22.659757+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2023-10-16T20:11:22.659757+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.659757+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:06.032503+0000","scrub_duration":0.0041348829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:23.073415+0000","last_change":"2023-10-16T20:11:23.073530+0000","last_active":"2023-10-16T20:11:23.073415+0000","last_peered":"2023-10-16T20:11:23.073415+0000","last_clean":"2023-10-16T20:11:23.073415+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:11:23.073415+0000","last_undegraded":"2023-10-16T20:11:23.073415+0000","last_fullsized":"2023-10-16T20:11:23.073415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:23.073248+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:23.073248+0000","last_clean_scrub_stamp":"2023-10-16T20:11:23.073248+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:07.204756+0000","scrub_duration":0.003780743,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.429822+0000","last_change":"2023-10-16T20:11:07.429977+0000","last_active":"2023-10-16T20:11:07.429822+0000","last_peered":"2023-10-16T20:11:07.429822+0000","last_clean":"2023-10-16T20:11:07.429822+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:11:07.429822+0000","last_undegraded":"2023-10-16T20:11:07.429822+0000","last_fullsized":"2023-10-16T20:11:07.429822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.429670+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:44.961326+0000","scrub_duration":0.0040925379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.770476+0000","last_change":"2023-10-16T20:10:56.770625+0000","last_active":"2023-10-16T20:10:56.770476+0000","last_peered":"2023-10-16T20:10:56.770476+0000","last_clean":"2023-10-16T20:10:56.770476+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:56.770476+0000","last_undegraded":"2023-10-16T20:10:56.770476+0000","last_fullsized":"2023-10-16T20:10:56.770476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.770319+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:09.725801+0000","scrub_duration":0.0040022180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.235127+0000","last_change":"2023-10-16T20:11:18.235236+0000","last_active":"2023-10-16T20:11:18.235127+0000","last_peered":"2023-10-16T20:11:18.235127+0000","last_clean":"2023-10-16T20:11:18.235127+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:11:18.235127+0000","last_undegraded":"2023-10-16T20:11:18.235127+0000","last_fullsized":"2023-10-16T20:11:18.235127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:18.234972+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:18.234972+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.234972+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:45.432876+0000","scrub_duration":0.003821283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.379491+0000","last_change":"2023-10-16T20:11:22.379607+0000","last_active":"2023-10-16T20:11:22.379491+0000","last_peered":"2023-10-16T20:11:22.379491+0000","last_clean":"2023-10-16T20:11:22.379491+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:11:22.379491+0000","last_undegraded":"2023-10-16T20:11:22.379491+0000","last_fullsized":"2023-10-16T20:11:22.379491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'122","last_scrub_stamp":"2023-10-16T20:11:22.379322+0000","last_deep_scrub":"25'122","last_deep_scrub_stamp":"2023-10-16T20:11:22.379322+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.379322+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:56:16.097600+0000","scrub_duration":0.0043956230000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2225","reported_seq":2263,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.849760+0000","last_change":"2023-10-16T20:10:52.849760+0000","last_active":"2023-10-16T20:10:52.849760+0000","last_peered":"2023-10-16T20:10:52.849760+0000","last_clean":"2023-10-16T20:10:52.849760+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:52.849760+0000","last_undegraded":"2023-10-16T20:10:52.849760+0000","last_fullsized":"2023-10-16T20:10:52.849760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2225","last_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_deep_scrub":"25'2225","last_deep_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.849447+0000","objects_scrubbed":3,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:08.176111+0000","scrub_duration":0.079253561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.087828+0000","last_change":"2023-10-16T20:11:18.087962+0000","last_active":"2023-10-16T20:11:18.087828+0000","last_peered":"2023-10-16T20:11:18.087828+0000","last_clean":"2023-10-16T20:11:18.087828+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:11:18.087828+0000","last_undegraded":"2023-10-16T20:11:18.087828+0000","last_fullsized":"2023-10-16T20:11:18.087828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2023-10-16T20:11:18.087653+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2023-10-16T20:11:18.087653+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.087653+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:48.338828+0000","scrub_duration":0.0039221890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'125","reported_seq":272,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.179411+0000","last_change":"2023-10-16T20:10:59.179606+0000","last_active":"2023-10-16T20:10:59.179411+0000","last_peered":"2023-10-16T20:10:59.179411+0000","last_clean":"2023-10-16T20:10:59.179411+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:10:59.179411+0000","last_undegraded":"2023-10-16T20:10:59.179411+0000","last_fullsized":"2023-10-16T20:10:59.179411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'125","last_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_deep_scrub":"25'125","last_deep_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.179212+0000","objects_scrubbed":4,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:20.741211+0000","scrub_duration":0.01096723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'206","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.752869+0000","last_change":"2023-10-16T20:10:51.753006+0000","last_active":"2023-10-16T20:10:51.752869+0000","last_peered":"2023-10-16T20:10:51.752869+0000","last_clean":"2023-10-16T20:10:51.752869+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:51.752869+0000","last_undegraded":"2023-10-16T20:10:51.752869+0000","last_fullsized":"2023-10-16T20:10:51.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'206","last_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_deep_scrub":"25'206","last_deep_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.752708+0000","objects_scrubbed":3,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:32.503229+0000","scrub_duration":0.012306727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.751652+0000","last_change":"2023-10-16T20:11:05.751793+0000","last_active":"2023-10-16T20:11:05.751652+0000","last_peered":"2023-10-16T20:11:05.751652+0000","last_clean":"2023-10-16T20:11:05.751652+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:11:05.751652+0000","last_undegraded":"2023-10-16T20:11:05.751652+0000","last_fullsized":"2023-10-16T20:11:05.751652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.751451+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:52.727094+0000","scrub_duration":0.0039667890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'8","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.449048+0000","last_change":"2023-10-16T20:10:58.449301+0000","last_active":"2023-10-16T20:10:58.449048+0000","last_peered":"2023-10-16T20:10:58.449048+0000","last_clean":"2023-10-16T20:10:58.449048+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:10:58.449048+0000","last_undegraded":"2023-10-16T20:10:58.449048+0000","last_fullsized":"2023-10-16T20:10:58.449048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.448775+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:27.179352+0000","scrub_duration":0.0075077039999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.785768+0000","last_change":"2023-10-16T20:11:07.785880+0000","last_active":"2023-10-16T20:11:07.785768+0000","last_peered":"2023-10-16T20:11:07.785768+0000","last_clean":"2023-10-16T20:11:07.785768+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:11:07.785768+0000","last_undegraded":"2023-10-16T20:11:07.785768+0000","last_fullsized":"2023-10-16T20:11:07.785768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.785559+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:29.750005+0000","scrub_duration":0.0038216840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'172","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.248681+0000","last_change":"2023-10-16T20:11:04.248898+0000","last_active":"2023-10-16T20:11:04.248681+0000","last_peered":"2023-10-16T20:11:04.248681+0000","last_clean":"2023-10-16T20:11:04.248681+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:11:04.248681+0000","last_undegraded":"2023-10-16T20:11:04.248681+0000","last_fullsized":"2023-10-16T20:11:04.248681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'172","last_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_deep_scrub":"25'172","last_deep_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.248408+0000","objects_scrubbed":3,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:48.428600+0000","scrub_duration":0.011087784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.182531+0000","last_change":"2023-10-16T20:11:26.182647+0000","last_active":"2023-10-16T20:11:26.182531+0000","last_peered":"2023-10-16T20:11:26.182531+0000","last_clean":"2023-10-16T20:11:26.182531+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:11:26.182531+0000","last_undegraded":"2023-10-16T20:11:26.182531+0000","last_fullsized":"2023-10-16T20:11:26.182531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:26.182366+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:26.182366+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.182366+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:55.197352+0000","scrub_duration":0.003793963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'83","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.419262+0000","last_change":"2023-10-16T20:10:59.419479+0000","last_active":"2023-10-16T20:10:59.419262+0000","last_peered":"2023-10-16T20:10:59.419262+0000","last_clean":"2023-10-16T20:10:59.419262+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:10:59.419262+0000","last_undegraded":"2023-10-16T20:10:59.419262+0000","last_fullsized":"2023-10-16T20:10:59.419262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.419026+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:10.718293+0000","scrub_duration":0.0094841230000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.062378+0000","last_change":"2023-10-16T20:11:05.062502+0000","last_active":"2023-10-16T20:11:05.062378+0000","last_peered":"2023-10-16T20:11:05.062378+0000","last_clean":"2023-10-16T20:11:05.062378+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:11:05.062378+0000","last_undegraded":"2023-10-16T20:11:05.062378+0000","last_fullsized":"2023-10-16T20:11:05.062378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'95","last_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_deep_scrub":"25'95","last_deep_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.062206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:49.242398+0000","scrub_duration":0.0047295150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'87","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.090482+0000","last_change":"2023-10-16T20:10:57.090726+0000","last_active":"2023-10-16T20:10:57.090482+0000","last_peered":"2023-10-16T20:10:57.090482+0000","last_clean":"2023-10-16T20:10:57.090482+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:57.090482+0000","last_undegraded":"2023-10-16T20:10:57.090482+0000","last_fullsized":"2023-10-16T20:10:57.090482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.090239+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:45.060366+0000","scrub_duration":0.010685826000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.425093+0000","last_change":"2023-10-16T20:11:07.425093+0000","last_active":"2023-10-16T20:11:07.425093+0000","last_peered":"2023-10-16T20:11:07.425093+0000","last_clean":"2023-10-16T20:11:07.425093+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:11:07.425093+0000","last_undegraded":"2023-10-16T20:11:07.425093+0000","last_fullsized":"2023-10-16T20:11:07.425093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.424696+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:09:24.485886+0000","scrub_duration":0.0038308159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1232","reported_seq":1271,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.345878+0000","last_change":"2023-10-16T20:11:05.345878+0000","last_active":"2023-10-16T20:11:05.345878+0000","last_peered":"2023-10-16T20:11:05.345878+0000","last_clean":"2023-10-16T20:11:05.345878+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:11:05.345878+0000","last_undegraded":"2023-10-16T20:11:05.345878+0000","last_fullsized":"2023-10-16T20:11:05.345878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1232","last_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_deep_scrub":"25'1232","last_deep_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.345578+0000","objects_scrubbed":6,"log_size":1232,"log_dups_size":0,"ondisk_log_size":1232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:26:15.503390+0000","scrub_duration":0.062660380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:29.232032+0000","last_change":"2023-10-16T20:11:29.232217+0000","last_active":"2023-10-16T20:11:29.232032+0000","last_peered":"2023-10-16T20:11:29.232032+0000","last_clean":"2023-10-16T20:11:29.232032+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:11:29.232032+0000","last_undegraded":"2023-10-16T20:11:29.232032+0000","last_fullsized":"2023-10-16T20:11:29.232032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:11:29.231761+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:11:29.231761+0000","last_clean_scrub_stamp":"2023-10-16T20:11:29.231761+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:21:56.521637+0000","scrub_duration":0.0044564460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'123","reported_seq":264,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.225726+0000","last_change":"2023-10-16T20:10:52.225726+0000","last_active":"2023-10-16T20:10:52.225726+0000","last_peered":"2023-10-16T20:10:52.225726+0000","last_clean":"2023-10-16T20:10:52.225726+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:52.225726+0000","last_undegraded":"2023-10-16T20:10:52.225726+0000","last_fullsized":"2023-10-16T20:10:52.225726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'123","last_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_deep_scrub":"25'123","last_deep_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.225528+0000","objects_scrubbed":7,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:59.684729+0000","scrub_duration":0.012038705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.015002+0000","last_change":"2023-10-16T20:11:26.015214+0000","last_active":"2023-10-16T20:11:26.015002+0000","last_peered":"2023-10-16T20:11:26.015002+0000","last_clean":"2023-10-16T20:11:26.015002+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:11:26.015002+0000","last_undegraded":"2023-10-16T20:11:26.015002+0000","last_fullsized":"2023-10-16T20:11:26.015002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:26.014810+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:26.014810+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.014810+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:58.547915+0000","scrub_duration":0.0042904199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'97","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.447251+0000","last_change":"2023-10-16T20:11:04.447251+0000","last_active":"2023-10-16T20:11:04.447251+0000","last_peered":"2023-10-16T20:11:04.447251+0000","last_clean":"2023-10-16T20:11:04.447251+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:11:04.447251+0000","last_undegraded":"2023-10-16T20:11:04.447251+0000","last_fullsized":"2023-10-16T20:11:04.447251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.446964+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:34.698139+0000","scrub_duration":0.0098213269999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:28.230089+0000","last_change":"2023-10-16T20:11:28.230205+0000","last_active":"2023-10-16T20:11:28.230089+0000","last_peered":"2023-10-16T20:11:28.230089+0000","last_clean":"2023-10-16T20:11:28.230089+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:11:28.230089+0000","last_undegraded":"2023-10-16T20:11:28.230089+0000","last_fullsized":"2023-10-16T20:11:28.230089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:28.229902+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:28.229902+0000","last_clean_scrub_stamp":"2023-10-16T20:11:28.229902+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:15.264662+0000","scrub_duration":0.0046017439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'917","reported_seq":956,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.216412+0000","last_change":"2023-10-16T20:11:00.216412+0000","last_active":"2023-10-16T20:11:00.216412+0000","last_peered":"2023-10-16T20:11:00.216412+0000","last_clean":"2023-10-16T20:11:00.216412+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:11:00.216412+0000","last_undegraded":"2023-10-16T20:11:00.216412+0000","last_fullsized":"2023-10-16T20:11:00.216412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'917","last_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_deep_scrub":"25'917","last_deep_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.216120+0000","objects_scrubbed":3,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:40.966640+0000","scrub_duration":0.039363331000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:19.261823+0000","last_change":"2023-10-16T20:11:19.261823+0000","last_active":"2023-10-16T20:11:19.261823+0000","last_peered":"2023-10-16T20:11:19.261823+0000","last_clean":"2023-10-16T20:11:19.261823+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:11:19.261823+0000","last_undegraded":"2023-10-16T20:11:19.261823+0000","last_fullsized":"2023-10-16T20:11:19.261823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:19.261537+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:19.261537+0000","last_clean_scrub_stamp":"2023-10-16T20:11:19.261537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:56.793193+0000","scrub_duration":0.003903255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'120","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:48.805896+0000","last_change":"2023-10-16T20:10:48.805896+0000","last_active":"2023-10-16T20:10:48.805896+0000","last_peered":"2023-10-16T20:10:48.805896+0000","last_clean":"2023-10-16T20:10:48.805896+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:10:48.805896+0000","last_undegraded":"2023-10-16T20:10:48.805896+0000","last_fullsized":"2023-10-16T20:10:48.805896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'120","last_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_deep_scrub":"25'120","last_deep_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_clean_scrub_stamp":"2023-10-16T20:10:48.805692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:38:07.417459+0000","scrub_duration":0.014508691000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.194070+0000","last_change":"2023-10-16T20:10:57.194070+0000","last_active":"2023-10-16T20:10:57.194070+0000","last_peered":"2023-10-16T20:10:57.194070+0000","last_clean":"2023-10-16T20:10:57.194070+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:57.194070+0000","last_undegraded":"2023-10-16T20:10:57.194070+0000","last_fullsized":"2023-10-16T20:10:57.194070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.193654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:57:44.185542+0000","scrub_duration":0.004328302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'193","reported_seq":232,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.308786+0000","last_change":"2023-10-16T20:10:52.308932+0000","last_active":"2023-10-16T20:10:52.308786+0000","last_peered":"2023-10-16T20:10:52.308786+0000","last_clean":"2023-10-16T20:10:52.308786+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:52.308786+0000","last_undegraded":"2023-10-16T20:10:52.308786+0000","last_fullsized":"2023-10-16T20:10:52.308786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.308606+0000","objects_scrubbed":2,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:05:12.902639+0000","scrub_duration":0.0076596310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:39.236016+0000","last_change":"2023-10-16T20:11:39.236136+0000","last_active":"2023-10-16T20:11:39.236016+0000","last_peered":"2023-10-16T20:11:39.236016+0000","last_clean":"2023-10-16T20:11:39.236016+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:11:39.236016+0000","last_undegraded":"2023-10-16T20:11:39.236016+0000","last_fullsized":"2023-10-16T20:11:39.236016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2023-10-16T20:11:39.235819+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2023-10-16T20:11:39.235819+0000","last_clean_scrub_stamp":"2023-10-16T20:11:39.235819+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:29:32.443252+0000","scrub_duration":0.0035110179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'11","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:49.778351+0000","last_change":"2023-10-16T20:10:49.778439+0000","last_active":"2023-10-16T20:10:49.778351+0000","last_peered":"2023-10-16T20:10:49.778351+0000","last_clean":"2023-10-16T20:10:49.778351+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:49.778351+0000","last_undegraded":"2023-10-16T20:10:49.778351+0000","last_fullsized":"2023-10-16T20:10:49.778351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_clean_scrub_stamp":"2023-10-16T20:10:49.778235+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:34:46.159193+0000","scrub_duration":0.0051660639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:45.366092+0000","last_change":"2023-10-16T20:11:45.366206+0000","last_active":"2023-10-16T20:11:45.366092+0000","last_peered":"2023-10-16T20:11:45.366092+0000","last_clean":"2023-10-16T20:11:45.366092+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:11:45.366092+0000","last_undegraded":"2023-10-16T20:11:45.366092+0000","last_fullsized":"2023-10-16T20:11:45.366092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2023-10-16T20:11:45.365889+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2023-10-16T20:11:45.365889+0000","last_clean_scrub_stamp":"2023-10-16T20:11:45.365889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:00.158334+0000","scrub_duration":0.0037913030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'7","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:01.947796+0000","last_change":"2023-10-16T20:11:01.947921+0000","last_active":"2023-10-16T20:11:01.947796+0000","last_peered":"2023-10-16T20:11:01.947796+0000","last_clean":"2023-10-16T20:11:01.947796+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:11:01.947796+0000","last_undegraded":"2023-10-16T20:11:01.947796+0000","last_fullsized":"2023-10-16T20:11:01.947796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_clean_scrub_stamp":"2023-10-16T20:11:01.947627+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:38.925238+0000","scrub_duration":0.0085375859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.755300+0000","last_change":"2023-10-16T20:11:04.755418+0000","last_active":"2023-10-16T20:11:04.755300+0000","last_peered":"2023-10-16T20:11:04.755300+0000","last_clean":"2023-10-16T20:11:04.755300+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:11:04.755300+0000","last_undegraded":"2023-10-16T20:11:04.755300+0000","last_fullsized":"2023-10-16T20:11:04.755300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.755134+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:21.886819+0000","scrub_duration":0.0038213980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'595","reported_seq":634,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.839482+0000","last_change":"2023-10-16T20:10:50.839718+0000","last_active":"2023-10-16T20:10:50.839482+0000","last_peered":"2023-10-16T20:10:50.839482+0000","last_clean":"2023-10-16T20:10:50.839482+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:50.839482+0000","last_undegraded":"2023-10-16T20:10:50.839482+0000","last_fullsized":"2023-10-16T20:10:50.839482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'595","last_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_deep_scrub":"25'595","last_deep_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.839312+0000","objects_scrubbed":3,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:26.515689+0000","scrub_duration":0.036436172000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:52.334386+0000","last_change":"2023-10-16T20:11:52.334500+0000","last_active":"2023-10-16T20:11:52.334386+0000","last_peered":"2023-10-16T20:11:52.334386+0000","last_clean":"2023-10-16T20:11:52.334386+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:11:52.334386+0000","last_undegraded":"2023-10-16T20:11:52.334386+0000","last_fullsized":"2023-10-16T20:11:52.334386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:52.334208+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:52.334208+0000","last_clean_scrub_stamp":"2023-10-16T20:11:52.334208+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:09.151360+0000","scrub_duration":0.0044015089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.197315+0000","last_change":"2023-10-16T20:10:59.197457+0000","last_active":"2023-10-16T20:10:59.197315+0000","last_peered":"2023-10-16T20:10:59.197315+0000","last_clean":"2023-10-16T20:10:59.197315+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:10:59.197315+0000","last_undegraded":"2023-10-16T20:10:59.197315+0000","last_fullsized":"2023-10-16T20:10:59.197315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.197159+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:04.377504+0000","scrub_duration":0.013745998000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'11","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.405936+0000","last_change":"2023-10-16T20:11:03.406084+0000","last_active":"2023-10-16T20:11:03.405936+0000","last_peered":"2023-10-16T20:11:03.405936+0000","last_clean":"2023-10-16T20:11:03.405936+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:11:03.405936+0000","last_undegraded":"2023-10-16T20:11:03.405936+0000","last_fullsized":"2023-10-16T20:11:03.405936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.405741+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:50.381384+0000","scrub_duration":0.012053975999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.643028+0000","last_change":"2023-10-16T20:11:00.643141+0000","last_active":"2023-10-16T20:11:00.643028+0000","last_peered":"2023-10-16T20:11:00.643028+0000","last_clean":"2023-10-16T20:11:00.643028+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:11:00.643028+0000","last_undegraded":"2023-10-16T20:11:00.643028+0000","last_fullsized":"2023-10-16T20:11:00.643028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.642786+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:29.373362+0000","scrub_duration":0.004474586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'11","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.224693+0000","last_change":"2023-10-16T20:11:00.224693+0000","last_active":"2023-10-16T20:11:00.224693+0000","last_peered":"2023-10-16T20:11:00.224693+0000","last_clean":"2023-10-16T20:11:00.224693+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:11:00.224693+0000","last_undegraded":"2023-10-16T20:11:00.224693+0000","last_fullsized":"2023-10-16T20:11:00.224693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.224425+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:44.355933+0000","scrub_duration":0.0071850550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.053355+0000","last_change":"2023-10-16T20:11:03.053556+0000","last_active":"2023-10-16T20:11:03.053355+0000","last_peered":"2023-10-16T20:11:03.053355+0000","last_clean":"2023-10-16T20:11:03.053355+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:11:03.053355+0000","last_undegraded":"2023-10-16T20:11:03.053355+0000","last_fullsized":"2023-10-16T20:11:03.053355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.053085+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:18.379749+0000","scrub_duration":0.0044426120000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'182","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.785504+0000","last_change":"2023-10-16T20:10:52.785600+0000","last_active":"2023-10-16T20:10:52.785504+0000","last_peered":"2023-10-16T20:10:52.785504+0000","last_clean":"2023-10-16T20:10:52.785504+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:52.785504+0000","last_undegraded":"2023-10-16T20:10:52.785504+0000","last_fullsized":"2023-10-16T20:10:52.785504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.785411+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:41:36.044719+0000","scrub_duration":0.014410586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.886972+0000","last_change":"2023-10-16T20:11:16.887104+0000","last_active":"2023-10-16T20:11:16.886972+0000","last_peered":"2023-10-16T20:11:16.886972+0000","last_clean":"2023-10-16T20:11:16.886972+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:11:16.886972+0000","last_undegraded":"2023-10-16T20:11:16.886972+0000","last_fullsized":"2023-10-16T20:11:16.886972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:16.886795+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:16.886795+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.886795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:43.385781+0000","scrub_duration":0.0037474850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'441","reported_seq":481,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.423359+0000","last_change":"2023-10-16T20:11:05.423502+0000","last_active":"2023-10-16T20:11:05.423359+0000","last_peered":"2023-10-16T20:11:05.423359+0000","last_clean":"2023-10-16T20:11:05.423359+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:11:05.423359+0000","last_undegraded":"2023-10-16T20:11:05.423359+0000","last_fullsized":"2023-10-16T20:11:05.423359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'441","last_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_deep_scrub":"25'441","last_deep_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.423201+0000","objects_scrubbed":2,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.561417+0000","scrub_duration":0.028676314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.313204+0000","last_change":"2023-10-16T20:11:03.313319+0000","last_active":"2023-10-16T20:11:03.313204+0000","last_peered":"2023-10-16T20:11:03.313204+0000","last_clean":"2023-10-16T20:11:03.313204+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:11:03.313204+0000","last_undegraded":"2023-10-16T20:11:03.313204+0000","last_fullsized":"2023-10-16T20:11:03.313204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'88","last_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_deep_scrub":"25'88","last_deep_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.313054+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:27:31.752491+0000","scrub_duration":0.0037970629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.099941+0000","last_change":"2023-10-16T20:10:51.100008+0000","last_active":"2023-10-16T20:10:51.099941+0000","last_peered":"2023-10-16T20:10:51.099941+0000","last_clean":"2023-10-16T20:10:51.099941+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:51.099941+0000","last_undegraded":"2023-10-16T20:10:51.099941+0000","last_fullsized":"2023-10-16T20:10:51.099941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.099844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:15:33.686104+0000","scrub_duration":0.0037505049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.251613+0000","last_change":"2023-10-16T20:11:16.251822+0000","last_active":"2023-10-16T20:11:16.251613+0000","last_peered":"2023-10-16T20:11:16.251613+0000","last_clean":"2023-10-16T20:11:16.251613+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:11:16.251613+0000","last_undegraded":"2023-10-16T20:11:16.251613+0000","last_fullsized":"2023-10-16T20:11:16.251613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:16.251413+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:16.251413+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.251413+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:59.624160+0000","scrub_duration":0.0040611930000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.227417+0000","last_change":"2023-10-16T20:11:26.227552+0000","last_active":"2023-10-16T20:11:26.227417+0000","last_peered":"2023-10-16T20:11:26.227417+0000","last_clean":"2023-10-16T20:11:26.227417+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:11:26.227417+0000","last_undegraded":"2023-10-16T20:11:26.227417+0000","last_fullsized":"2023-10-16T20:11:26.227417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:26.227263+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:26.227263+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.227263+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:38:19.565166+0000","scrub_duration":0.010291702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.916838+0000","last_change":"2023-10-16T20:11:02.916971+0000","last_active":"2023-10-16T20:11:02.916838+0000","last_peered":"2023-10-16T20:11:02.916838+0000","last_clean":"2023-10-16T20:11:02.916838+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:11:02.916838+0000","last_undegraded":"2023-10-16T20:11:02.916838+0000","last_fullsized":"2023-10-16T20:11:02.916838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.916667+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:00.488332+0000","scrub_duration":0.004083677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'182","reported_seq":222,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.058213+0000","last_change":"2023-10-16T20:10:58.058213+0000","last_active":"2023-10-16T20:10:58.058213+0000","last_peered":"2023-10-16T20:10:58.058213+0000","last_clean":"2023-10-16T20:10:58.058213+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:58.058213+0000","last_undegraded":"2023-10-16T20:10:58.058213+0000","last_fullsized":"2023-10-16T20:10:58.058213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.057907+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:35.465191+0000","scrub_duration":0.0099141170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.714234+0000","last_change":"2023-10-16T20:11:05.714234+0000","last_active":"2023-10-16T20:11:05.714234+0000","last_peered":"2023-10-16T20:11:05.714234+0000","last_clean":"2023-10-16T20:11:05.714234+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:11:05.714234+0000","last_undegraded":"2023-10-16T20:11:05.714234+0000","last_fullsized":"2023-10-16T20:11:05.714234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.713860+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:42.363819+0000","scrub_duration":0.0043101069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'19","reported_seq":59,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.204431+0000","last_change":"2023-10-16T20:11:02.204431+0000","last_active":"2023-10-16T20:11:02.204431+0000","last_peered":"2023-10-16T20:11:02.204431+0000","last_clean":"2023-10-16T20:11:02.204431+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:11:02.204431+0000","last_undegraded":"2023-10-16T20:11:02.204431+0000","last_fullsized":"2023-10-16T20:11:02.204431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.204019+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:43.393039+0000","scrub_duration":0.010984687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:17.119707+0000","last_change":"2023-10-16T20:11:17.119707+0000","last_active":"2023-10-16T20:11:17.119707+0000","last_peered":"2023-10-16T20:11:17.119707+0000","last_clean":"2023-10-16T20:11:17.119707+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:11:17.119707+0000","last_undegraded":"2023-10-16T20:11:17.119707+0000","last_fullsized":"2023-10-16T20:11:17.119707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'48","last_scrub_stamp":"2023-10-16T20:11:17.119304+0000","last_deep_scrub":"25'48","last_deep_scrub_stamp":"2023-10-16T20:11:17.119304+0000","last_clean_scrub_stamp":"2023-10-16T20:11:17.119304+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:04.111192+0000","scrub_duration":0.0037991639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'7","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.299518+0000","last_change":"2023-10-16T20:11:09.299518+0000","last_active":"2023-10-16T20:11:09.299518+0000","last_peered":"2023-10-16T20:11:09.299518+0000","last_clean":"2023-10-16T20:11:09.299518+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:11:09.299518+0000","last_undegraded":"2023-10-16T20:11:09.299518+0000","last_fullsized":"2023-10-16T20:11:09.299518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.299250+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:50.359476+0000","scrub_duration":0.0074289619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.434160+0000","last_change":"2023-10-16T20:10:57.434160+0000","last_active":"2023-10-16T20:10:57.434160+0000","last_peered":"2023-10-16T20:10:57.434160+0000","last_clean":"2023-10-16T20:10:57.434160+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:57.434160+0000","last_undegraded":"2023-10-16T20:10:57.434160+0000","last_fullsized":"2023-10-16T20:10:57.434160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.433829+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:14.317205+0000","scrub_duration":0.0042212430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'178","reported_seq":218,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:47.079655+0000","last_change":"2023-10-16T20:10:47.079655+0000","last_active":"2023-10-16T20:10:47.079655+0000","last_peered":"2023-10-16T20:10:47.079655+0000","last_clean":"2023-10-16T20:10:47.079655+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:47.079655+0000","last_undegraded":"2023-10-16T20:10:47.079655+0000","last_fullsized":"2023-10-16T20:10:47.079655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_clean_scrub_stamp":"2023-10-16T20:10:47.079299+0000","objects_scrubbed":4,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:58.646035+0000","scrub_duration":0.012090556000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:20.688314+0000","last_change":"2023-10-16T20:11:20.688314+0000","last_active":"2023-10-16T20:11:20.688314+0000","last_peered":"2023-10-16T20:11:20.688314+0000","last_clean":"2023-10-16T20:11:20.688314+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:11:20.688314+0000","last_undegraded":"2023-10-16T20:11:20.688314+0000","last_fullsized":"2023-10-16T20:11:20.688314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2023-10-16T20:11:20.688032+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2023-10-16T20:11:20.688032+0000","last_clean_scrub_stamp":"2023-10-16T20:11:20.688032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:52.001332+0000","scrub_duration":0.0039269320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'429","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.061870+0000","last_change":"2023-10-16T20:10:50.061870+0000","last_active":"2023-10-16T20:10:50.061870+0000","last_peered":"2023-10-16T20:10:50.061870+0000","last_clean":"2023-10-16T20:10:50.061870+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:50.061870+0000","last_undegraded":"2023-10-16T20:10:50.061870+0000","last_fullsized":"2023-10-16T20:10:50.061870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.061747+0000","objects_scrubbed":2,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:43.780025+0000","scrub_duration":0.007646229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.684325+0000","last_change":"2023-10-16T20:11:18.684441+0000","last_active":"2023-10-16T20:11:18.684325+0000","last_peered":"2023-10-16T20:11:18.684325+0000","last_clean":"2023-10-16T20:11:18.684325+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:11:18.684325+0000","last_undegraded":"2023-10-16T20:11:18.684325+0000","last_fullsized":"2023-10-16T20:11:18.684325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:11:18.684142+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:11:18.684142+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.684142+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:25.921862+0000","scrub_duration":0.003750738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'14","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.287527+0000","last_change":"2023-10-16T20:11:12.287646+0000","last_active":"2023-10-16T20:11:12.287527+0000","last_peered":"2023-10-16T20:11:12.287527+0000","last_clean":"2023-10-16T20:11:12.287527+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:11:12.287527+0000","last_undegraded":"2023-10-16T20:11:12.287527+0000","last_fullsized":"2023-10-16T20:11:12.287527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'14","last_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_deep_scrub":"25'14","last_deep_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.287330+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:43.600630+0000","scrub_duration":0.0075854269999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.282147+0000","last_change":"2023-10-16T20:11:09.282147+0000","last_active":"2023-10-16T20:11:09.282147+0000","last_peered":"2023-10-16T20:11:09.282147+0000","last_clean":"2023-10-16T20:11:09.282147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:11:09.282147+0000","last_undegraded":"2023-10-16T20:11:09.282147+0000","last_fullsized":"2023-10-16T20:11:09.282147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.281641+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:34.393175+0000","scrub_duration":0.0045042149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:35.068448+0000","last_change":"2023-10-16T20:11:35.068635+0000","last_active":"2023-10-16T20:11:35.068448+0000","last_peered":"2023-10-16T20:11:35.068448+0000","last_clean":"2023-10-16T20:11:35.068448+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:11:35.068448+0000","last_undegraded":"2023-10-16T20:11:35.068448+0000","last_fullsized":"2023-10-16T20:11:35.068448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:35.068212+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:35.068212+0000","last_clean_scrub_stamp":"2023-10-16T20:11:35.068212+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:29.407569+0000","scrub_duration":0.0046133959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'13","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.246697+0000","last_change":"2023-10-16T20:11:22.246759+0000","last_active":"2023-10-16T20:11:22.246697+0000","last_peered":"2023-10-16T20:11:22.246697+0000","last_clean":"2023-10-16T20:11:22.246697+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:11:22.246697+0000","last_undegraded":"2023-10-16T20:11:22.246697+0000","last_fullsized":"2023-10-16T20:11:22.246697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-10-16T20:11:22.246620+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-10-16T20:11:22.246620+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.246620+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:20.946031+0000","scrub_duration":0.010463379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:32.085198+0000","last_change":"2023-10-16T20:11:32.085319+0000","last_active":"2023-10-16T20:11:32.085198+0000","last_peered":"2023-10-16T20:11:32.085198+0000","last_clean":"2023-10-16T20:11:32.085198+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:11:32.085198+0000","last_undegraded":"2023-10-16T20:11:32.085198+0000","last_fullsized":"2023-10-16T20:11:32.085198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:32.085036+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:32.085036+0000","last_clean_scrub_stamp":"2023-10-16T20:11:32.085036+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:19.119797+0000","scrub_duration":0.0038365719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'156","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.267670+0000","last_change":"2023-10-16T20:11:10.267809+0000","last_active":"2023-10-16T20:11:10.267670+0000","last_peered":"2023-10-16T20:11:10.267670+0000","last_clean":"2023-10-16T20:11:10.267670+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:11:10.267670+0000","last_undegraded":"2023-10-16T20:11:10.267670+0000","last_fullsized":"2023-10-16T20:11:10.267670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'156","last_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_deep_scrub":"25'156","last_deep_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.267479+0000","objects_scrubbed":7,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:24.964421+0000","scrub_duration":0.014645241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":135,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.071221+0000","last_change":"2023-10-16T20:11:06.071341+0000","last_active":"2023-10-16T20:11:06.071221+0000","last_peered":"2023-10-16T20:11:06.071221+0000","last_clean":"2023-10-16T20:11:06.071221+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:11:06.071221+0000","last_undegraded":"2023-10-16T20:11:06.071221+0000","last_fullsized":"2023-10-16T20:11:06.071221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.071033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:51:02.947576+0000","scrub_duration":0.0042787709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.791172+0000","last_change":"2023-10-16T20:10:50.791172+0000","last_active":"2023-10-16T20:10:50.791172+0000","last_peered":"2023-10-16T20:10:50.791172+0000","last_clean":"2023-10-16T20:10:50.791172+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:10:50.791172+0000","last_undegraded":"2023-10-16T20:10:50.791172+0000","last_fullsized":"2023-10-16T20:10:50.791172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.790831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:27.440790+0000","scrub_duration":0.0041105270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.684963+0000","last_change":"2023-10-16T20:11:12.685085+0000","last_active":"2023-10-16T20:11:12.684963+0000","last_peered":"2023-10-16T20:11:12.684963+0000","last_clean":"2023-10-16T20:11:12.684963+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:11:12.684963+0000","last_undegraded":"2023-10-16T20:11:12.684963+0000","last_fullsized":"2023-10-16T20:11:12.684963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.684788+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:39.823004+0000","scrub_duration":0.0045610140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:46.154118+0000","last_change":"2023-10-16T20:10:46.154175+0000","last_active":"2023-10-16T20:10:46.154118+0000","last_peered":"2023-10-16T20:10:46.154118+0000","last_clean":"2023-10-16T20:10:46.154118+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:46.154118+0000","last_undegraded":"2023-10-16T20:10:46.154118+0000","last_fullsized":"2023-10-16T20:10:46.154118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_clean_scrub_stamp":"2023-10-16T20:10:46.154049+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:41:39.554198+0000","scrub_duration":0.0087997690000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":8007,"ondisk_log_size":8007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509819,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2,"15min":1.169},"min":{"1min":0.73999999999999999,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.5860000000000001,"5min":2.0569999999999999,"15min":2.085},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1879999999999999,"15min":1.2749999999999999},"min":{"1min":0.81699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.649,"5min":1.905,"15min":2.1520000000000001},"last":1.554}]},{"osd":1,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.23,"15min":1.2350000000000001},"min":{"1min":0.77700000000000002,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.75,"5min":1.996,"15min":2.3050000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.94699999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.698,"5min":1.8320000000000001,"15min":2.27},"last":1.667}]},{"osd":2,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.3129999999999999},"min":{"1min":0.75700000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9490000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.327},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.375,"15min":1.4079999999999999},"min":{"1min":1.0389999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.774,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.157}]},{"osd":3,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3460000000000001,"15min":1.4099999999999999},"min":{"1min":1.0349999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8109999999999999,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.444},{"interface":"front","average":{"1min":1.411,"5min":1.4590000000000001,"15min":1.498},"min":{"1min":0.90000000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.696,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.516}]},{"osd":4,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.85899999999999999,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":2.375},"last":1.823},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.367,"15min":1.401},"min":{"1min":0.95799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1859999999999999,"5min":2.298,"15min":2.5459999999999998},"last":1.613}]},{"osd":5,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4670000000000001,"15min":1.456},"min":{"1min":1.0009999999999999,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.7490000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.48,"15min":1.5109999999999999},"min":{"1min":1.1000000000000001,"5min":0.72899999999999998,"15min":0.56499999999999995},"max":{"1min":1.821,"5min":2.2490000000000001,"15min":2.4750000000000001},"last":1.752}]},{"osd":6,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.579,"15min":1.5940000000000001},"min":{"1min":1.1279999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.869,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.986},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5109999999999999,"15min":1.5640000000000001},"min":{"1min":0.96599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.0779999999999998,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.7130000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509819,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.68500000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":2.0409999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.335,"5min":1.2949999999999999,"15min":1.2769999999999999},"min":{"1min":0.91700000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0110000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.3120000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.202,"15min":1.2390000000000001},"min":{"1min":0.72499999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.504,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.331,"15min":1.345},"min":{"1min":0.94899999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.956,"5min":2.2069999999999999,"15min":2.2349999999999999},"last":1.155}]},{"osd":2,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.871,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7110000000000001,"5min":2.3180000000000001,"15min":2.367},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3540000000000001,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.887,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.226}]},{"osd":3,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.444,"15min":1.476},"min":{"1min":0.89500000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.758,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.024},{"interface":"front","average":{"1min":1.375,"5min":1.417,"15min":1.45},"min":{"1min":1.113,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":1.609,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.514}]},{"osd":4,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.379,"15min":1.357},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.8899999999999999,"5min":3.415,"15min":3.415},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.125}]},{"osd":5,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4039999999999999,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":1.9059999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.647},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.575,"15min":1.554},"min":{"1min":0.877,"5min":0.877,"15min":0.68300000000000005},"max":{"1min":1.9510000000000001,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.617}]},{"osd":7,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5580000000000001,"15min":1.5700000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":3.145,"15min":3.145},"last":1.548},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.603,"15min":1.5840000000000001},"min":{"1min":1.3120000000000001,"5min":1.044,"15min":0.98799999999999999},"max":{"1min":1.883,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.4119999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509820,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.179,"15min":1.2110000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.677,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.206,"15min":1.2669999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7350000000000001,"5min":1.929,"15min":2.3839999999999999},"last":1.165}]},{"osd":1,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3240000000000001,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.827,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.466},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.323,"15min":1.345},"min":{"1min":0.84899999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8420000000000001,"5min":2.677,"15min":2.677},"last":0.89800000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.339,"15min":1.3360000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4710000000000001,"5min":2.0569999999999999,"15min":2.177},"last":1.373},{"interface":"front","average":{"1min":1.29,"5min":1.423,"15min":1.448},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.1899999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.093}]},{"osd":3,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4139999999999999,"15min":1.45},"min":{"1min":0.98099999999999998,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.724,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.258},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.5269999999999999,"15min":1.5309999999999999},"min":{"1min":1.1000000000000001,"5min":1.048,"15min":0.86599999999999999},"max":{"1min":1.9730000000000001,"5min":2.71,"15min":2.71},"last":1.2769999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.3540000000000001,"15min":1.339},"min":{"1min":0.86699999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.966,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.22},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":1.0509999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.887,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.3089999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":2.0910000000000002,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.55,"15min":1.512},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.1989999999999998,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.349}]},{"osd":7,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.571,"15min":1.593},"min":{"1min":1.2569999999999999,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":2.0329999999999999,"5min":2.4489999999999998,"15min":2.7629999999999999},"last":1.891},{"interface":"front","average":{"1min":1.641,"5min":1.6799999999999999,"15min":1.6639999999999999},"min":{"1min":1.2190000000000001,"5min":1.097,"15min":0.98199999999999998},"max":{"1min":2.29,"5min":2.5979999999999999,"15min":2.867},"last":1.5549999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509819,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0900000000000001,"15min":1.1739999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.444,"5min":2.2410000000000001,"15min":2.5800000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.147,"15min":1.2549999999999999},"min":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.587,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":1.611}]},{"osd":1,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.266,"15min":1.345},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.44500000000000001},"max":{"1min":1.393,"5min":2.964,"15min":2.964},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.5129999999999999,"15min":1.5600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.6990000000000001,"5min":3.056,"15min":3.1779999999999999},"last":1.3819999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.522,"15min":1.6499999999999999},"min":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.52700000000000002},"max":{"1min":1.929,"5min":2.996,"15min":3.5310000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.6020000000000001,"15min":1.718},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1139999999999999,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":1.508}]},{"osd":4,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.452,"15min":1.5429999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6200000000000001,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.5620000000000001,"15min":1.6359999999999999},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":1.996,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.1930000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.625,"15min":1.7270000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0169999999999999,"5min":3.52,"15min":3.52},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.595,"15min":1.6639999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.64600000000000002},"max":{"1min":1.8460000000000001,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.4650000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.712,"15min":1.7789999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.72199999999999998},"max":{"1min":2.0179999999999998,"5min":2.9860000000000002,"15min":3.1000000000000001},"last":1.341},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.736,"15min":1.849},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.85799999999999998},"max":{"1min":2.1240000000000001,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.6479999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.7190000000000001,"15min":1.8009999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.75},"max":{"1min":1.958,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.8600000000000001,"15min":1.917},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":0.66800000000000004},"max":{"1min":2.1179999999999999,"5min":2.8380000000000001,"15min":3.2330000000000001},"last":1.5580000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.034,"15min":1.0680000000000001},"min":{"1min":0.71499999999999997,"5min":0.437,"15min":0.437},"max":{"1min":1.47,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.879},{"interface":"front","average":{"1min":1.181,"5min":1.3169999999999999,"15min":1.3740000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.9319999999999999,"5min":3.1179999999999999,"15min":3.702},"last":1.0369999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.407,"15min":1.4490000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.744,"5min":2.4889999999999999,"15min":2.738},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.542},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9710000000000001,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.2769999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.528,"15min":1.55},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.853,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.633,"15min":1.696},"min":{"1min":1.0389999999999999,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":1.7849999999999999,"5min":2.734,"15min":2.9420000000000002},"last":1.5409999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.605,"15min":1.6459999999999999},"min":{"1min":1.175,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.915,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.7549999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.603,"15min":1.643},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.1640000000000001,"5min":2.363,"15min":3.54},"last":2.044}]},{"osd":5,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.647,"15min":1.627},"min":{"1min":1.002,"5min":1.002,"15min":0.71199999999999997},"max":{"1min":1.7350000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.7010000000000001,"15min":1.76},"min":{"1min":1.2989999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.004,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.827}]},{"osd":6,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.75,"15min":1.8},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.3069999999999999,"5min":2.6070000000000002,"15min":3.6259999999999999},"last":2.2959999999999998},{"interface":"front","average":{"1min":1.506,"5min":1.7390000000000001,"15min":1.762},"min":{"1min":1.135,"5min":1.135,"15min":0.877},"max":{"1min":1.9790000000000001,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.8600000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.798,"15min":1.8740000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.3839999999999999,"5min":2.6829999999999998,"15min":3.7839999999999998},"last":2.1840000000000002},{"interface":"front","average":{"1min":1.613,"5min":1.8220000000000001,"15min":1.8580000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.89200000000000002},"max":{"1min":2.052,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.804}]}]},{"osd":0,"up_from":15,"seq":64424509820,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0529999999999999,"15min":1.1259999999999999},"min":{"1min":0.72099999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.843,"5min":2.012,"15min":3.1960000000000002},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.319,"15min":1.3720000000000001},"min":{"1min":0.78100000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.452,"5min":2.7789999999999999,"15min":2.9929999999999999},"last":1.5580000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3009999999999999,"15min":1.4790000000000001},"min":{"1min":0.83099999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.825,"5min":2.27,"15min":2.8359999999999999},"last":1.806},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.468,"15min":1.556},"min":{"1min":0.92500000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0049999999999999,"5min":2.8769999999999998,"15min":3.3450000000000002},"last":1.087}]},{"osd":3,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.3360000000000001,"15min":1.5569999999999999},"min":{"1min":0.61499999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.627,"5min":2.3599999999999999,"15min":4.6660000000000004},"last":1.881},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.5980000000000001,"15min":1.7729999999999999},"min":{"1min":1.113,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":1.895,"5min":2.6850000000000001,"15min":3.2829999999999999},"last":2.0470000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.5329999999999999,"15min":1.657},"min":{"1min":1.165,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.7889999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.9990000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.6319999999999999,"15min":1.7},"min":{"1min":1.1970000000000001,"5min":0.89200000000000002,"15min":0.79700000000000004},"max":{"1min":1.8160000000000001,"5min":2.544,"15min":3.1890000000000001},"last":1.6950000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.665,"15min":1.7250000000000001},"min":{"1min":1.2769999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.048,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.6200000000000001,"15min":1.7450000000000001},"min":{"1min":1.208,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9410000000000001,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.611}]},{"osd":6,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.7390000000000001,"15min":1.843},"min":{"1min":1.254,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0680000000000001,"5min":2.8290000000000002,"15min":3.399},"last":1.927},{"interface":"front","average":{"1min":1.613,"5min":1.7709999999999999,"15min":1.831},"min":{"1min":1.2070000000000001,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":2.1339999999999999,"5min":3.0649999999999999,"15min":3.46},"last":1.7450000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.8580000000000001,"15min":1.9450000000000001},"min":{"1min":1.129,"5min":1.129,"15min":1.1000000000000001},"max":{"1min":2.1920000000000002,"5min":3.21,"15min":3.6160000000000001},"last":1.847},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.7529999999999999,"15min":1.8819999999999999},"min":{"1min":1.456,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0529999999999999,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.778}]}]},{"osd":4,"up_from":14,"seq":60129542523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.1970000000000001},"min":{"1min":0.83099999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.8120000000000001,"5min":1.972,"15min":2.5649999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3100000000000001},"min":{"1min":0.80000000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.5800000000000001,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.0620000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.389,"15min":1.343},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9390000000000001,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.421,"15min":1.3640000000000001},"min":{"1min":0.82999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.728,"5min":17.715,"15min":17.715},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4059999999999999,"15min":1.405},"min":{"1min":1.0820000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8520000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.3540000000000001,"15min":1.375},"min":{"1min":0.99099999999999999,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.7390000000000001,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.153}]},{"osd":3,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.472,"15min":1.468},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8129999999999999,"5min":8.2469999999999999,"15min":8.2469999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5800000000000001,"15min":1.5549999999999999},"min":{"1min":1.2589999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.907,"5min":8.2769999999999992,"15min":8.2769999999999992},"last":0.99199999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.3440000000000001,"15min":1.341},"min":{"1min":0.96599999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.897,"5min":2.0249999999999999,"15min":2.3900000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.5049999999999999,"15min":1.462},"min":{"1min":0.91000000000000003,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":1.8520000000000001,"5min":8.1869999999999994,"15min":8.1869999999999994},"last":0.94699999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.506,"15min":1.462},"min":{"1min":1.097,"5min":1.0429999999999999,"15min":0.76200000000000001},"max":{"1min":1.879,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.5269999999999999,"15min":1.53},"min":{"1min":1.052,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":1.9510000000000001,"5min":2.512,"15min":2.601},"last":1.0289999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.6479999999999999,"15min":1.5920000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.86299999999999999},"max":{"1min":2.0960000000000001,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.212},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.732,"15min":1.665},"min":{"1min":1.446,"5min":1.145,"15min":0.999},"max":{"1min":1.998,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.1879999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.1240000000000001,"15min":1.173},"min":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.373},"max":{"1min":1.3260000000000001,"5min":2.944,"15min":2.944},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1830000000000001,"15min":1.294},"min":{"1min":0.72899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.657,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.248}]},{"osd":2,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.335,"15min":1.395},"min":{"1min":0.81999999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8560000000000001,"5min":2.835,"15min":3.585},"last":1.125},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.484,"15min":1.5660000000000001},"min":{"1min":0.96799999999999997,"5min":0.60899999999999999,"15min":0.59999999999999998},"max":{"1min":1.8680000000000001,"5min":2.6659999999999999,"15min":2.8719999999999999},"last":1.788}]},{"osd":3,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.6240000000000001,"15min":1.6950000000000001},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.63},"max":{"1min":1.9319999999999999,"5min":2.831,"15min":3.3740000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.5149999999999999,"15min":1.5760000000000001},"min":{"1min":0.88800000000000001,"5min":0.53800000000000003,"15min":0.51200000000000001},"max":{"1min":2.0030000000000001,"5min":2.8370000000000002,"15min":3.234},"last":1.716}]},{"osd":4,"last update":"Mon Oct 16 20:11:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":1.03,"5min":0.75800000000000001,"15min":0.71499999999999997},"max":{"1min":1.7629999999999999,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.367},{"interface":"front","average":{"1min":1.478,"5min":1.631,"15min":1.6699999999999999},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":1.8009999999999999,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.6559999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.581,"15min":1.647},"min":{"1min":1.153,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.6499999999999999,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":2.0030000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.679,"15min":1.7370000000000001},"min":{"1min":1.087,"5min":0.96299999999999997,"15min":0.77400000000000002},"max":{"1min":1.804,"5min":3.2170000000000001,"15min":3.819},"last":1.5169999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.722,"15min":1.802},"min":{"1min":1.1879999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.929,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.778,"15min":1.829},"min":{"1min":1.337,"5min":0.878,"15min":0.746},"max":{"1min":2.0600000000000001,"5min":2.698,"15min":3.3210000000000002},"last":1.879}]},{"osd":7,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.7070000000000001,"15min":1.8120000000000001},"min":{"1min":1.254,"5min":0.96199999999999997,"15min":0.95099999999999996},"max":{"1min":1.8109999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":1.835},{"interface":"front","average":{"1min":1.665,"5min":1.869,"15min":1.9419999999999999},"min":{"1min":1.3819999999999999,"5min":1.052,"15min":0.96299999999999997},"max":{"1min":1.952,"5min":3.3239999999999998,"15min":3.923},"last":1.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:11:58.062 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-16T19:40:57.305449+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=10, tm_sec=43, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:58.063 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:12:18.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:12:18.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.299+0000 7fc260305640 1 Processor -- start 2023-10-16T20:12:18.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.299+0000 7fc260305640 1 -- start start 2023-10-16T20:12:18.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.301+0000 7fc260305640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2580ca420 0x7fc2580ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.301+0000 7fc260305640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc25806b4b0 0x7fc258156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.301+0000 7fc260305640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 0x7fc2580c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.301+0000 7fc260305640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580c5320 con 0x7fc25806b4b0 2023-10-16T20:12:18.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.301+0000 7fc260305640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580c4df0 con 0x7fc2580659d0 2023-10-16T20:12:18.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.301+0000 7fc260305640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc258156580 con 0x7fc2580ca420 2023-10-16T20:12:18.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.303+0000 7fc25e8a2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 0x7fc2580c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:18.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.303+0000 7fc25e0a1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2580ca420 0x7fc2580ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:18.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.304+0000 7fc25e8a2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 0x7fc2580c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:53056/0 (socket says 172.21.15.57:53056) 2023-10-16T20:12:18.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.304+0000 7fc25e8a2640 1 -- 172.21.15.57:0/221594799 learned_addr learned my addr 172.21.15.57:0/221594799 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:18.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.310+0000 7fc25e0a1640 1 -- 172.21.15.57:0/221594799 >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 msgr2=0x7fc2580c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.310+0000 7fc25e0a1640 1 --2- 172.21.15.57:0/221594799 >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 0x7fc2580c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.311+0000 7fc25e0a1640 1 -- 172.21.15.57:0/221594799 >> v2:172.21.15.57:3300/0 conn(0x7fc25806b4b0 msgr2=0x7fc258156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.311+0000 7fc25e0a1640 1 --2- 172.21.15.57:0/221594799 >> v2:172.21.15.57:3300/0 conn(0x7fc25806b4b0 0x7fc258156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.311+0000 7fc25e0a1640 1 -- 172.21.15.57:0/221594799 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580c5040 con 0x7fc2580ca420 2023-10-16T20:12:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.311+0000 7fc25e8a2640 1 --2- 172.21.15.57:0/221594799 >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 0x7fc2580c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:12:18.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.316+0000 7fc25e0a1640 1 --2- 172.21.15.57:0/221594799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2580ca420 0x7fc2580ca800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc258066310 tx=0x7fc25402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee98fcc741997f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:18.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.327+0000 7fc25d09f640 1 -- 172.21.15.57:0/221594799 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254031830 con 0x7fc2580ca420 2023-10-16T20:12:18.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.327+0000 7fc25d09f640 1 -- 172.21.15.57:0/221594799 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254031990 con 0x7fc2580ca420 2023-10-16T20:12:18.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.327+0000 7fc25d09f640 1 -- 172.21.15.57:0/221594799 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254031d20 con 0x7fc2580ca420 2023-10-16T20:12:18.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 -- 172.21.15.57:0/221594799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2580ca420 msgr2=0x7fc2580ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:18.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 --2- 172.21.15.57:0/221594799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2580ca420 0x7fc2580ca800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc258066310 tx=0x7fc25402b8d0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 -- 172.21.15.57:0/221594799 shutdown_connections 2023-10-16T20:12:18.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 --2- 172.21.15.57:0/221594799 >> v2:172.21.15.110:3300/0 conn(0x7fc2580659d0 0x7fc2580c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 --2- 172.21.15.57:0/221594799 >> v2:172.21.15.57:3300/0 conn(0x7fc25806b4b0 0x7fc258156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 --2- 172.21.15.57:0/221594799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2580ca420 0x7fc2580ca800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 -- 172.21.15.57:0/221594799 >> 172.21.15.57:0/221594799 conn(0x7fc2580c78d0 msgr2=0x7fc2580c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:18.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 -- 172.21.15.57:0/221594799 shutdown_connections 2023-10-16T20:12:18.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.328+0000 7fc260305640 1 -- 172.21.15.57:0/221594799 wait complete. 2023-10-16T20:12:18.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.331+0000 7fc260305640 1 Processor -- start 2023-10-16T20:12:18.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.331+0000 7fc260305640 1 -- start start 2023-10-16T20:12:18.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.332+0000 7fc260305640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2580659d0 0x7fc258155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.332+0000 7fc260305640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25806b4b0 0x7fc2581f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.332+0000 7fc260305640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2580ca420 0x7fc2581f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.332+0000 7fc260305640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581f15d0 con 0x7fc2580ca420 2023-10-16T20:12:18.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.332+0000 7fc260305640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc258071730 con 0x7fc2580659d0 2023-10-16T20:12:18.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.332+0000 7fc260305640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581eec60 con 0x7fc25806b4b0 2023-10-16T20:12:18.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.333+0000 7fc25e8a2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2580ca420 0x7fc2581f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:18.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.334+0000 7fc25d8a0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25806b4b0 0x7fc2581f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:18.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.334+0000 7fc25d8a0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25806b4b0 0x7fc2581f1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45234/0 (socket says 172.21.15.57:45234) 2023-10-16T20:12:18.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.334+0000 7fc25d8a0640 1 -- 172.21.15.57:0/4116004853 learned_addr learned my addr 172.21.15.57:0/4116004853 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:18.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.336+0000 7fc25e0a1640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2580659d0 0x7fc258155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:18.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.339+0000 7fc25e8a2640 1 -- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25806b4b0 msgr2=0x7fc2581f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:18.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.339+0000 7fc25e8a2640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25806b4b0 0x7fc2581f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.339+0000 7fc25e8a2640 1 -- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2580659d0 msgr2=0x7fc258155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:18.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.339+0000 7fc25e8a2640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2580659d0 0x7fc258155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.340+0000 7fc25e8a2640 1 -- 172.21.15.57:0/4116004853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250009b30 con 0x7fc2580ca420 2023-10-16T20:12:18.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.342+0000 7fc25e8a2640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2580ca420 0x7fc2581f1fa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc25000ef90 tx=0x7fc25000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:18.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.351+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250018070 con 0x7fc2580ca420 2023-10-16T20:12:18.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.351+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25000f040 con 0x7fc2580ca420 2023-10-16T20:12:18.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.351+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000cd40 con 0x7fc2580ca420 2023-10-16T20:12:18.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.351+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc254009400 con 0x7fc2580ca420 2023-10-16T20:12:18.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.352+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2581eef40 con 0x7fc2580ca420 2023-10-16T20:12:18.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.353+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2581f1740 con 0x7fc2580ca420 2023-10-16T20:12:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.695+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc250003990 con 0x7fc2580ca420 2023-10-16T20:12:18.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.697+0000 7fc24effd640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc23c06aef0 0x7fc23c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.698+0000 7fc25e0a1640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc23c06aef0 0x7fc23c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.699+0000 7fc25e0a1640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc23c06aef0 0x7fc23c06d3b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc254036000 tx=0x7fc25403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.737+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc250058e70 con 0x7fc2580ca420 2023-10-16T20:12:18.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.738+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2500551b0 con 0x7fc2580ca420 2023-10-16T20:12:18.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.963+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 --> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc25806af90 con 0x7fc23c06aef0 2023-10-16T20:12:18.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.986+0000 7fc24effd640 1 -- 172.21.15.57:0/4116004853 <== mgr.4104 v2:172.21.15.57:6800/32930157 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289749 (secure 0 0 0) 0x7fc254031b00 con 0x7fc23c06aef0 2023-10-16T20:12:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:12:18.994 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-16T20:12:18.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc23c06aef0 msgr2=0x7fc23c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:18.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc23c06aef0 0x7fc23c06d3b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc254036000 tx=0x7fc25403c040 comp rx=0 tx=0).stop 2023-10-16T20:12:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2580ca420 msgr2=0x7fc2581f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2580ca420 0x7fc2581f1fa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc25000ef90 tx=0x7fc25000c490 comp rx=0 tx=0).stop 2023-10-16T20:12:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 shutdown_connections 2023-10-16T20:12:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fc23c06aef0 0x7fc23c06d3b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2580ca420 0x7fc2581f1fa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25806b4b0 0x7fc2581f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 --2- 172.21.15.57:0/4116004853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2580659d0 0x7fc258155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 >> 172.21.15.57:0/4116004853 conn(0x7fc2580c78d0 msgr2=0x7fc2580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 shutdown_connections 2023-10-16T20:12:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:18.993+0000 7fc260305640 1 -- 172.21.15.57:0/4116004853 wait complete. 2023-10-16T20:12:19.019 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":972,"stamp":"2023-10-16T20:12:18.270665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21660966,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":685,"num_read_kb":691,"num_write":11429,"num_write_kb":277842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12923,"ondisk_log_size":12923,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":362544,"kb_used_data":38192,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754612176,"statfs":{"total":773094113280,"available":772722868224,"internally_reserved":0,"allocated":39108608,"data_stored":44090156,"data_compressed":1904932,"data_compressed_allocated":3211264,"data_compressed_original":9732096,"omap_allocated":12744,"internal_metadata":332058168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004882"},"pg_stats":[{"pgid":"3.3f","version":"25'70","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:40.282749+0000","last_change":"2023-10-16T20:11:40.282749+0000","last_active":"2023-10-16T20:11:40.282749+0000","last_peered":"2023-10-16T20:11:40.282749+0000","last_clean":"2023-10-16T20:11:40.282749+0000","last_became_active":"2023-10-16T19:40:59.208129+0000","last_became_peered":"2023-10-16T19:40:59.208129+0000","last_unstale":"2023-10-16T20:11:40.282749+0000","last_undegraded":"2023-10-16T20:11:40.282749+0000","last_fullsized":"2023-10-16T20:11:40.282749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2023-10-16T20:11:40.282461+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2023-10-16T20:11:40.282461+0000","last_clean_scrub_stamp":"2023-10-16T20:11:40.282461+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:06.022999+0000","scrub_duration":0.0039075719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'84","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.930525+0000","last_change":"2023-10-16T20:11:12.930525+0000","last_active":"2023-10-16T20:11:12.930525+0000","last_peered":"2023-10-16T20:11:12.930525+0000","last_clean":"2023-10-16T20:11:12.930525+0000","last_became_active":"2023-10-16T19:40:59.176407+0000","last_became_peered":"2023-10-16T19:40:59.176407+0000","last_unstale":"2023-10-16T20:11:12.930525+0000","last_undegraded":"2023-10-16T20:11:12.930525+0000","last_fullsized":"2023-10-16T20:11:12.930525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2023-10-16T20:11:12.930105+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2023-10-16T20:11:12.930105+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.930105+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:43:27.862335+0000","scrub_duration":0.0038562230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":3285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'81","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.113207+0000","last_change":"2023-10-16T20:10:58.113207+0000","last_active":"2023-10-16T20:10:58.113207+0000","last_peered":"2023-10-16T20:10:58.113207+0000","last_clean":"2023-10-16T20:10:58.113207+0000","last_became_active":"2023-10-16T19:40:59.181860+0000","last_became_peered":"2023-10-16T19:40:59.181860+0000","last_unstale":"2023-10-16T20:10:58.113207+0000","last_undegraded":"2023-10-16T20:10:58.113207+0000","last_fullsized":"2023-10-16T20:10:58.113207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:58.112934+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.112934+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:56:36.903954+0000","scrub_duration":0.0043098260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'73","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:38.057280+0000","last_change":"2023-10-16T20:11:38.057459+0000","last_active":"2023-10-16T20:11:38.057280+0000","last_peered":"2023-10-16T20:11:38.057280+0000","last_clean":"2023-10-16T20:11:38.057280+0000","last_became_active":"2023-10-16T19:40:59.157338+0000","last_became_peered":"2023-10-16T19:40:59.157338+0000","last_unstale":"2023-10-16T20:11:38.057280+0000","last_undegraded":"2023-10-16T20:11:38.057280+0000","last_fullsized":"2023-10-16T20:11:38.057280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:11:38.057039+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:11:38.057039+0000","last_clean_scrub_stamp":"2023-10-16T20:11:38.057039+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:31:37.576742+0000","scrub_duration":0.0042427519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'66","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:27.225077+0000","last_change":"2023-10-16T20:11:27.225191+0000","last_active":"2023-10-16T20:11:27.225077+0000","last_peered":"2023-10-16T20:11:27.225077+0000","last_clean":"2023-10-16T20:11:27.225077+0000","last_became_active":"2023-10-16T19:40:59.173143+0000","last_became_peered":"2023-10-16T19:40:59.173143+0000","last_unstale":"2023-10-16T20:11:27.225077+0000","last_undegraded":"2023-10-16T20:11:27.225077+0000","last_fullsized":"2023-10-16T20:11:27.225077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:27.224877+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:27.224877+0000","last_clean_scrub_stamp":"2023-10-16T20:11:27.224877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:49.148104+0000","scrub_duration":0.003599349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'55","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:23.213667+0000","last_change":"2023-10-16T20:11:23.213775+0000","last_active":"2023-10-16T20:11:23.213667+0000","last_peered":"2023-10-16T20:11:23.213667+0000","last_clean":"2023-10-16T20:11:23.213667+0000","last_became_active":"2023-10-16T19:40:59.176481+0000","last_became_peered":"2023-10-16T19:40:59.176481+0000","last_unstale":"2023-10-16T20:11:23.213667+0000","last_undegraded":"2023-10-16T20:11:23.213667+0000","last_fullsized":"2023-10-16T20:11:23.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'55","last_scrub_stamp":"2023-10-16T20:11:23.213508+0000","last_deep_scrub":"25'55","last_deep_scrub_stamp":"2023-10-16T20:11:23.213508+0000","last_clean_scrub_stamp":"2023-10-16T20:11:23.213508+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:58:19.674889+0000","scrub_duration":0.003811713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'70","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.181264+0000","last_change":"2023-10-16T20:10:58.181264+0000","last_active":"2023-10-16T20:10:58.181264+0000","last_peered":"2023-10-16T20:10:58.181264+0000","last_clean":"2023-10-16T20:10:58.181264+0000","last_became_active":"2023-10-16T19:40:59.175474+0000","last_became_peered":"2023-10-16T19:40:59.175474+0000","last_unstale":"2023-10-16T20:10:58.181264+0000","last_undegraded":"2023-10-16T20:10:58.181264+0000","last_fullsized":"2023-10-16T20:10:58.181264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2023-10-16T20:10:58.180799+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.180799+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:05.485396+0000","scrub_duration":0.0050881859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'90","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.687494+0000","last_change":"2023-10-16T20:11:15.687583+0000","last_active":"2023-10-16T20:11:15.687494+0000","last_peered":"2023-10-16T20:11:15.687494+0000","last_clean":"2023-10-16T20:11:15.687494+0000","last_became_active":"2023-10-16T19:40:59.162215+0000","last_became_peered":"2023-10-16T19:40:59.162215+0000","last_unstale":"2023-10-16T20:11:15.687494+0000","last_undegraded":"2023-10-16T20:11:15.687494+0000","last_fullsized":"2023-10-16T20:11:15.687494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2023-10-16T20:11:15.687367+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.687367+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:48.220471+0000","scrub_duration":0.003008134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'62","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:58.297598+0000","last_change":"2023-10-16T20:11:58.297721+0000","last_active":"2023-10-16T20:11:58.297598+0000","last_peered":"2023-10-16T20:11:58.297598+0000","last_clean":"2023-10-16T20:11:58.297598+0000","last_became_active":"2023-10-16T19:41:25.495761+0000","last_became_peered":"2023-10-16T19:41:25.495761+0000","last_unstale":"2023-10-16T20:11:58.297598+0000","last_undegraded":"2023-10-16T20:11:58.297598+0000","last_fullsized":"2023-10-16T20:11:58.297598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2023-10-16T20:11:58.297438+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2023-10-16T20:11:58.297438+0000","last_clean_scrub_stamp":"2023-10-16T20:11:58.297438+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:33.971722+0000","scrub_duration":0.0043168319999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'75","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.264046+0000","last_change":"2023-10-16T20:11:26.264157+0000","last_active":"2023-10-16T20:11:26.264046+0000","last_peered":"2023-10-16T20:11:26.264046+0000","last_clean":"2023-10-16T20:11:26.264046+0000","last_became_active":"2023-10-16T19:40:59.211979+0000","last_became_peered":"2023-10-16T19:40:59.211979+0000","last_unstale":"2023-10-16T20:11:26.264046+0000","last_undegraded":"2023-10-16T20:11:26.264046+0000","last_fullsized":"2023-10-16T20:11:26.264046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:26.263830+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:26.263830+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.263830+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:57.577129+0000","scrub_duration":0.0038091370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'76","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.289871+0000","last_change":"2023-10-16T20:11:16.290019+0000","last_active":"2023-10-16T20:11:16.289871+0000","last_peered":"2023-10-16T20:11:16.289871+0000","last_clean":"2023-10-16T20:11:16.289871+0000","last_became_active":"2023-10-16T19:40:59.211840+0000","last_became_peered":"2023-10-16T19:40:59.211840+0000","last_unstale":"2023-10-16T20:11:16.289871+0000","last_undegraded":"2023-10-16T20:11:16.289871+0000","last_fullsized":"2023-10-16T20:11:16.289871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'76","last_scrub_stamp":"2023-10-16T20:11:16.289702+0000","last_deep_scrub":"25'76","last_deep_scrub_stamp":"2023-10-16T20:11:16.289702+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.289702+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:21.470047+0000","scrub_duration":0.0035382479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'64","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:13.447001+0000","last_change":"2023-10-16T20:11:13.447113+0000","last_active":"2023-10-16T20:11:13.447001+0000","last_peered":"2023-10-16T20:11:13.447001+0000","last_clean":"2023-10-16T20:11:13.447001+0000","last_became_active":"2023-10-16T19:40:59.210794+0000","last_became_peered":"2023-10-16T19:40:59.210794+0000","last_unstale":"2023-10-16T20:11:13.447001+0000","last_undegraded":"2023-10-16T20:11:13.447001+0000","last_fullsized":"2023-10-16T20:11:13.447001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2023-10-16T20:11:13.446811+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2023-10-16T20:11:13.446811+0000","last_clean_scrub_stamp":"2023-10-16T20:11:13.446811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:28.423434+0000","scrub_duration":0.003574317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'63","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.714932+0000","last_change":"2023-10-16T20:11:02.715055+0000","last_active":"2023-10-16T20:11:02.714932+0000","last_peered":"2023-10-16T20:11:02.714932+0000","last_clean":"2023-10-16T20:11:02.714932+0000","last_became_active":"2023-10-16T19:40:59.210094+0000","last_became_peered":"2023-10-16T19:40:59.210094+0000","last_unstale":"2023-10-16T20:11:02.714932+0000","last_undegraded":"2023-10-16T20:11:02.714932+0000","last_fullsized":"2023-10-16T20:11:02.714932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2023-10-16T20:11:02.714754+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.714754+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:27.826289+0000","scrub_duration":0.0039065690000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":19,"num_write_kb":2766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:31.943796+0000","last_change":"2023-10-16T20:11:31.944010+0000","last_active":"2023-10-16T20:11:31.943796+0000","last_peered":"2023-10-16T20:11:31.943796+0000","last_clean":"2023-10-16T20:11:31.943796+0000","last_became_active":"2023-10-16T19:40:59.179639+0000","last_became_peered":"2023-10-16T19:40:59.179639+0000","last_unstale":"2023-10-16T20:11:31.943796+0000","last_undegraded":"2023-10-16T20:11:31.943796+0000","last_fullsized":"2023-10-16T20:11:31.943796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:31.943475+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:31.943475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:31.943475+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:13.003702+0000","scrub_duration":0.0042240350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'75","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.843528+0000","last_change":"2023-10-16T20:11:05.843528+0000","last_active":"2023-10-16T20:11:05.843528+0000","last_peered":"2023-10-16T20:11:05.843528+0000","last_clean":"2023-10-16T20:11:05.843528+0000","last_became_active":"2023-10-16T19:40:59.131290+0000","last_became_peered":"2023-10-16T19:40:59.131290+0000","last_unstale":"2023-10-16T20:11:05.843528+0000","last_undegraded":"2023-10-16T20:11:05.843528+0000","last_fullsized":"2023-10-16T20:11:05.843528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:05.843246+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.843246+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:20.298267+0000","scrub_duration":0.0036425199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'78","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:15.257761+0000","last_change":"2023-10-16T20:11:15.257761+0000","last_active":"2023-10-16T20:11:15.257761+0000","last_peered":"2023-10-16T20:11:15.257761+0000","last_clean":"2023-10-16T20:11:15.257761+0000","last_became_active":"2023-10-16T19:40:59.174178+0000","last_became_peered":"2023-10-16T19:40:59.174178+0000","last_unstale":"2023-10-16T20:11:15.257761+0000","last_undegraded":"2023-10-16T20:11:15.257761+0000","last_fullsized":"2023-10-16T20:11:15.257761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:15.257475+0000","last_clean_scrub_stamp":"2023-10-16T20:11:15.257475+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:46.570775+0000","scrub_duration":0.0042286989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'68","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:25.205679+0000","last_change":"2023-10-16T20:11:25.205870+0000","last_active":"2023-10-16T20:11:25.205679+0000","last_peered":"2023-10-16T20:11:25.205679+0000","last_clean":"2023-10-16T20:11:25.205679+0000","last_became_active":"2023-10-16T19:40:59.159564+0000","last_became_peered":"2023-10-16T19:40:59.159564+0000","last_unstale":"2023-10-16T20:11:25.205679+0000","last_undegraded":"2023-10-16T20:11:25.205679+0000","last_fullsized":"2023-10-16T20:11:25.205679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:25.205501+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:25.205501+0000","last_clean_scrub_stamp":"2023-10-16T20:11:25.205501+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:18.398131+0000","scrub_duration":0.0038602850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.739768+0000","last_change":"2023-10-16T20:10:57.739768+0000","last_active":"2023-10-16T20:10:57.739768+0000","last_peered":"2023-10-16T20:10:57.739768+0000","last_clean":"2023-10-16T20:10:57.739768+0000","last_became_active":"2023-10-16T19:40:59.210141+0000","last_became_peered":"2023-10-16T19:40:59.210141+0000","last_unstale":"2023-10-16T20:10:57.739768+0000","last_undegraded":"2023-10-16T20:10:57.739768+0000","last_fullsized":"2023-10-16T20:10:57.739768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:10:57.739436+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.739436+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:03.134324+0000","scrub_duration":0.0038318470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'77","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:49.375706+0000","last_change":"2023-10-16T20:11:49.375898+0000","last_active":"2023-10-16T20:11:49.375706+0000","last_peered":"2023-10-16T20:11:49.375706+0000","last_clean":"2023-10-16T20:11:49.375706+0000","last_became_active":"2023-10-16T19:40:59.179692+0000","last_became_peered":"2023-10-16T19:40:59.179692+0000","last_unstale":"2023-10-16T20:11:49.375706+0000","last_undegraded":"2023-10-16T20:11:49.375706+0000","last_fullsized":"2023-10-16T20:11:49.375706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:49.375526+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:49.375526+0000","last_clean_scrub_stamp":"2023-10-16T20:11:49.375526+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:31.515696+0000","scrub_duration":0.0041958730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'73","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:11.242047+0000","last_change":"2023-10-16T20:11:11.242157+0000","last_active":"2023-10-16T20:11:11.242047+0000","last_peered":"2023-10-16T20:11:11.242047+0000","last_clean":"2023-10-16T20:11:11.242047+0000","last_became_active":"2023-10-16T19:40:59.207481+0000","last_became_peered":"2023-10-16T19:40:59.207481+0000","last_unstale":"2023-10-16T20:11:11.242047+0000","last_undegraded":"2023-10-16T20:11:11.242047+0000","last_fullsized":"2023-10-16T20:11:11.242047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:11:11.241831+0000","last_clean_scrub_stamp":"2023-10-16T20:11:11.241831+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:55:18.546428+0000","scrub_duration":0.0035476230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'82","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:33.995521+0000","last_change":"2023-10-16T20:11:33.995674+0000","last_active":"2023-10-16T20:11:33.995521+0000","last_peered":"2023-10-16T20:11:33.995521+0000","last_clean":"2023-10-16T20:11:33.995521+0000","last_became_active":"2023-10-16T19:40:59.178910+0000","last_became_peered":"2023-10-16T19:40:59.178910+0000","last_unstale":"2023-10-16T20:11:33.995521+0000","last_undegraded":"2023-10-16T20:11:33.995521+0000","last_fullsized":"2023-10-16T20:11:33.995521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'82","last_scrub_stamp":"2023-10-16T20:11:33.995352+0000","last_deep_scrub":"25'82","last_deep_scrub_stamp":"2023-10-16T20:11:33.995352+0000","last_clean_scrub_stamp":"2023-10-16T20:11:33.995352+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:36.617577+0000","scrub_duration":0.0047927760000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'74","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:14.286115+0000","last_change":"2023-10-16T20:11:14.286224+0000","last_active":"2023-10-16T20:11:14.286115+0000","last_peered":"2023-10-16T20:11:14.286115+0000","last_clean":"2023-10-16T20:11:14.286115+0000","last_became_active":"2023-10-16T19:40:59.158930+0000","last_became_peered":"2023-10-16T19:40:59.158930+0000","last_unstale":"2023-10-16T20:11:14.286115+0000","last_undegraded":"2023-10-16T20:11:14.286115+0000","last_fullsized":"2023-10-16T20:11:14.286115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:14.285903+0000","last_clean_scrub_stamp":"2023-10-16T20:11:14.285903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:28.982844+0000","scrub_duration":0.00376969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.707011+0000","last_change":"2023-10-16T20:10:56.707130+0000","last_active":"2023-10-16T20:10:56.707011+0000","last_peered":"2023-10-16T20:10:56.707011+0000","last_clean":"2023-10-16T20:10:56.707011+0000","last_became_active":"2023-10-16T19:40:58.993090+0000","last_became_peered":"2023-10-16T19:40:58.993090+0000","last_unstale":"2023-10-16T20:10:56.707011+0000","last_undegraded":"2023-10-16T20:10:56.707011+0000","last_fullsized":"2023-10-16T20:10:56.707011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:10:56.706833+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.706833+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:40.887025+0000","scrub_duration":0.0036464599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.395618+0000","last_change":"2023-10-16T20:11:06.395618+0000","last_active":"2023-10-16T20:11:06.395618+0000","last_peered":"2023-10-16T20:11:06.395618+0000","last_clean":"2023-10-16T20:11:06.395618+0000","last_became_active":"2023-10-16T19:40:59.154016+0000","last_became_peered":"2023-10-16T19:40:59.154016+0000","last_unstale":"2023-10-16T20:11:06.395618+0000","last_undegraded":"2023-10-16T20:11:06.395618+0000","last_fullsized":"2023-10-16T20:11:06.395618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:06.395317+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.395317+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:33.593221+0000","scrub_duration":0.0039439499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'71","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:19.665454+0000","last_change":"2023-10-16T20:11:19.665454+0000","last_active":"2023-10-16T20:11:19.665454+0000","last_peered":"2023-10-16T20:11:19.665454+0000","last_clean":"2023-10-16T20:11:19.665454+0000","last_became_active":"2023-10-16T19:40:58.993167+0000","last_became_peered":"2023-10-16T19:40:58.993167+0000","last_unstale":"2023-10-16T20:11:19.665454+0000","last_undegraded":"2023-10-16T20:11:19.665454+0000","last_fullsized":"2023-10-16T20:11:19.665454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2023-10-16T20:11:19.665138+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2023-10-16T20:11:19.665138+0000","last_clean_scrub_stamp":"2023-10-16T20:11:19.665138+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:34.362079+0000","scrub_duration":0.0039841809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'69","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:24.270386+0000","last_change":"2023-10-16T20:11:24.270571+0000","last_active":"2023-10-16T20:11:24.270386+0000","last_peered":"2023-10-16T20:11:24.270386+0000","last_clean":"2023-10-16T20:11:24.270386+0000","last_became_active":"2023-10-16T19:41:25.494796+0000","last_became_peered":"2023-10-16T19:41:25.494796+0000","last_unstale":"2023-10-16T20:11:24.270386+0000","last_undegraded":"2023-10-16T20:11:24.270386+0000","last_fullsized":"2023-10-16T20:11:24.270386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:11:24.270212+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:11:24.270212+0000","last_clean_scrub_stamp":"2023-10-16T20:11:24.270212+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:18.933573+0000","scrub_duration":0.0038560790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'68","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.861599+0000","last_change":"2023-10-16T20:11:10.861599+0000","last_active":"2023-10-16T20:11:10.861599+0000","last_peered":"2023-10-16T20:11:10.861599+0000","last_clean":"2023-10-16T20:11:10.861599+0000","last_became_active":"2023-10-16T19:40:59.131932+0000","last_became_peered":"2023-10-16T19:40:59.131932+0000","last_unstale":"2023-10-16T20:11:10.861599+0000","last_undegraded":"2023-10-16T20:11:10.861599+0000","last_fullsized":"2023-10-16T20:11:10.861599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2023-10-16T20:11:10.861284+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.861284+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:05:10.816911+0000","scrub_duration":0.0039407549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'52","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.659928+0000","last_change":"2023-10-16T20:11:22.660048+0000","last_active":"2023-10-16T20:11:22.659928+0000","last_peered":"2023-10-16T20:11:22.659928+0000","last_clean":"2023-10-16T20:11:22.659928+0000","last_became_active":"2023-10-16T19:40:58.993155+0000","last_became_peered":"2023-10-16T19:40:58.993155+0000","last_unstale":"2023-10-16T20:11:22.659928+0000","last_undegraded":"2023-10-16T20:11:22.659928+0000","last_fullsized":"2023-10-16T20:11:22.659928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2023-10-16T20:11:22.659757+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2023-10-16T20:11:22.659757+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.659757+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:06.032503+0000","scrub_duration":0.0041348829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'85","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:23.073415+0000","last_change":"2023-10-16T20:11:23.073530+0000","last_active":"2023-10-16T20:11:23.073415+0000","last_peered":"2023-10-16T20:11:23.073415+0000","last_clean":"2023-10-16T20:11:23.073415+0000","last_became_active":"2023-10-16T19:40:59.178485+0000","last_became_peered":"2023-10-16T19:40:59.178485+0000","last_unstale":"2023-10-16T20:11:23.073415+0000","last_undegraded":"2023-10-16T20:11:23.073415+0000","last_fullsized":"2023-10-16T20:11:23.073415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:23.073248+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:23.073248+0000","last_clean_scrub_stamp":"2023-10-16T20:11:23.073248+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:50:07.204756+0000","scrub_duration":0.003780743,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":3199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'85","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.429977+0000","last_change":"2023-10-16T20:11:07.429977+0000","last_active":"2023-10-16T20:11:07.429977+0000","last_peered":"2023-10-16T20:11:07.429977+0000","last_clean":"2023-10-16T20:11:07.429977+0000","last_became_active":"2023-10-16T19:40:59.153545+0000","last_became_peered":"2023-10-16T19:40:59.153545+0000","last_unstale":"2023-10-16T20:11:07.429977+0000","last_undegraded":"2023-10-16T20:11:07.429977+0000","last_fullsized":"2023-10-16T20:11:07.429977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:07.429670+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.429670+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:44.961326+0000","scrub_duration":0.0040925379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'81","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:56.770625+0000","last_change":"2023-10-16T20:10:56.770625+0000","last_active":"2023-10-16T20:10:56.770625+0000","last_peered":"2023-10-16T20:10:56.770625+0000","last_clean":"2023-10-16T20:10:56.770625+0000","last_became_active":"2023-10-16T19:40:59.182280+0000","last_became_peered":"2023-10-16T19:40:59.182280+0000","last_unstale":"2023-10-16T20:10:56.770625+0000","last_undegraded":"2023-10-16T20:10:56.770625+0000","last_fullsized":"2023-10-16T20:10:56.770625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:10:56.770319+0000","last_clean_scrub_stamp":"2023-10-16T20:10:56.770319+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:09.725801+0000","scrub_duration":0.0040022180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.235236+0000","last_change":"2023-10-16T20:11:18.235236+0000","last_active":"2023-10-16T20:11:18.235236+0000","last_peered":"2023-10-16T20:11:18.235236+0000","last_clean":"2023-10-16T20:11:18.235236+0000","last_became_active":"2023-10-16T19:40:59.209391+0000","last_became_peered":"2023-10-16T19:40:59.209391+0000","last_unstale":"2023-10-16T20:11:18.235236+0000","last_undegraded":"2023-10-16T20:11:18.235236+0000","last_fullsized":"2023-10-16T20:11:18.235236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:18.234972+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:18.234972+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.234972+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:38:45.432876+0000","scrub_duration":0.003821283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'122","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.379491+0000","last_change":"2023-10-16T20:11:22.379607+0000","last_active":"2023-10-16T20:11:22.379491+0000","last_peered":"2023-10-16T20:11:22.379491+0000","last_clean":"2023-10-16T20:11:22.379491+0000","last_became_active":"2023-10-16T19:40:59.127798+0000","last_became_peered":"2023-10-16T19:40:59.127798+0000","last_unstale":"2023-10-16T20:11:22.379491+0000","last_undegraded":"2023-10-16T20:11:22.379491+0000","last_fullsized":"2023-10-16T20:11:22.379491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'122","last_scrub_stamp":"2023-10-16T20:11:22.379322+0000","last_deep_scrub":"25'122","last_deep_scrub_stamp":"2023-10-16T20:11:22.379322+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.379322+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:56:16.097600+0000","scrub_duration":0.0043956230000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":3562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'2225","reported_seq":2263,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.849760+0000","last_change":"2023-10-16T20:10:52.849760+0000","last_active":"2023-10-16T20:10:52.849760+0000","last_peered":"2023-10-16T20:10:52.849760+0000","last_clean":"2023-10-16T20:10:52.849760+0000","last_became_active":"2023-10-16T19:40:56.458854+0000","last_became_peered":"2023-10-16T19:40:56.458854+0000","last_unstale":"2023-10-16T20:10:52.849760+0000","last_undegraded":"2023-10-16T20:10:52.849760+0000","last_fullsized":"2023-10-16T20:10:52.849760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2225","last_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_deep_scrub":"25'2225","last_deep_scrub_stamp":"2023-10-16T20:10:52.849447+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.849447+0000","objects_scrubbed":3,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:08.176111+0000","scrub_duration":0.079253561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8121229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2214,"num_write_kb":9005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.087828+0000","last_change":"2023-10-16T20:11:18.087962+0000","last_active":"2023-10-16T20:11:18.087828+0000","last_peered":"2023-10-16T20:11:18.087828+0000","last_clean":"2023-10-16T20:11:18.087828+0000","last_became_active":"2023-10-16T19:40:59.178100+0000","last_became_peered":"2023-10-16T19:40:59.178100+0000","last_unstale":"2023-10-16T20:11:18.087828+0000","last_undegraded":"2023-10-16T20:11:18.087828+0000","last_fullsized":"2023-10-16T20:11:18.087828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2023-10-16T20:11:18.087653+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2023-10-16T20:11:18.087653+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.087653+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:48.338828+0000","scrub_duration":0.0039221890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":3611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'125","reported_seq":272,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.179411+0000","last_change":"2023-10-16T20:10:59.179606+0000","last_active":"2023-10-16T20:10:59.179411+0000","last_peered":"2023-10-16T20:10:59.179411+0000","last_clean":"2023-10-16T20:10:59.179411+0000","last_became_active":"2023-10-16T19:40:56.418314+0000","last_became_peered":"2023-10-16T19:40:56.418314+0000","last_unstale":"2023-10-16T20:10:59.179411+0000","last_undegraded":"2023-10-16T20:10:59.179411+0000","last_fullsized":"2023-10-16T20:10:59.179411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'125","last_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_deep_scrub":"25'125","last_deep_scrub_stamp":"2023-10-16T20:10:59.179212+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.179212+0000","objects_scrubbed":4,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:20.741211+0000","scrub_duration":0.01096723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":110,"num_write":118,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'206","reported_seq":438,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.752869+0000","last_change":"2023-10-16T20:10:51.753006+0000","last_active":"2023-10-16T20:10:51.752869+0000","last_peered":"2023-10-16T20:10:51.752869+0000","last_clean":"2023-10-16T20:10:51.752869+0000","last_became_active":"2023-10-16T19:40:56.446690+0000","last_became_peered":"2023-10-16T19:40:56.446690+0000","last_unstale":"2023-10-16T20:10:51.752869+0000","last_undegraded":"2023-10-16T20:10:51.752869+0000","last_fullsized":"2023-10-16T20:10:51.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'206","last_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_deep_scrub":"25'206","last_deep_scrub_stamp":"2023-10-16T20:10:51.752708+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.752708+0000","objects_scrubbed":3,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:32.503229+0000","scrub_duration":0.012306727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32724,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":198,"num_write":199,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'62","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.751652+0000","last_change":"2023-10-16T20:11:05.751793+0000","last_active":"2023-10-16T20:11:05.751652+0000","last_peered":"2023-10-16T20:11:05.751652+0000","last_clean":"2023-10-16T20:11:05.751652+0000","last_became_active":"2023-10-16T19:40:59.177157+0000","last_became_peered":"2023-10-16T19:40:59.177157+0000","last_unstale":"2023-10-16T20:11:05.751652+0000","last_undegraded":"2023-10-16T20:11:05.751652+0000","last_fullsized":"2023-10-16T20:11:05.751652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2023-10-16T20:11:05.751451+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.751451+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:52.727094+0000","scrub_duration":0.0039667890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'8","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.449048+0000","last_change":"2023-10-16T20:10:58.449301+0000","last_active":"2023-10-16T20:10:58.449048+0000","last_peered":"2023-10-16T20:10:58.449048+0000","last_clean":"2023-10-16T20:10:58.449048+0000","last_became_active":"2023-10-16T19:40:56.303232+0000","last_became_peered":"2023-10-16T19:40:56.303232+0000","last_unstale":"2023-10-16T20:10:58.449048+0000","last_undegraded":"2023-10-16T20:10:58.449048+0000","last_fullsized":"2023-10-16T20:10:58.449048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-10-16T20:10:58.448775+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.448775+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:27.179352+0000","scrub_duration":0.0075077039999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'81","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.785768+0000","last_change":"2023-10-16T20:11:07.785880+0000","last_active":"2023-10-16T20:11:07.785768+0000","last_peered":"2023-10-16T20:11:07.785768+0000","last_clean":"2023-10-16T20:11:07.785768+0000","last_became_active":"2023-10-16T19:40:59.130299+0000","last_became_peered":"2023-10-16T19:40:59.130299+0000","last_unstale":"2023-10-16T20:11:07.785768+0000","last_undegraded":"2023-10-16T20:11:07.785768+0000","last_fullsized":"2023-10-16T20:11:07.785768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:07.785559+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.785559+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:29.750005+0000","scrub_duration":0.0038216840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'172","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.248681+0000","last_change":"2023-10-16T20:11:04.248898+0000","last_active":"2023-10-16T20:11:04.248681+0000","last_peered":"2023-10-16T20:11:04.248681+0000","last_clean":"2023-10-16T20:11:04.248681+0000","last_became_active":"2023-10-16T19:40:56.414934+0000","last_became_peered":"2023-10-16T19:40:56.414934+0000","last_unstale":"2023-10-16T20:11:04.248681+0000","last_undegraded":"2023-10-16T20:11:04.248681+0000","last_fullsized":"2023-10-16T20:11:04.248681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'172","last_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_deep_scrub":"25'172","last_deep_scrub_stamp":"2023-10-16T20:11:04.248408+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.248408+0000","objects_scrubbed":3,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:48.428600+0000","scrub_duration":0.011087784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.182531+0000","last_change":"2023-10-16T20:11:26.182647+0000","last_active":"2023-10-16T20:11:26.182531+0000","last_peered":"2023-10-16T20:11:26.182531+0000","last_clean":"2023-10-16T20:11:26.182531+0000","last_became_active":"2023-10-16T19:40:59.159096+0000","last_became_peered":"2023-10-16T19:40:59.159096+0000","last_unstale":"2023-10-16T20:11:26.182531+0000","last_undegraded":"2023-10-16T20:11:26.182531+0000","last_fullsized":"2023-10-16T20:11:26.182531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2023-10-16T20:11:26.182366+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2023-10-16T20:11:26.182366+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.182366+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:55.197352+0000","scrub_duration":0.003793963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'83","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.419262+0000","last_change":"2023-10-16T20:10:59.419479+0000","last_active":"2023-10-16T20:10:59.419262+0000","last_peered":"2023-10-16T20:10:59.419262+0000","last_clean":"2023-10-16T20:10:59.419262+0000","last_became_active":"2023-10-16T19:40:56.414924+0000","last_became_peered":"2023-10-16T19:40:56.414924+0000","last_unstale":"2023-10-16T20:10:59.419262+0000","last_undegraded":"2023-10-16T20:10:59.419262+0000","last_fullsized":"2023-10-16T20:10:59.419262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:10:59.419026+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.419026+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:10.718293+0000","scrub_duration":0.0094841230000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":79,"num_write":80,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'95","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.062378+0000","last_change":"2023-10-16T20:11:05.062502+0000","last_active":"2023-10-16T20:11:05.062378+0000","last_peered":"2023-10-16T20:11:05.062378+0000","last_clean":"2023-10-16T20:11:05.062378+0000","last_became_active":"2023-10-16T19:40:59.177617+0000","last_became_peered":"2023-10-16T19:40:59.177617+0000","last_unstale":"2023-10-16T20:11:05.062378+0000","last_undegraded":"2023-10-16T20:11:05.062378+0000","last_fullsized":"2023-10-16T20:11:05.062378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'95","last_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_deep_scrub":"25'95","last_deep_scrub_stamp":"2023-10-16T20:11:05.062206+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.062206+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:49.242398+0000","scrub_duration":0.0047295150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'87","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.090482+0000","last_change":"2023-10-16T20:10:57.090726+0000","last_active":"2023-10-16T20:10:57.090482+0000","last_peered":"2023-10-16T20:10:57.090482+0000","last_clean":"2023-10-16T20:10:57.090482+0000","last_became_active":"2023-10-16T19:40:56.395726+0000","last_became_peered":"2023-10-16T19:40:56.395726+0000","last_unstale":"2023-10-16T20:10:57.090482+0000","last_undegraded":"2023-10-16T20:10:57.090482+0000","last_fullsized":"2023-10-16T20:10:57.090482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2023-10-16T20:10:57.090239+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.090239+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:45.060366+0000","scrub_duration":0.010685826000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:07.425093+0000","last_change":"2023-10-16T20:11:07.425093+0000","last_active":"2023-10-16T20:11:07.425093+0000","last_peered":"2023-10-16T20:11:07.425093+0000","last_clean":"2023-10-16T20:11:07.425093+0000","last_became_active":"2023-10-16T19:40:59.119464+0000","last_became_peered":"2023-10-16T19:40:59.119464+0000","last_unstale":"2023-10-16T20:11:07.425093+0000","last_undegraded":"2023-10-16T20:11:07.425093+0000","last_fullsized":"2023-10-16T20:11:07.425093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:07.424696+0000","last_clean_scrub_stamp":"2023-10-16T20:11:07.424696+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:09:24.485886+0000","scrub_duration":0.0038308159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'1232","reported_seq":1271,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.345878+0000","last_change":"2023-10-16T20:11:05.345878+0000","last_active":"2023-10-16T20:11:05.345878+0000","last_peered":"2023-10-16T20:11:05.345878+0000","last_clean":"2023-10-16T20:11:05.345878+0000","last_became_active":"2023-10-16T19:40:56.447530+0000","last_became_peered":"2023-10-16T19:40:56.447530+0000","last_unstale":"2023-10-16T20:11:05.345878+0000","last_undegraded":"2023-10-16T20:11:05.345878+0000","last_fullsized":"2023-10-16T20:11:05.345878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1232","last_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_deep_scrub":"25'1232","last_deep_scrub_stamp":"2023-10-16T20:11:05.345578+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.345578+0000","objects_scrubbed":6,"log_size":1232,"log_dups_size":0,"ondisk_log_size":1232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:26:15.503390+0000","scrub_duration":0.062660380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":4588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:29.232032+0000","last_change":"2023-10-16T20:11:29.232217+0000","last_active":"2023-10-16T20:11:29.232032+0000","last_peered":"2023-10-16T20:11:29.232032+0000","last_clean":"2023-10-16T20:11:29.232032+0000","last_became_active":"2023-10-16T19:40:59.124178+0000","last_became_peered":"2023-10-16T19:40:59.124178+0000","last_unstale":"2023-10-16T20:11:29.232032+0000","last_undegraded":"2023-10-16T20:11:29.232032+0000","last_fullsized":"2023-10-16T20:11:29.232032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:11:29.231761+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:11:29.231761+0000","last_clean_scrub_stamp":"2023-10-16T20:11:29.231761+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:21:56.521637+0000","scrub_duration":0.0044564460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'123","reported_seq":264,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.225726+0000","last_change":"2023-10-16T20:10:52.225726+0000","last_active":"2023-10-16T20:10:52.225726+0000","last_peered":"2023-10-16T20:10:52.225726+0000","last_clean":"2023-10-16T20:10:52.225726+0000","last_became_active":"2023-10-16T19:40:56.461985+0000","last_became_peered":"2023-10-16T19:40:56.461985+0000","last_unstale":"2023-10-16T20:10:52.225726+0000","last_undegraded":"2023-10-16T20:10:52.225726+0000","last_fullsized":"2023-10-16T20:10:52.225726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'123","last_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_deep_scrub":"25'123","last_deep_scrub_stamp":"2023-10-16T20:10:52.225528+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.225528+0000","objects_scrubbed":7,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:59.684729+0000","scrub_duration":0.012038705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24106,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":106,"num_write":115,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.015002+0000","last_change":"2023-10-16T20:11:26.015214+0000","last_active":"2023-10-16T20:11:26.015002+0000","last_peered":"2023-10-16T20:11:26.015002+0000","last_clean":"2023-10-16T20:11:26.015002+0000","last_became_active":"2023-10-16T19:40:59.178056+0000","last_became_peered":"2023-10-16T19:40:59.178056+0000","last_unstale":"2023-10-16T20:11:26.015002+0000","last_undegraded":"2023-10-16T20:11:26.015002+0000","last_fullsized":"2023-10-16T20:11:26.015002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:26.014810+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:26.014810+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.014810+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:58.547915+0000","scrub_duration":0.0042904199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'97","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.447251+0000","last_change":"2023-10-16T20:11:04.447251+0000","last_active":"2023-10-16T20:11:04.447251+0000","last_peered":"2023-10-16T20:11:04.447251+0000","last_clean":"2023-10-16T20:11:04.447251+0000","last_became_active":"2023-10-16T19:40:56.449531+0000","last_became_peered":"2023-10-16T19:40:56.449531+0000","last_unstale":"2023-10-16T20:11:04.447251+0000","last_undegraded":"2023-10-16T20:11:04.447251+0000","last_fullsized":"2023-10-16T20:11:04.447251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:04.446964+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.446964+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:28:34.698139+0000","scrub_duration":0.0098213269999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'78","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:28.230089+0000","last_change":"2023-10-16T20:11:28.230205+0000","last_active":"2023-10-16T20:11:28.230089+0000","last_peered":"2023-10-16T20:11:28.230089+0000","last_clean":"2023-10-16T20:11:28.230089+0000","last_became_active":"2023-10-16T19:40:59.127714+0000","last_became_peered":"2023-10-16T19:40:59.127714+0000","last_unstale":"2023-10-16T20:11:28.230089+0000","last_undegraded":"2023-10-16T20:11:28.230089+0000","last_fullsized":"2023-10-16T20:11:28.230089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:28.229902+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:28.229902+0000","last_clean_scrub_stamp":"2023-10-16T20:11:28.229902+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:15.264662+0000","scrub_duration":0.0046017439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'917","reported_seq":956,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.216412+0000","last_change":"2023-10-16T20:11:00.216412+0000","last_active":"2023-10-16T20:11:00.216412+0000","last_peered":"2023-10-16T20:11:00.216412+0000","last_clean":"2023-10-16T20:11:00.216412+0000","last_became_active":"2023-10-16T19:40:56.416427+0000","last_became_peered":"2023-10-16T19:40:56.416427+0000","last_unstale":"2023-10-16T20:11:00.216412+0000","last_undegraded":"2023-10-16T20:11:00.216412+0000","last_fullsized":"2023-10-16T20:11:00.216412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'917","last_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_deep_scrub":"25'917","last_deep_scrub_stamp":"2023-10-16T20:11:00.216120+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.216120+0000","objects_scrubbed":3,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:40.966640+0000","scrub_duration":0.039363331000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3281562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":3645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:19.261823+0000","last_change":"2023-10-16T20:11:19.261823+0000","last_active":"2023-10-16T20:11:19.261823+0000","last_peered":"2023-10-16T20:11:19.261823+0000","last_clean":"2023-10-16T20:11:19.261823+0000","last_became_active":"2023-10-16T19:40:59.208678+0000","last_became_peered":"2023-10-16T19:40:59.208678+0000","last_unstale":"2023-10-16T20:11:19.261823+0000","last_undegraded":"2023-10-16T20:11:19.261823+0000","last_fullsized":"2023-10-16T20:11:19.261823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:19.261537+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:19.261537+0000","last_clean_scrub_stamp":"2023-10-16T20:11:19.261537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:20:56.793193+0000","scrub_duration":0.003903255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'120","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:48.805896+0000","last_change":"2023-10-16T20:10:48.805896+0000","last_active":"2023-10-16T20:10:48.805896+0000","last_peered":"2023-10-16T20:10:48.805896+0000","last_clean":"2023-10-16T20:10:48.805896+0000","last_became_active":"2023-10-16T19:40:56.481886+0000","last_became_peered":"2023-10-16T19:40:56.481886+0000","last_unstale":"2023-10-16T20:10:48.805896+0000","last_undegraded":"2023-10-16T20:10:48.805896+0000","last_fullsized":"2023-10-16T20:10:48.805896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'120","last_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_deep_scrub":"25'120","last_deep_scrub_stamp":"2023-10-16T20:10:48.805692+0000","last_clean_scrub_stamp":"2023-10-16T20:10:48.805692+0000","objects_scrubbed":8,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:38:07.417459+0000","scrub_duration":0.014508691000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'69","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.194070+0000","last_change":"2023-10-16T20:10:57.194070+0000","last_active":"2023-10-16T20:10:57.194070+0000","last_peered":"2023-10-16T20:10:57.194070+0000","last_clean":"2023-10-16T20:10:57.194070+0000","last_became_active":"2023-10-16T19:40:59.128613+0000","last_became_peered":"2023-10-16T19:40:59.128613+0000","last_unstale":"2023-10-16T20:10:57.194070+0000","last_undegraded":"2023-10-16T20:10:57.194070+0000","last_fullsized":"2023-10-16T20:10:57.194070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2023-10-16T20:10:57.193654+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.193654+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:57:44.185542+0000","scrub_duration":0.004328302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'193","reported_seq":232,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.308786+0000","last_change":"2023-10-16T20:10:52.308932+0000","last_active":"2023-10-16T20:10:52.308786+0000","last_peered":"2023-10-16T20:10:52.308786+0000","last_clean":"2023-10-16T20:10:52.308786+0000","last_became_active":"2023-10-16T19:40:56.461813+0000","last_became_peered":"2023-10-16T19:40:56.461813+0000","last_unstale":"2023-10-16T20:10:52.308786+0000","last_undegraded":"2023-10-16T20:10:52.308786+0000","last_fullsized":"2023-10-16T20:10:52.308786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2023-10-16T20:10:52.308606+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.308606+0000","objects_scrubbed":2,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:05:12.902639+0000","scrub_duration":0.0076596310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'89","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:39.236016+0000","last_change":"2023-10-16T20:11:39.236136+0000","last_active":"2023-10-16T20:11:39.236016+0000","last_peered":"2023-10-16T20:11:39.236016+0000","last_clean":"2023-10-16T20:11:39.236016+0000","last_became_active":"2023-10-16T19:40:59.127695+0000","last_became_peered":"2023-10-16T19:40:59.127695+0000","last_unstale":"2023-10-16T20:11:39.236016+0000","last_undegraded":"2023-10-16T20:11:39.236016+0000","last_fullsized":"2023-10-16T20:11:39.236016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2023-10-16T20:11:39.235819+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2023-10-16T20:11:39.235819+0000","last_clean_scrub_stamp":"2023-10-16T20:11:39.235819+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:29:32.443252+0000","scrub_duration":0.0035110179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'11","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:49.778351+0000","last_change":"2023-10-16T20:10:49.778439+0000","last_active":"2023-10-16T20:10:49.778351+0000","last_peered":"2023-10-16T20:10:49.778351+0000","last_clean":"2023-10-16T20:10:49.778351+0000","last_became_active":"2023-10-16T19:40:56.485247+0000","last_became_peered":"2023-10-16T19:40:56.485247+0000","last_unstale":"2023-10-16T20:10:49.778351+0000","last_undegraded":"2023-10-16T20:10:49.778351+0000","last_fullsized":"2023-10-16T20:10:49.778351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:10:49.778235+0000","last_clean_scrub_stamp":"2023-10-16T20:10:49.778235+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:34:46.159193+0000","scrub_duration":0.0051660639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'71","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:45.366092+0000","last_change":"2023-10-16T20:11:45.366206+0000","last_active":"2023-10-16T20:11:45.366092+0000","last_peered":"2023-10-16T20:11:45.366092+0000","last_clean":"2023-10-16T20:11:45.366092+0000","last_became_active":"2023-10-16T19:40:59.126945+0000","last_became_peered":"2023-10-16T19:40:59.126945+0000","last_unstale":"2023-10-16T20:11:45.366092+0000","last_undegraded":"2023-10-16T20:11:45.366092+0000","last_fullsized":"2023-10-16T20:11:45.366092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2023-10-16T20:11:45.365889+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2023-10-16T20:11:45.365889+0000","last_clean_scrub_stamp":"2023-10-16T20:11:45.365889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:00.158334+0000","scrub_duration":0.0037913030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'7","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:01.947796+0000","last_change":"2023-10-16T20:11:01.947921+0000","last_active":"2023-10-16T20:11:01.947796+0000","last_peered":"2023-10-16T20:11:01.947796+0000","last_clean":"2023-10-16T20:11:01.947796+0000","last_became_active":"2023-10-16T19:40:56.398929+0000","last_became_peered":"2023-10-16T19:40:56.398929+0000","last_unstale":"2023-10-16T20:11:01.947796+0000","last_undegraded":"2023-10-16T20:11:01.947796+0000","last_fullsized":"2023-10-16T20:11:01.947796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:01.947627+0000","last_clean_scrub_stamp":"2023-10-16T20:11:01.947627+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:38.925238+0000","scrub_duration":0.0085375859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:04.755300+0000","last_change":"2023-10-16T20:11:04.755418+0000","last_active":"2023-10-16T20:11:04.755300+0000","last_peered":"2023-10-16T20:11:04.755300+0000","last_clean":"2023-10-16T20:11:04.755300+0000","last_became_active":"2023-10-16T19:41:25.727377+0000","last_became_peered":"2023-10-16T19:41:25.727377+0000","last_unstale":"2023-10-16T20:11:04.755300+0000","last_undegraded":"2023-10-16T20:11:04.755300+0000","last_fullsized":"2023-10-16T20:11:04.755300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2023-10-16T20:11:04.755134+0000","last_clean_scrub_stamp":"2023-10-16T20:11:04.755134+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:46:21.886819+0000","scrub_duration":0.0038213980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":8088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'595","reported_seq":634,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.839482+0000","last_change":"2023-10-16T20:10:50.839718+0000","last_active":"2023-10-16T20:10:50.839482+0000","last_peered":"2023-10-16T20:10:50.839482+0000","last_clean":"2023-10-16T20:10:50.839482+0000","last_became_active":"2023-10-16T19:40:56.483730+0000","last_became_peered":"2023-10-16T19:40:56.483730+0000","last_unstale":"2023-10-16T20:10:50.839482+0000","last_undegraded":"2023-10-16T20:10:50.839482+0000","last_fullsized":"2023-10-16T20:10:50.839482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'595","last_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_deep_scrub":"25'595","last_deep_scrub_stamp":"2023-10-16T20:10:50.839312+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.839312+0000","objects_scrubbed":3,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:26.515689+0000","scrub_duration":0.036436172000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2924434,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":3165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'77","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:52.334386+0000","last_change":"2023-10-16T20:11:52.334500+0000","last_active":"2023-10-16T20:11:52.334386+0000","last_peered":"2023-10-16T20:11:52.334386+0000","last_clean":"2023-10-16T20:11:52.334386+0000","last_became_active":"2023-10-16T19:40:59.157130+0000","last_became_peered":"2023-10-16T19:40:59.157130+0000","last_unstale":"2023-10-16T20:11:52.334386+0000","last_undegraded":"2023-10-16T20:11:52.334386+0000","last_fullsized":"2023-10-16T20:11:52.334386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:52.334208+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:52.334208+0000","last_clean_scrub_stamp":"2023-10-16T20:11:52.334208+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:09.151360+0000","scrub_duration":0.0044015089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:59.197315+0000","last_change":"2023-10-16T20:10:59.197457+0000","last_active":"2023-10-16T20:10:59.197315+0000","last_peered":"2023-10-16T20:10:59.197315+0000","last_clean":"2023-10-16T20:10:59.197315+0000","last_became_active":"2023-10-16T19:40:41.706542+0000","last_became_peered":"2023-10-16T19:40:41.706542+0000","last_unstale":"2023-10-16T20:10:59.197315+0000","last_undegraded":"2023-10-16T20:10:59.197315+0000","last_fullsized":"2023-10-16T20:10:59.197315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-10-16T20:10:59.197159+0000","last_clean_scrub_stamp":"2023-10-16T20:10:59.197159+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:04.377504+0000","scrub_duration":0.013745998000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'11","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.406084+0000","last_change":"2023-10-16T20:11:03.406084+0000","last_active":"2023-10-16T20:11:03.406084+0000","last_peered":"2023-10-16T20:11:03.406084+0000","last_clean":"2023-10-16T20:11:03.406084+0000","last_became_active":"2023-10-16T19:40:56.484964+0000","last_became_peered":"2023-10-16T19:40:56.484964+0000","last_unstale":"2023-10-16T20:11:03.406084+0000","last_undegraded":"2023-10-16T20:11:03.406084+0000","last_fullsized":"2023-10-16T20:11:03.406084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:03.405741+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.405741+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:14:50.381384+0000","scrub_duration":0.012053975999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'65","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.643141+0000","last_change":"2023-10-16T20:11:00.643141+0000","last_active":"2023-10-16T20:11:00.643141+0000","last_peered":"2023-10-16T20:11:00.643141+0000","last_clean":"2023-10-16T20:11:00.643141+0000","last_became_active":"2023-10-16T19:40:59.155135+0000","last_became_peered":"2023-10-16T19:40:59.155135+0000","last_unstale":"2023-10-16T20:11:00.643141+0000","last_undegraded":"2023-10-16T20:11:00.643141+0000","last_fullsized":"2023-10-16T20:11:00.643141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2023-10-16T20:11:00.642786+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.642786+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:29.373362+0000","scrub_duration":0.004474586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'11","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:00.224693+0000","last_change":"2023-10-16T20:11:00.224693+0000","last_active":"2023-10-16T20:11:00.224693+0000","last_peered":"2023-10-16T20:11:00.224693+0000","last_clean":"2023-10-16T20:11:00.224693+0000","last_became_active":"2023-10-16T19:40:56.466964+0000","last_became_peered":"2023-10-16T19:40:56.466964+0000","last_unstale":"2023-10-16T20:11:00.224693+0000","last_undegraded":"2023-10-16T20:11:00.224693+0000","last_fullsized":"2023-10-16T20:11:00.224693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-10-16T20:11:00.224425+0000","last_clean_scrub_stamp":"2023-10-16T20:11:00.224425+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:44.355933+0000","scrub_duration":0.0071850550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'72","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.053556+0000","last_change":"2023-10-16T20:11:03.053556+0000","last_active":"2023-10-16T20:11:03.053556+0000","last_peered":"2023-10-16T20:11:03.053556+0000","last_clean":"2023-10-16T20:11:03.053556+0000","last_became_active":"2023-10-16T19:40:59.173356+0000","last_became_peered":"2023-10-16T19:40:59.173356+0000","last_unstale":"2023-10-16T20:11:03.053556+0000","last_undegraded":"2023-10-16T20:11:03.053556+0000","last_fullsized":"2023-10-16T20:11:03.053556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2023-10-16T20:11:03.053085+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.053085+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:18.379749+0000","scrub_duration":0.0044426120000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'182","reported_seq":311,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:52.785600+0000","last_change":"2023-10-16T20:10:52.785600+0000","last_active":"2023-10-16T20:10:52.785600+0000","last_peered":"2023-10-16T20:10:52.785600+0000","last_clean":"2023-10-16T20:10:52.785600+0000","last_became_active":"2023-10-16T19:40:56.484993+0000","last_became_peered":"2023-10-16T19:40:56.484993+0000","last_unstale":"2023-10-16T20:10:52.785600+0000","last_undegraded":"2023-10-16T20:10:52.785600+0000","last_fullsized":"2023-10-16T20:10:52.785600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:52.785411+0000","last_clean_scrub_stamp":"2023-10-16T20:10:52.785411+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:41:36.044719+0000","scrub_duration":0.014410586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":90,"num_write":173,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'66","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.886972+0000","last_change":"2023-10-16T20:11:16.887104+0000","last_active":"2023-10-16T20:11:16.886972+0000","last_peered":"2023-10-16T20:11:16.886972+0000","last_clean":"2023-10-16T20:11:16.886972+0000","last_became_active":"2023-10-16T19:40:59.179737+0000","last_became_peered":"2023-10-16T19:40:59.179737+0000","last_unstale":"2023-10-16T20:11:16.886972+0000","last_undegraded":"2023-10-16T20:11:16.886972+0000","last_fullsized":"2023-10-16T20:11:16.886972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2023-10-16T20:11:16.886795+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2023-10-16T20:11:16.886795+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.886795+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:43.385781+0000","scrub_duration":0.0037474850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'441","reported_seq":482,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.423502+0000","last_change":"2023-10-16T20:11:05.423502+0000","last_active":"2023-10-16T20:11:05.423502+0000","last_peered":"2023-10-16T20:11:05.423502+0000","last_clean":"2023-10-16T20:11:05.423502+0000","last_became_active":"2023-10-16T19:40:56.396012+0000","last_became_peered":"2023-10-16T19:40:56.396012+0000","last_unstale":"2023-10-16T20:11:05.423502+0000","last_undegraded":"2023-10-16T20:11:05.423502+0000","last_fullsized":"2023-10-16T20:11:05.423502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'441","last_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_deep_scrub":"25'441","last_deep_scrub_stamp":"2023-10-16T20:11:05.423201+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.423201+0000","objects_scrubbed":2,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.561417+0000","scrub_duration":0.028676314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435560,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":2610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'88","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:03.313319+0000","last_change":"2023-10-16T20:11:03.313319+0000","last_active":"2023-10-16T20:11:03.313319+0000","last_peered":"2023-10-16T20:11:03.313319+0000","last_clean":"2023-10-16T20:11:03.313319+0000","last_became_active":"2023-10-16T19:40:59.182026+0000","last_became_peered":"2023-10-16T19:40:59.182026+0000","last_unstale":"2023-10-16T20:11:03.313319+0000","last_undegraded":"2023-10-16T20:11:03.313319+0000","last_fullsized":"2023-10-16T20:11:03.313319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'88","last_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_deep_scrub":"25'88","last_deep_scrub_stamp":"2023-10-16T20:11:03.313054+0000","last_clean_scrub_stamp":"2023-10-16T20:11:03.313054+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:27:31.752491+0000","scrub_duration":0.0037970629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:51.100008+0000","last_change":"2023-10-16T20:10:51.100008+0000","last_active":"2023-10-16T20:10:51.100008+0000","last_peered":"2023-10-16T20:10:51.100008+0000","last_clean":"2023-10-16T20:10:51.100008+0000","last_became_active":"2023-10-16T19:40:56.462686+0000","last_became_peered":"2023-10-16T19:40:56.462686+0000","last_unstale":"2023-10-16T20:10:51.100008+0000","last_undegraded":"2023-10-16T20:10:51.100008+0000","last_fullsized":"2023-10-16T20:10:51.100008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-10-16T20:10:51.099844+0000","last_clean_scrub_stamp":"2023-10-16T20:10:51.099844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:15:33.686104+0000","scrub_duration":0.0037505049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'56","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:16.251613+0000","last_change":"2023-10-16T20:11:16.251822+0000","last_active":"2023-10-16T20:11:16.251613+0000","last_peered":"2023-10-16T20:11:16.251613+0000","last_clean":"2023-10-16T20:11:16.251613+0000","last_became_active":"2023-10-16T19:40:59.154129+0000","last_became_peered":"2023-10-16T19:40:59.154129+0000","last_unstale":"2023-10-16T20:11:16.251613+0000","last_undegraded":"2023-10-16T20:11:16.251613+0000","last_fullsized":"2023-10-16T20:11:16.251613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:16.251413+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:16.251413+0000","last_clean_scrub_stamp":"2023-10-16T20:11:16.251413+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:59.624160+0000","scrub_duration":0.0040611930000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'75","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:26.227552+0000","last_change":"2023-10-16T20:11:26.227552+0000","last_active":"2023-10-16T20:11:26.227552+0000","last_peered":"2023-10-16T20:11:26.227552+0000","last_clean":"2023-10-16T20:11:26.227552+0000","last_became_active":"2023-10-16T19:40:56.465470+0000","last_became_peered":"2023-10-16T19:40:56.465470+0000","last_unstale":"2023-10-16T20:11:26.227552+0000","last_undegraded":"2023-10-16T20:11:26.227552+0000","last_fullsized":"2023-10-16T20:11:26.227552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:11:26.227263+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:11:26.227263+0000","last_clean_scrub_stamp":"2023-10-16T20:11:26.227263+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:38:19.565166+0000","scrub_duration":0.010291702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'83","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.916971+0000","last_change":"2023-10-16T20:11:02.916971+0000","last_active":"2023-10-16T20:11:02.916971+0000","last_peered":"2023-10-16T20:11:02.916971+0000","last_clean":"2023-10-16T20:11:02.916971+0000","last_became_active":"2023-10-16T19:40:59.176063+0000","last_became_peered":"2023-10-16T19:40:59.176063+0000","last_unstale":"2023-10-16T20:11:02.916971+0000","last_undegraded":"2023-10-16T20:11:02.916971+0000","last_fullsized":"2023-10-16T20:11:02.916971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2023-10-16T20:11:02.916667+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.916667+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:00.488332+0000","scrub_duration":0.004083677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'182","reported_seq":222,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:58.058213+0000","last_change":"2023-10-16T20:10:58.058213+0000","last_active":"2023-10-16T20:10:58.058213+0000","last_peered":"2023-10-16T20:10:58.058213+0000","last_clean":"2023-10-16T20:10:58.058213+0000","last_became_active":"2023-10-16T19:40:56.414830+0000","last_became_peered":"2023-10-16T19:40:56.414830+0000","last_unstale":"2023-10-16T20:10:58.058213+0000","last_undegraded":"2023-10-16T20:10:58.058213+0000","last_fullsized":"2023-10-16T20:10:58.058213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'182","last_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_deep_scrub":"25'182","last_deep_scrub_stamp":"2023-10-16T20:10:58.057907+0000","last_clean_scrub_stamp":"2023-10-16T20:10:58.057907+0000","objects_scrubbed":4,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:35.465191+0000","scrub_duration":0.0099141170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'77","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:05.714234+0000","last_change":"2023-10-16T20:11:05.714234+0000","last_active":"2023-10-16T20:11:05.714234+0000","last_peered":"2023-10-16T20:11:05.714234+0000","last_clean":"2023-10-16T20:11:05.714234+0000","last_became_active":"2023-10-16T19:41:25.493560+0000","last_became_peered":"2023-10-16T19:41:25.493560+0000","last_unstale":"2023-10-16T20:11:05.714234+0000","last_undegraded":"2023-10-16T20:11:05.714234+0000","last_fullsized":"2023-10-16T20:11:05.714234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2023-10-16T20:11:05.713860+0000","last_clean_scrub_stamp":"2023-10-16T20:11:05.713860+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:42.363819+0000","scrub_duration":0.0043101069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"25'19","reported_seq":59,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:02.204431+0000","last_change":"2023-10-16T20:11:02.204431+0000","last_active":"2023-10-16T20:11:02.204431+0000","last_peered":"2023-10-16T20:11:02.204431+0000","last_clean":"2023-10-16T20:11:02.204431+0000","last_became_active":"2023-10-16T19:40:56.459568+0000","last_became_peered":"2023-10-16T19:40:56.459568+0000","last_unstale":"2023-10-16T20:11:02.204431+0000","last_undegraded":"2023-10-16T20:11:02.204431+0000","last_fullsized":"2023-10-16T20:11:02.204431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-10-16T20:11:02.204019+0000","last_clean_scrub_stamp":"2023-10-16T20:11:02.204019+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:43.393039+0000","scrub_duration":0.010984687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'48","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:17.119707+0000","last_change":"2023-10-16T20:11:17.119707+0000","last_active":"2023-10-16T20:11:17.119707+0000","last_peered":"2023-10-16T20:11:17.119707+0000","last_clean":"2023-10-16T20:11:17.119707+0000","last_became_active":"2023-10-16T19:40:59.173405+0000","last_became_peered":"2023-10-16T19:40:59.173405+0000","last_unstale":"2023-10-16T20:11:17.119707+0000","last_undegraded":"2023-10-16T20:11:17.119707+0000","last_fullsized":"2023-10-16T20:11:17.119707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'48","last_scrub_stamp":"2023-10-16T20:11:17.119304+0000","last_deep_scrub":"25'48","last_deep_scrub_stamp":"2023-10-16T20:11:17.119304+0000","last_clean_scrub_stamp":"2023-10-16T20:11:17.119304+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:04.111192+0000","scrub_duration":0.0037991639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'7","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.299518+0000","last_change":"2023-10-16T20:11:09.299518+0000","last_active":"2023-10-16T20:11:09.299518+0000","last_peered":"2023-10-16T20:11:09.299518+0000","last_clean":"2023-10-16T20:11:09.299518+0000","last_became_active":"2023-10-16T19:40:56.468250+0000","last_became_peered":"2023-10-16T19:40:56.468250+0000","last_unstale":"2023-10-16T20:11:09.299518+0000","last_undegraded":"2023-10-16T20:11:09.299518+0000","last_fullsized":"2023-10-16T20:11:09.299518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-10-16T20:11:09.299250+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.299250+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:50.359476+0000","scrub_duration":0.0074289619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'73","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:57.434160+0000","last_change":"2023-10-16T20:10:57.434160+0000","last_active":"2023-10-16T20:10:57.434160+0000","last_peered":"2023-10-16T20:10:57.434160+0000","last_clean":"2023-10-16T20:10:57.434160+0000","last_became_active":"2023-10-16T19:40:59.179250+0000","last_became_peered":"2023-10-16T19:40:59.179250+0000","last_unstale":"2023-10-16T20:10:57.434160+0000","last_undegraded":"2023-10-16T20:10:57.434160+0000","last_fullsized":"2023-10-16T20:10:57.434160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2023-10-16T20:10:57.433829+0000","last_clean_scrub_stamp":"2023-10-16T20:10:57.433829+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:14.317205+0000","scrub_duration":0.0042212430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'178","reported_seq":218,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:47.079655+0000","last_change":"2023-10-16T20:10:47.079655+0000","last_active":"2023-10-16T20:10:47.079655+0000","last_peered":"2023-10-16T20:10:47.079655+0000","last_clean":"2023-10-16T20:10:47.079655+0000","last_became_active":"2023-10-16T19:40:56.459271+0000","last_became_peered":"2023-10-16T19:40:56.459271+0000","last_unstale":"2023-10-16T20:10:47.079655+0000","last_undegraded":"2023-10-16T20:10:47.079655+0000","last_fullsized":"2023-10-16T20:10:47.079655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2023-10-16T20:10:47.079299+0000","last_clean_scrub_stamp":"2023-10-16T20:10:47.079299+0000","objects_scrubbed":4,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:58.646035+0000","scrub_duration":0.012090556000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'52","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:20.688314+0000","last_change":"2023-10-16T20:11:20.688314+0000","last_active":"2023-10-16T20:11:20.688314+0000","last_peered":"2023-10-16T20:11:20.688314+0000","last_clean":"2023-10-16T20:11:20.688314+0000","last_became_active":"2023-10-16T19:40:59.128394+0000","last_became_peered":"2023-10-16T19:40:59.128394+0000","last_unstale":"2023-10-16T20:11:20.688314+0000","last_undegraded":"2023-10-16T20:11:20.688314+0000","last_fullsized":"2023-10-16T20:11:20.688314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2023-10-16T20:11:20.688032+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2023-10-16T20:11:20.688032+0000","last_clean_scrub_stamp":"2023-10-16T20:11:20.688032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:52.001332+0000","scrub_duration":0.0039269320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'429","reported_seq":469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.061870+0000","last_change":"2023-10-16T20:10:50.061870+0000","last_active":"2023-10-16T20:10:50.061870+0000","last_peered":"2023-10-16T20:10:50.061870+0000","last_clean":"2023-10-16T20:10:50.061870+0000","last_became_active":"2023-10-16T19:40:56.450677+0000","last_became_peered":"2023-10-16T19:40:56.450677+0000","last_unstale":"2023-10-16T20:10:50.061870+0000","last_undegraded":"2023-10-16T20:10:50.061870+0000","last_fullsized":"2023-10-16T20:10:50.061870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'429","last_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_deep_scrub":"25'429","last_deep_scrub_stamp":"2023-10-16T20:10:50.061747+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.061747+0000","objects_scrubbed":2,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:43.780025+0000","scrub_duration":0.007646229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.684325+0000","last_change":"2023-10-16T20:11:18.684441+0000","last_active":"2023-10-16T20:11:18.684325+0000","last_peered":"2023-10-16T20:11:18.684325+0000","last_clean":"2023-10-16T20:11:18.684325+0000","last_became_active":"2023-10-16T19:40:59.181949+0000","last_became_peered":"2023-10-16T19:40:59.181949+0000","last_unstale":"2023-10-16T20:11:18.684325+0000","last_undegraded":"2023-10-16T20:11:18.684325+0000","last_fullsized":"2023-10-16T20:11:18.684325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2023-10-16T20:11:18.684142+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2023-10-16T20:11:18.684142+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.684142+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:25.921862+0000","scrub_duration":0.003750738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'14","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.287527+0000","last_change":"2023-10-16T20:11:12.287646+0000","last_active":"2023-10-16T20:11:12.287527+0000","last_peered":"2023-10-16T20:11:12.287527+0000","last_clean":"2023-10-16T20:11:12.287527+0000","last_became_active":"2023-10-16T19:40:56.461241+0000","last_became_peered":"2023-10-16T19:40:56.461241+0000","last_unstale":"2023-10-16T20:11:12.287527+0000","last_undegraded":"2023-10-16T20:11:12.287527+0000","last_fullsized":"2023-10-16T20:11:12.287527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'14","last_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_deep_scrub":"25'14","last_deep_scrub_stamp":"2023-10-16T20:11:12.287330+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.287330+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:48:43.600630+0000","scrub_duration":0.0075854269999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'74","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:09.282147+0000","last_change":"2023-10-16T20:11:09.282147+0000","last_active":"2023-10-16T20:11:09.282147+0000","last_peered":"2023-10-16T20:11:09.282147+0000","last_clean":"2023-10-16T20:11:09.282147+0000","last_became_active":"2023-10-16T19:40:59.209369+0000","last_became_peered":"2023-10-16T19:40:59.209369+0000","last_unstale":"2023-10-16T20:11:09.282147+0000","last_undegraded":"2023-10-16T20:11:09.282147+0000","last_fullsized":"2023-10-16T20:11:09.282147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2023-10-16T20:11:09.281641+0000","last_clean_scrub_stamp":"2023-10-16T20:11:09.281641+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:34.393175+0000","scrub_duration":0.0045042149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'78","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:35.068448+0000","last_change":"2023-10-16T20:11:35.068635+0000","last_active":"2023-10-16T20:11:35.068448+0000","last_peered":"2023-10-16T20:11:35.068448+0000","last_clean":"2023-10-16T20:11:35.068448+0000","last_became_active":"2023-10-16T19:40:59.155051+0000","last_became_peered":"2023-10-16T19:40:59.155051+0000","last_unstale":"2023-10-16T20:11:35.068448+0000","last_undegraded":"2023-10-16T20:11:35.068448+0000","last_fullsized":"2023-10-16T20:11:35.068448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2023-10-16T20:11:35.068212+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2023-10-16T20:11:35.068212+0000","last_clean_scrub_stamp":"2023-10-16T20:11:35.068212+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:29.407569+0000","scrub_duration":0.0046133959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'13","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:22.246697+0000","last_change":"2023-10-16T20:11:22.246759+0000","last_active":"2023-10-16T20:11:22.246697+0000","last_peered":"2023-10-16T20:11:22.246697+0000","last_clean":"2023-10-16T20:11:22.246697+0000","last_became_active":"2023-10-16T19:40:56.463340+0000","last_became_peered":"2023-10-16T19:40:56.463340+0000","last_unstale":"2023-10-16T20:11:22.246697+0000","last_undegraded":"2023-10-16T20:11:22.246697+0000","last_fullsized":"2023-10-16T20:11:22.246697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-10-16T20:11:22.246620+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-10-16T20:11:22.246620+0000","last_clean_scrub_stamp":"2023-10-16T20:11:22.246620+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:20.946031+0000","scrub_duration":0.010463379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'79","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:32.085198+0000","last_change":"2023-10-16T20:11:32.085319+0000","last_active":"2023-10-16T20:11:32.085198+0000","last_peered":"2023-10-16T20:11:32.085198+0000","last_clean":"2023-10-16T20:11:32.085198+0000","last_became_active":"2023-10-16T19:40:59.154374+0000","last_became_peered":"2023-10-16T19:40:59.154374+0000","last_unstale":"2023-10-16T20:11:32.085198+0000","last_undegraded":"2023-10-16T20:11:32.085198+0000","last_fullsized":"2023-10-16T20:11:32.085198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2023-10-16T20:11:32.085036+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2023-10-16T20:11:32.085036+0000","last_clean_scrub_stamp":"2023-10-16T20:11:32.085036+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:19.119797+0000","scrub_duration":0.0038365719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'156","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:10.267670+0000","last_change":"2023-10-16T20:11:10.267809+0000","last_active":"2023-10-16T20:11:10.267670+0000","last_peered":"2023-10-16T20:11:10.267670+0000","last_clean":"2023-10-16T20:11:10.267670+0000","last_became_active":"2023-10-16T19:40:56.462771+0000","last_became_peered":"2023-10-16T19:40:56.462771+0000","last_unstale":"2023-10-16T20:11:10.267670+0000","last_undegraded":"2023-10-16T20:11:10.267670+0000","last_fullsized":"2023-10-16T20:11:10.267670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'156","last_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_deep_scrub":"25'156","last_deep_scrub_stamp":"2023-10-16T20:11:10.267479+0000","last_clean_scrub_stamp":"2023-10-16T20:11:10.267479+0000","objects_scrubbed":7,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:24.964421+0000","scrub_duration":0.014645241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:06.071341+0000","last_change":"2023-10-16T20:11:06.071341+0000","last_active":"2023-10-16T20:11:06.071341+0000","last_peered":"2023-10-16T20:11:06.071341+0000","last_clean":"2023-10-16T20:11:06.071341+0000","last_became_active":"2023-10-16T19:40:59.174397+0000","last_became_peered":"2023-10-16T19:40:59.174397+0000","last_unstale":"2023-10-16T20:11:06.071341+0000","last_undegraded":"2023-10-16T20:11:06.071341+0000","last_fullsized":"2023-10-16T20:11:06.071341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2023-10-16T20:11:06.071033+0000","last_clean_scrub_stamp":"2023-10-16T20:11:06.071033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:51:02.947576+0000","scrub_duration":0.0042787709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'9","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:50.791172+0000","last_change":"2023-10-16T20:10:50.791172+0000","last_active":"2023-10-16T20:10:50.791172+0000","last_peered":"2023-10-16T20:10:50.791172+0000","last_clean":"2023-10-16T20:10:50.791172+0000","last_became_active":"2023-10-16T19:40:56.462151+0000","last_became_peered":"2023-10-16T19:40:56.462151+0000","last_unstale":"2023-10-16T20:10:50.791172+0000","last_undegraded":"2023-10-16T20:10:50.791172+0000","last_fullsized":"2023-10-16T20:10:50.791172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2023-10-16T20:10:50.790831+0000","last_clean_scrub_stamp":"2023-10-16T20:10:50.790831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:27.440790+0000","scrub_duration":0.0041105270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'56","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:11:12.684963+0000","last_change":"2023-10-16T20:11:12.685085+0000","last_active":"2023-10-16T20:11:12.684963+0000","last_peered":"2023-10-16T20:11:12.684963+0000","last_clean":"2023-10-16T20:11:12.684963+0000","last_became_active":"2023-10-16T19:40:59.210168+0000","last_became_peered":"2023-10-16T19:40:59.210168+0000","last_unstale":"2023-10-16T20:11:12.684963+0000","last_undegraded":"2023-10-16T20:11:12.684963+0000","last_fullsized":"2023-10-16T20:11:12.684963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2023-10-16T20:11:12.684788+0000","last_clean_scrub_stamp":"2023-10-16T20:11:12.684788+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:39.823004+0000","scrub_duration":0.0045610140000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'75","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:10:46.154175+0000","last_change":"2023-10-16T20:10:46.154175+0000","last_active":"2023-10-16T20:10:46.154175+0000","last_peered":"2023-10-16T20:10:46.154175+0000","last_clean":"2023-10-16T20:10:46.154175+0000","last_became_active":"2023-10-16T19:40:56.465052+0000","last_became_peered":"2023-10-16T19:40:56.465052+0000","last_unstale":"2023-10-16T20:10:46.154175+0000","last_undegraded":"2023-10-16T20:10:46.154175+0000","last_fullsized":"2023-10-16T20:10:46.154175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2023-10-16T20:10:46.154049+0000","last_clean_scrub_stamp":"2023-10-16T20:10:46.154049+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:41:39.554198+0000","scrub_duration":0.0087997690000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":2129,"num_write_kb":250249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4797,"ondisk_log_size":4797,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21070598,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":567,"num_read_kb":583,"num_write":9141,"num_write_kb":25177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36913152,"data_stored":42141196,"data_compressed":1839154,"data_compressed_allocated":3121152,"data_compressed_original":8585216,"omap_allocated":0,"internal_metadata":0},"log_size":8007,"ondisk_log_size":8007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65778,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509823,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52408,"kb_used_data":7344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319432,"statfs":{"total":96636764160,"available":96583098368,"internally_reserved":0,"allocated":7520256,"data_stored":8809103,"data_compressed":369549,"data_compressed_allocated":622592,"data_compressed_original":2109440,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2,"15min":1.169},"min":{"1min":0.73999999999999999,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.5860000000000001,"5min":2.0569999999999999,"15min":2.085},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1879999999999999,"15min":1.2749999999999999},"min":{"1min":0.81699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.649,"5min":1.905,"15min":2.1520000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.23,"15min":1.2350000000000001},"min":{"1min":0.77700000000000002,"5min":0.68799999999999994,"15min":0.503},"max":{"1min":1.75,"5min":1.996,"15min":2.3050000000000002},"last":1.45},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.262,"15min":1.3160000000000001},"min":{"1min":0.94699999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.698,"5min":1.8320000000000001,"15min":2.27},"last":1.583}]},{"osd":2,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.3129999999999999},"min":{"1min":0.75700000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9490000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.375,"15min":1.4079999999999999},"min":{"1min":1.0389999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"max":{"1min":1.774,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.353}]},{"osd":3,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.3460000000000001,"15min":1.4099999999999999},"min":{"1min":1.0349999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8109999999999999,"5min":2.1139999999999999,"15min":2.2450000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.4590000000000001,"15min":1.498},"min":{"1min":0.90000000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.696,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.139}]},{"osd":4,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.85899999999999999,"5min":0.72499999999999998,"15min":0.624},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":2.375},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.367,"15min":1.401},"min":{"1min":0.95799999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.1859999999999999,"5min":2.298,"15min":2.5459999999999998},"last":1.5469999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4670000000000001,"15min":1.456},"min":{"1min":1.0009999999999999,"5min":0.79800000000000004,"15min":0.77300000000000002},"max":{"1min":1.7490000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":1.04},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.48,"15min":1.5109999999999999},"min":{"1min":1.1000000000000001,"5min":0.72899999999999998,"15min":0.56499999999999995},"max":{"1min":1.821,"5min":2.2490000000000001,"15min":2.4750000000000001},"last":1.5029999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.579,"15min":1.5940000000000001},"min":{"1min":1.1279999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"max":{"1min":1.869,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.643},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5109999999999999,"15min":1.5640000000000001},"min":{"1min":0.96599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.0779999999999998,"5min":2.4209999999999998,"15min":2.4990000000000001},"last":1.484}]}]},{"osd":6,"up_from":15,"seq":64424509823,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52132,"kb_used_data":7068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319708,"statfs":{"total":96636764160,"available":96583380992,"internally_reserved":0,"allocated":7237632,"data_stored":7642559,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.68500000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":2.0409999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.2949999999999999,"15min":1.2769999999999999},"min":{"1min":0.91700000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0110000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.8149999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.202,"15min":1.2390000000000001},"min":{"1min":0.72499999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.504,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.331,"15min":1.345},"min":{"1min":0.94899999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.956,"5min":2.2069999999999999,"15min":2.2349999999999999},"last":1.55}]},{"osd":2,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.871,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7110000000000001,"5min":2.3180000000000001,"15min":2.367},"last":1.425},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3540000000000001,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.887,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.3360000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.444,"15min":1.476},"min":{"1min":0.89500000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.758,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":1.633},{"interface":"front","average":{"1min":1.375,"5min":1.417,"15min":1.45},"min":{"1min":1.113,"5min":0.95899999999999996,"15min":0.91800000000000004},"max":{"1min":1.609,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.8500000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.379,"15min":1.357},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.8899999999999999,"5min":3.415,"15min":3.415},"last":1.78},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.7050000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4039999999999999,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"max":{"1min":1.9059999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.575,"15min":1.554},"min":{"1min":0.877,"5min":0.877,"15min":0.68300000000000005},"max":{"1min":1.9510000000000001,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.659}]},{"osd":7,"last update":"Mon Oct 16 20:11:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5580000000000001,"15min":1.5700000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":3.145,"15min":3.145},"last":1.488},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.603,"15min":1.5840000000000001},"min":{"1min":1.3120000000000001,"5min":1.044,"15min":0.98799999999999999},"max":{"1min":1.883,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.7290000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509824,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43892,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327948,"statfs":{"total":96636764160,"available":96591818752,"internally_reserved":0,"allocated":4501504,"data_stored":5476578,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.179,"15min":1.2110000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.677,"5min":1.9350000000000001,"15min":1.9650000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.206,"15min":1.2669999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7350000000000001,"5min":1.929,"15min":2.3839999999999999},"last":1.5640000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3240000000000001,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.81200000000000006,"15min":0.755},"max":{"1min":1.827,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.323,"15min":1.345},"min":{"1min":0.84899999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8420000000000001,"5min":2.677,"15min":2.677},"last":1.1479999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.339,"15min":1.3360000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4710000000000001,"5min":2.0569999999999999,"15min":2.177},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.423,"15min":1.448},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.1899999999999999,"5min":2.476,"15min":2.6040000000000001},"last":1.53}]},{"osd":3,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4139999999999999,"15min":1.45},"min":{"1min":0.98099999999999998,"5min":0.872,"15min":0.79400000000000004},"max":{"1min":1.724,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.5269999999999999,"15min":1.5309999999999999},"min":{"1min":1.1000000000000001,"5min":1.048,"15min":0.86599999999999999},"max":{"1min":1.9730000000000001,"5min":2.71,"15min":2.71},"last":1.3660000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.3540000000000001,"15min":1.339},"min":{"1min":0.86699999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.966,"5min":2.3300000000000001,"15min":2.4369999999999998},"last":1.042},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":1.0509999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.887,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.6859999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.79000000000000004},"max":{"1min":2.0910000000000002,"5min":2.5049999999999999,"15min":2.7850000000000001},"last":1.599},{"interface":"front","average":{"1min":1.494,"5min":1.55,"15min":1.512},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.67900000000000005},"max":{"1min":2.1989999999999998,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.3169999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.571,"15min":1.593},"min":{"1min":1.2569999999999999,"5min":0.95099999999999996,"15min":0.59599999999999997},"max":{"1min":2.0329999999999999,"5min":2.4489999999999998,"15min":2.7629999999999999},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.641,"5min":1.6799999999999999,"15min":1.6639999999999999},"min":{"1min":1.2190000000000001,"5min":1.097,"15min":0.98199999999999998},"max":{"1min":2.29,"5min":2.5979999999999999,"15min":2.867},"last":1.6499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509823,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60424,"kb_used_data":11200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311416,"statfs":{"total":96636764160,"available":96574889984,"internally_reserved":0,"allocated":11468800,"data_stored":12460713,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0900000000000001,"15min":1.1739999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.444,"5min":2.2410000000000001,"15min":2.5800000000000001},"last":0.751},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.147,"15min":1.2549999999999999},"min":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.587,"5min":2.6600000000000001,"15min":3.0259999999999998},"last":0.81899999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.266,"15min":1.345},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.44500000000000001},"max":{"1min":1.393,"5min":2.964,"15min":2.964},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.5129999999999999,"15min":1.5600000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.6990000000000001,"5min":3.056,"15min":3.1779999999999999},"last":1.5880000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.522,"15min":1.6499999999999999},"min":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.52700000000000002},"max":{"1min":1.929,"5min":2.996,"15min":3.5310000000000001},"last":1.254},{"interface":"front","average":{"1min":1.353,"5min":1.6020000000000001,"15min":1.718},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1139999999999999,"5min":3.1659999999999999,"15min":3.2799999999999998},"last":1.085}]},{"osd":4,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.452,"15min":1.5429999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6200000000000001,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.5620000000000001,"15min":1.6359999999999999},"min":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.76900000000000002},"max":{"1min":1.996,"5min":2.7679999999999998,"15min":2.9550000000000001},"last":1.4830000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.625,"15min":1.7270000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0169999999999999,"5min":3.52,"15min":3.52},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.595,"15min":1.6639999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.64600000000000002},"max":{"1min":1.8460000000000001,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.758}]},{"osd":6,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.712,"15min":1.7789999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.72199999999999998},"max":{"1min":2.0179999999999998,"5min":2.9860000000000002,"15min":3.1000000000000001},"last":1.71},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.736,"15min":1.849},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.85799999999999998},"max":{"1min":2.1240000000000001,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.8109999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.7190000000000001,"15min":1.8009999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.75},"max":{"1min":1.958,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.649},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.8600000000000001,"15min":1.917},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":0.66800000000000004},"max":{"1min":2.1179999999999999,"5min":2.8380000000000001,"15min":3.2330000000000001},"last":1.871}]}]},{"osd":2,"up_from":15,"seq":64424509824,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":2719744,"data_stored":3036308,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.034,"15min":1.0680000000000001},"min":{"1min":0.71499999999999997,"5min":0.437,"15min":0.437},"max":{"1min":1.47,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.204},{"interface":"front","average":{"1min":1.181,"5min":1.3169999999999999,"15min":1.3740000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.9319999999999999,"5min":3.1179999999999999,"15min":3.702},"last":1.647}]},{"osd":1,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.407,"15min":1.4490000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.744,"5min":2.4889999999999999,"15min":2.738},"last":1.462},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4730000000000001,"15min":1.542},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9710000000000001,"5min":2.9340000000000002,"15min":3.0819999999999999},"last":1.083}]},{"osd":3,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.528,"15min":1.55},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.853,"5min":2.9199999999999999,"15min":3.0019999999999998},"last":1.012},{"interface":"front","average":{"1min":1.464,"5min":1.633,"15min":1.696},"min":{"1min":1.0389999999999999,"5min":0.76300000000000001,"15min":0.58099999999999996},"max":{"1min":1.7849999999999999,"5min":2.734,"15min":2.9420000000000002},"last":1.2889999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.605,"15min":1.6459999999999999},"min":{"1min":1.175,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.915,"5min":2.6859999999999999,"15min":3.0710000000000002},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.603,"15min":1.643},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.1640000000000001,"5min":2.363,"15min":3.54},"last":1.375}]},{"osd":5,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.647,"15min":1.627},"min":{"1min":1.002,"5min":1.002,"15min":0.71199999999999997},"max":{"1min":1.7350000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.161},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.7010000000000001,"15min":1.76},"min":{"1min":1.2989999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.004,"5min":2.8079999999999998,"15min":3.2589999999999999},"last":1.607}]},{"osd":6,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.75,"15min":1.8},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.3069999999999999,"5min":2.6070000000000002,"15min":3.6259999999999999},"last":1.508},{"interface":"front","average":{"1min":1.506,"5min":1.7390000000000001,"15min":1.762},"min":{"1min":1.135,"5min":1.135,"15min":0.877},"max":{"1min":1.9790000000000001,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.3320000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.798,"15min":1.8740000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.3839999999999999,"5min":2.6829999999999998,"15min":3.7839999999999998},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.8220000000000001,"15min":1.8580000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.89200000000000002},"max":{"1min":2.052,"5min":2.6680000000000001,"15min":2.8490000000000002},"last":1.425}]}]},{"osd":0,"up_from":15,"seq":64424509824,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":376832,"data_stored":711308,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0529999999999999,"15min":1.1259999999999999},"min":{"1min":0.72099999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.843,"5min":2.012,"15min":3.1960000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.319,"15min":1.3720000000000001},"min":{"1min":0.78100000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.452,"5min":2.7789999999999999,"15min":2.9929999999999999},"last":1.3660000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3009999999999999,"15min":1.4790000000000001},"min":{"1min":0.83099999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.825,"5min":2.27,"15min":2.8359999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.468,"15min":1.556},"min":{"1min":0.92500000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0049999999999999,"5min":2.8769999999999998,"15min":3.3450000000000002},"last":1.127}]},{"osd":3,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.3360000000000001,"15min":1.5569999999999999},"min":{"1min":0.61499999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.627,"5min":2.3599999999999999,"15min":4.6660000000000004},"last":1.036},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.5980000000000001,"15min":1.7729999999999999},"min":{"1min":1.113,"5min":0.75600000000000001,"15min":0.73599999999999999},"max":{"1min":1.895,"5min":2.6850000000000001,"15min":3.2829999999999999},"last":1.415}]},{"osd":4,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.5329999999999999,"15min":1.657},"min":{"1min":1.165,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.7889999999999999,"5min":2.5830000000000002,"15min":4.5739999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.6319999999999999,"15min":1.7},"min":{"1min":1.1970000000000001,"5min":0.89200000000000002,"15min":0.79700000000000004},"max":{"1min":1.8160000000000001,"5min":2.544,"15min":3.1890000000000001},"last":1.262}]},{"osd":5,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.665,"15min":1.7250000000000001},"min":{"1min":1.2769999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.048,"5min":3.1480000000000001,"15min":3.5430000000000001},"last":1.575},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.6200000000000001,"15min":1.7450000000000001},"min":{"1min":1.208,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9410000000000001,"5min":2.6389999999999998,"15min":4.3730000000000002},"last":1.3129999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.7390000000000001,"15min":1.843},"min":{"1min":1.254,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0680000000000001,"5min":2.8290000000000002,"15min":3.399},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.7709999999999999,"15min":1.831},"min":{"1min":1.2070000000000001,"5min":1.014,"15min":0.86299999999999999},"max":{"1min":2.1339999999999999,"5min":3.0649999999999999,"15min":3.46},"last":1.446}]},{"osd":7,"last update":"Mon Oct 16 20:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.8580000000000001,"15min":1.9450000000000001},"min":{"1min":1.129,"5min":1.129,"15min":1.1000000000000001},"max":{"1min":2.1920000000000002,"5min":3.21,"15min":3.6160000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.7529999999999999,"15min":1.8819999999999999},"min":{"1min":1.456,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.0529999999999999,"5min":2.7829999999999999,"15min":4.4820000000000002},"last":1.4670000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542528,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42656,"kb_used_data":3160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329184,"statfs":{"total":96636764160,"available":96593084416,"internally_reserved":0,"allocated":3235840,"data_stored":3421055,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.1970000000000001},"min":{"1min":0.83099999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.8120000000000001,"5min":1.972,"15min":2.5649999999999999},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3220000000000001,"15min":1.3100000000000001},"min":{"1min":0.80000000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.5800000000000001,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.349}]},{"osd":1,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.389,"15min":1.343},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9390000000000001,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":1.641},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.421,"15min":1.3640000000000001},"min":{"1min":0.82999999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.728,"5min":17.715,"15min":17.715},"last":1.458}]},{"osd":2,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4059999999999999,"15min":1.405},"min":{"1min":1.0820000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8520000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.042},{"interface":"front","average":{"1min":1.389,"5min":1.3540000000000001,"15min":1.375},"min":{"1min":0.99099999999999999,"5min":0.90000000000000002,"15min":0.80600000000000005},"max":{"1min":1.7390000000000001,"5min":2.1640000000000001,"15min":2.3460000000000001},"last":1.292}]},{"osd":3,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.472,"15min":1.468},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8129999999999999,"5min":8.2469999999999999,"15min":8.2469999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5800000000000001,"15min":1.5549999999999999},"min":{"1min":1.2589999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.907,"5min":8.2769999999999992,"15min":8.2769999999999992},"last":1.3799999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.3440000000000001,"15min":1.341},"min":{"1min":0.96599999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.897,"5min":2.0249999999999999,"15min":2.3900000000000001},"last":1.135},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.5049999999999999,"15min":1.462},"min":{"1min":0.91000000000000003,"5min":0.81000000000000005,"15min":0.68500000000000005},"max":{"1min":1.8520000000000001,"5min":8.1869999999999994,"15min":8.1869999999999994},"last":1.7070000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.506,"15min":1.462},"min":{"1min":1.097,"5min":1.0429999999999999,"15min":0.76200000000000001},"max":{"1min":1.879,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.228},{"interface":"front","average":{"1min":1.536,"5min":1.5269999999999999,"15min":1.53},"min":{"1min":1.052,"5min":0.94099999999999995,"15min":0.93700000000000006},"max":{"1min":1.9510000000000001,"5min":2.512,"15min":2.601},"last":1.49}]},{"osd":7,"last update":"Mon Oct 16 20:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.6479999999999999,"15min":1.5920000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.86299999999999999},"max":{"1min":2.0960000000000001,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.732,"15min":1.665},"min":{"1min":1.446,"5min":1.145,"15min":0.999},"max":{"1min":1.998,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.577}]}]},{"osd":1,"up_from":14,"seq":60129542528,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2048000,"data_stored":2532532,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.1240000000000001,"15min":1.173},"min":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.373},"max":{"1min":1.3260000000000001,"5min":2.944,"15min":2.944},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1830000000000001,"15min":1.294},"min":{"1min":0.72899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.657,"5min":2.2050000000000001,"15min":3.2909999999999999},"last":1.1559999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.335,"15min":1.395},"min":{"1min":0.81999999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8560000000000001,"5min":2.835,"15min":3.585},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.484,"15min":1.5660000000000001},"min":{"1min":0.96799999999999997,"5min":0.60899999999999999,"15min":0.59999999999999998},"max":{"1min":1.8680000000000001,"5min":2.6659999999999999,"15min":2.8719999999999999},"last":1.2549999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.6240000000000001,"15min":1.6950000000000001},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.63},"max":{"1min":1.9319999999999999,"5min":2.831,"15min":3.3740000000000001},"last":1.341},{"interface":"front","average":{"1min":1.393,"5min":1.5149999999999999,"15min":1.5760000000000001},"min":{"1min":0.88800000000000001,"5min":0.53800000000000003,"15min":0.51200000000000001},"max":{"1min":2.0030000000000001,"5min":2.8370000000000002,"15min":3.234},"last":1.288}]},{"osd":4,"last update":"Mon Oct 16 20:11:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":1.03,"5min":0.75800000000000001,"15min":0.71499999999999997},"max":{"1min":1.7629999999999999,"5min":3.1080000000000001,"15min":3.7349999999999999},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.631,"15min":1.6699999999999999},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.78700000000000003},"max":{"1min":1.8009999999999999,"5min":2.6269999999999998,"15min":3.1419999999999999},"last":1.5089999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.581,"15min":1.647},"min":{"1min":1.153,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.6499999999999999,"5min":2.9289999999999998,"15min":3.0249999999999999},"last":1.385},{"interface":"front","average":{"1min":1.478,"5min":1.679,"15min":1.7370000000000001},"min":{"1min":1.087,"5min":0.96299999999999997,"15min":0.77400000000000002},"max":{"1min":1.804,"5min":3.2170000000000001,"15min":3.819},"last":1.6479999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.722,"15min":1.802},"min":{"1min":1.1879999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.929,"5min":2.9950000000000001,"15min":3.8730000000000002},"last":1.819},{"interface":"front","average":{"1min":1.621,"5min":1.778,"15min":1.829},"min":{"1min":1.337,"5min":0.878,"15min":0.746},"max":{"1min":2.0600000000000001,"5min":2.698,"15min":3.3210000000000002},"last":1.4359999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.7070000000000001,"15min":1.8120000000000001},"min":{"1min":1.254,"5min":0.96199999999999997,"15min":0.95099999999999996},"max":{"1min":1.8109999999999999,"5min":3.0579999999999998,"15min":3.1379999999999999},"last":2.0209999999999999},{"interface":"front","average":{"1min":1.665,"5min":1.869,"15min":1.9419999999999999},"min":{"1min":1.3819999999999999,"5min":1.052,"15min":0.96299999999999997},"max":{"1min":1.952,"5min":3.3239999999999998,"15min":3.923},"last":1.9399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32889,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":24912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":2436504,"data_compressed":203464,"data_compressed_allocated":335872,"data_compressed_original":1007616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2461696,"data_stored":2940280,"data_compressed":178308,"data_compressed_allocated":299008,"data_compressed_original":806912,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11210752,"data_stored":12364685,"data_compressed":414519,"data_compressed_allocated":716800,"data_compressed_original":1896448,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":3325027,"data_compressed":123286,"data_compressed_allocated":208896,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":5380550,"data_compressed":381772,"data_compressed_allocated":634880,"data_compressed_original":1814528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":7546531,"data_compressed":201145,"data_compressed_allocated":348160,"data_compressed_original":942080,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":8122707,"data_compressed":336660,"data_compressed_allocated":577536,"data_compressed_original":1536000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:12:19.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-16T20:12:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.279+0000 7fef2d010640 1 Processor -- start 2023-10-16T20:12:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.279+0000 7fef2d010640 1 -- start start 2023-10-16T20:12:19.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.281+0000 7fef2d010640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef28157750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:19.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.281+0000 7fef2d010640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef2815a4c0 0x7fef2815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:19.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.281+0000 7fef2d010640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2806d460 con 0x7fef2806e150 2023-10-16T20:12:19.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.281+0000 7fef2d010640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2815ae30 con 0x7fef2815a4c0 2023-10-16T20:12:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.281+0000 7fef2d010640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2806d690 con 0x7fef28150da0 2023-10-16T20:12:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.282+0000 7fef2659c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fef2806e150 0x7fef280c3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47564/0 (socket says 172.21.15.57:47564) 2023-10-16T20:12:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.282+0000 7fef2659c640 1 -- 172.21.15.57:0/3364146931 learned_addr learned my addr 172.21.15.57:0/3364146931 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:12:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.283+0000 7fef2759e640 1 --2- 172.21.15.57:0/3364146931 >> v2:172.21.15.110:3300/0 conn(0x7fef2815a4c0 0x7fef2815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.283+0000 7fef26d9d640 1 --2- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef28157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.286+0000 7fef25d9b640 1 -- 172.21.15.57:0/3364146931 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790830343 0 0) 0x7fef2806d460 con 0x7fef2806e150 2023-10-16T20:12:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.286+0000 7fef25d9b640 1 -- 172.21.15.57:0/3364146931 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef10003520 con 0x7fef2806e150 2023-10-16T20:12:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.290+0000 7fef2759e640 1 -- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 msgr2=0x7fef28157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.290+0000 7fef2759e640 1 --2- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef28157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.290+0000 7fef2759e640 1 -- 172.21.15.57:0/3364146931 >> v1:172.21.15.57:6789/0 conn(0x7fef2806e150 legacy=0x7fef280c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.290+0000 7fef2759e640 1 -- 172.21.15.57:0/3364146931 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280c5490 con 0x7fef2815a4c0 2023-10-16T20:12:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.295+0000 7fef2759e640 1 --2- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2815a4c0 0x7fef2815a8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef20009d90 tx=0x7fef2002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a2d010a9894c7b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.306+0000 7fef25d9b640 1 -- 172.21.15.57:0/3364146931 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2002cc50 con 0x7fef2815a4c0 2023-10-16T20:12:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.306+0000 7fef25d9b640 1 -- 172.21.15.57:0/3364146931 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2002cdb0 con 0x7fef2815a4c0 2023-10-16T20:12:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.306+0000 7fef25d9b640 1 -- 172.21.15.57:0/3364146931 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20034660 con 0x7fef2815a4c0 2023-10-16T20:12:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 -- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2815a4c0 msgr2=0x7fef2815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 --2- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2815a4c0 0x7fef2815a8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef20009d90 tx=0x7fef2002bea0 comp rx=0 tx=0).stop 2023-10-16T20:12:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 -- 172.21.15.57:0/3364146931 shutdown_connections 2023-10-16T20:12:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 --2- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2815a4c0 0x7fef2815a8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 --2- 172.21.15.57:0/3364146931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef28157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 -- 172.21.15.57:0/3364146931 >> 172.21.15.57:0/3364146931 conn(0x7fef280c6ea0 msgr2=0x7fef280c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 -- 172.21.15.57:0/3364146931 shutdown_connections 2023-10-16T20:12:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.307+0000 7fef2d010640 1 -- 172.21.15.57:0/3364146931 wait complete. 2023-10-16T20:12:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.310+0000 7fef2d010640 1 Processor -- start 2023-10-16T20:12:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.310+0000 7fef2d010640 1 -- start start 2023-10-16T20:12:19.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.312+0000 7fef2d010640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2806e150 0x7fef280c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:19.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.312+0000 7fef2d010640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef280c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:19.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.312+0000 7fef2d010640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 0x7fef281eded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:19.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.312+0000 7fef2d010640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28157260 con 0x7fef2815a4c0 2023-10-16T20:12:19.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.312+0000 7fef2d010640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef281576f0 con 0x7fef2806e150 2023-10-16T20:12:19.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.312+0000 7fef2d010640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280c2310 con 0x7fef28150da0 2023-10-16T20:12:19.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.313+0000 7fef2759e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 0x7fef281eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:19.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.314+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2806e150 0x7fef280c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:19.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.314+0000 7fef2659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef280c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:19.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.314+0000 7fef2759e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 0x7fef281eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34376/0 (socket says 172.21.15.57:34376) 2023-10-16T20:12:19.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.314+0000 7fef2759e640 1 -- 172.21.15.57:0/3098542422 learned_addr learned my addr 172.21.15.57:0/3098542422 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:19.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.323+0000 7fef2759e640 1 -- 172.21.15.57:0/3098542422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 msgr2=0x7fef280c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:19.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.323+0000 7fef2759e640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef280c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:19.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.323+0000 7fef2759e640 1 -- 172.21.15.57:0/3098542422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2806e150 msgr2=0x7fef280c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:19.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.323+0000 7fef2759e640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2806e150 0x7fef280c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:19.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.324+0000 7fef2759e640 1 -- 172.21.15.57:0/3098542422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20009a70 con 0x7fef2815a4c0 2023-10-16T20:12:19.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.327+0000 7fef2759e640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 0x7fef281eded0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef20009eb0 tx=0x7fef20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:19.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.332+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20040650 con 0x7fef2815a4c0 2023-10-16T20:12:19.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.332+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef200407b0 con 0x7fef2815a4c0 2023-10-16T20:12:19.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.332+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20040b60 con 0x7fef2815a4c0 2023-10-16T20:12:19.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.333+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef28154f20 con 0x7fef2815a4c0 2023-10-16T20:12:19.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.333+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef28156c10 con 0x7fef2815a4c0 2023-10-16T20:12:19.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.334+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef28157410 con 0x7fef2815a4c0 2023-10-16T20:12:19.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.358+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fef20040cc0 con 0x7fef2815a4c0 2023-10-16T20:12:19.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.359+0000 7fef0f7fe640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fef1406aec0 0x7fef1406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.360+0000 7fef26d9d640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fef1406aec0 0x7fef1406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.362+0000 7fef26d9d640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fef1406aec0 0x7fef1406d380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef18009b40 tx=0x7fef18009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:19.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.362+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fef2007b430 con 0x7fef2815a4c0 2023-10-16T20:12:19.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.643+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef20077770 con 0x7fef2815a4c0 2023-10-16T20:12:19.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:19.839+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fef28157410 con 0x7fef2815a4c0 2023-10-16T20:12:20.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.219+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fef28157410 con 0x7fef2815a4c0 2023-10-16T20:12:20.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.219+0000 7fef0f7fe640 1 -- 172.21.15.57:0/3098542422 <== mon.0 v2:172.21.15.57:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fef20077770 con 0x7fef2815a4c0 2023-10-16T20:12:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.223+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fef1406aec0 msgr2=0x7fef1406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.223+0000 7fef2d010640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fef1406aec0 0x7fef1406d380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef18009b40 tx=0x7fef18009190 comp rx=0 tx=0).stop 2023-10-16T20:12:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.223+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 msgr2=0x7fef281eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:20.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.223+0000 7fef2d010640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 0x7fef281eded0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef20009eb0 tx=0x7fef20004a40 comp rx=0 tx=0).stop 2023-10-16T20:12:20.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 shutdown_connections 2023-10-16T20:12:20.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fef1406aec0 0x7fef1406d380 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef2815a4c0 0x7fef281eded0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef28150da0 0x7fef280c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 --2- 172.21.15.57:0/3098542422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef2806e150 0x7fef280c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 >> 172.21.15.57:0/3098542422 conn(0x7fef280c6ea0 msgr2=0x7fef280c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 shutdown_connections 2023-10-16T20:12:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.224+0000 7fef2d010640 1 -- 172.21.15.57:0/3098542422 wait complete. 2023-10-16T20:12:20.251 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T20:12:20.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:12:20.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.482+0000 7fba7638a640 1 Processor -- start 2023-10-16T20:12:20.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.482+0000 7fba7638a640 1 -- start start 2023-10-16T20:12:20.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.484+0000 7fba7638a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba70156690 0x7fba700cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:20.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.484+0000 7fba7638a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7006bb30 con 0x7fba700c8c00 2023-10-16T20:12:20.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.484+0000 7fba7638a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700c7a80 con 0x7fba7006b600 2023-10-16T20:12:20.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.484+0000 7fba7638a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba700c7d40 con 0x7fba70156690 2023-10-16T20:12:20.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.487+0000 7fba74927640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fba7006b600 0x7fba7015c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:43968/0 (socket says 172.21.15.57:43968) 2023-10-16T20:12:20.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.487+0000 7fba74927640 1 -- 172.21.15.57:0/900420568 learned_addr learned my addr 172.21.15.57:0/900420568 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:12:20.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.487+0000 7fba6ffff640 1 --2- 172.21.15.57:0/900420568 >> v2:172.21.15.110:3300/0 conn(0x7fba70156690 0x7fba700cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:20.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.500+0000 7fba6ffff640 1 -- 172.21.15.57:0/900420568 >> v1:172.21.15.110:6789/0 conn(0x7fba7006b600 legacy=0x7fba7015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:20.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.500+0000 7fba6ffff640 1 -- 172.21.15.57:0/900420568 >> v1:172.21.15.57:6789/0 conn(0x7fba700c8c00 legacy=0x7fba7006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:20.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.500+0000 7fba6ffff640 1 -- 172.21.15.57:0/900420568 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700c8020 con 0x7fba70156690 2023-10-16T20:12:20.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.509+0000 7fba6ffff640 1 --2- 172.21.15.57:0/900420568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 0x7fba700cc6e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba600097a0 tx=0x7fba6002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73befa58af51660d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.520+0000 7fba6f7fe640 1 -- 172.21.15.57:0/900420568 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6002f050 con 0x7fba70156690 2023-10-16T20:12:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.520+0000 7fba6f7fe640 1 -- 172.21.15.57:0/900420568 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fba60031700 con 0x7fba70156690 2023-10-16T20:12:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.520+0000 7fba6f7fe640 1 -- 172.21.15.57:0/900420568 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60031ab0 con 0x7fba70156690 2023-10-16T20:12:20.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.521+0000 7fba7638a640 1 -- 172.21.15.57:0/900420568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 msgr2=0x7fba700cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:20.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.521+0000 7fba7638a640 1 --2- 172.21.15.57:0/900420568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 0x7fba700cc6e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba600097a0 tx=0x7fba6002b7a0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.521+0000 7fba7638a640 1 -- 172.21.15.57:0/900420568 shutdown_connections 2023-10-16T20:12:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.521+0000 7fba7638a640 1 --2- 172.21.15.57:0/900420568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 0x7fba700cc6e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.521+0000 7fba7638a640 1 -- 172.21.15.57:0/900420568 >> 172.21.15.57:0/900420568 conn(0x7fba700659d0 msgr2=0x7fba70065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.522+0000 7fba7638a640 1 -- 172.21.15.57:0/900420568 shutdown_connections 2023-10-16T20:12:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.522+0000 7fba7638a640 1 -- 172.21.15.57:0/900420568 wait complete. 2023-10-16T20:12:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.524+0000 7fba7638a640 1 Processor -- start 2023-10-16T20:12:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.525+0000 7fba7638a640 1 -- start start 2023-10-16T20:12:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.526+0000 7fba7638a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba7006b600 0x7fba700c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.526+0000 7fba7638a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 0x7fba700c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.526+0000 7fba7638a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 0x7fba7015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.526+0000 7fba7638a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700c5cc0 con 0x7fba700c8c00 2023-10-16T20:12:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.526+0000 7fba7638a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700c4720 con 0x7fba70156690 2023-10-16T20:12:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.526+0000 7fba7638a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7015a430 con 0x7fba7006b600 2023-10-16T20:12:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.527+0000 7fba67fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 0x7fba700c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.527+0000 7fba67fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 0x7fba700c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34384/0 (socket says 172.21.15.57:34384) 2023-10-16T20:12:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.527+0000 7fba67fff640 1 -- 172.21.15.57:0/1752776830 learned_addr learned my addr 172.21.15.57:0/1752776830 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.532+0000 7fba67fff640 1 -- 172.21.15.57:0/1752776830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba7006b600 msgr2=0x7fba700c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.532+0000 7fba67fff640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba7006b600 0x7fba700c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.532+0000 7fba67fff640 1 -- 172.21.15.57:0/1752776830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 msgr2=0x7fba7015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.532+0000 7fba67fff640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 0x7fba7015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.532+0000 7fba67fff640 1 -- 172.21.15.57:0/1752776830 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60009400 con 0x7fba700c8c00 2023-10-16T20:12:20.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.535+0000 7fba67fff640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 0x7fba700c3010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c410 tx=0x7fba5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:20.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.540+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba580035f0 con 0x7fba700c8c00 2023-10-16T20:12:20.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.540+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fba58003750 con 0x7fba700c8c00 2023-10-16T20:12:20.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.540+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58003b60 con 0x7fba700c8c00 2023-10-16T20:12:20.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.541+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba700c49c0 con 0x7fba700c8c00 2023-10-16T20:12:20.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.541+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7015a6d0 con 0x7fba700c8c00 2023-10-16T20:12:20.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.542+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7015a8f0 con 0x7fba700c8c00 2023-10-16T20:12:20.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.853+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fba58003cc0 con 0x7fba700c8c00 2023-10-16T20:12:20.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.854+0000 7fba6d7fa640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fba5006aec0 0x7fba5006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:20.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.855+0000 7fba6ffff640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fba5006aec0 0x7fba5006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:20.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.857+0000 7fba6ffff640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fba5006aec0 0x7fba5006d380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba60035000 tx=0x7fba60030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.919+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fba58058650 con 0x7fba700c8c00 2023-10-16T20:12:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:20.919+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba58054290 con 0x7fba700c8c00 2023-10-16T20:12:21.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.169+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba7004e1d0 con 0x7fba700c8c00 2023-10-16T20:12:21.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.209+0000 7fba6d7fa640 1 -- 172.21.15.57:0/1752776830 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+6552 (secure 0 0 0) 0x7fba58017070 con 0x7fba700c8c00 2023-10-16T20:12:21.213 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:12:21.213 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":84,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:40:59.056046+0000","modified":"2023-10-16T20:12:05.389046+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4250,"mds_1":4247,"mds_2":4244,"mds_3":4231,"mds_4":4224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4224":{"gid":4224,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4231":{"gid":4231,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"d","rank":1,"incarnation":8,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:12:21.214 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 84 2023-10-16T20:12:21.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.212+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fba5006aec0 msgr2=0x7fba5006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.212+0000 7fba7638a640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fba5006aec0 0x7fba5006d380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba60035000 tx=0x7fba60030000 comp rx=0 tx=0).stop 2023-10-16T20:12:21.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.212+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 msgr2=0x7fba700c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.212+0000 7fba7638a640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 0x7fba700c3010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c410 tx=0x7fba5800c8d0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 shutdown_connections 2023-10-16T20:12:21.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fba5006aec0 0x7fba5006d380 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70156690 0x7fba7015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba700c8c00 0x7fba700c3010 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 --2- 172.21.15.57:0/1752776830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba7006b600 0x7fba700c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 >> 172.21.15.57:0/1752776830 conn(0x7fba700659d0 msgr2=0x7fba70065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:21.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 shutdown_connections 2023-10-16T20:12:21.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.213+0000 7fba7638a640 1 -- 172.21.15.57:0/1752776830 wait complete. 2023-10-16T20:12:21.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:12:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.460+0000 7fdc0b66f640 1 Processor -- start 2023-10-16T20:12:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.460+0000 7fdc0b66f640 1 -- start start 2023-10-16T20:12:21.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.462+0000 7fdc0b66f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdc040c77c0 0x7fdc040c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:21.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.462+0000 7fdc0b66f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0406a7b0 con 0x7fdc040c7c10 2023-10-16T20:12:21.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.462+0000 7fdc0b66f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc04071db0 con 0x7fdc04150f50 2023-10-16T20:12:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.462+0000 7fdc0b66f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc04072090 con 0x7fdc040c77c0 2023-10-16T20:12:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.464+0000 7fdc0940b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdc04150f50 0x7fdc04071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:43976/0 (socket says 172.21.15.57:43976) 2023-10-16T20:12:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.464+0000 7fdc0940b640 1 -- 172.21.15.57:0/3733448222 learned_addr learned my addr 172.21.15.57:0/3733448222 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:12:21.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.548+0000 7fdc08c0a640 1 --2- 172.21.15.57:0/3733448222 >> v2:172.21.15.57:3300/0 conn(0x7fdc040c77c0 0x7fdc040c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:21.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.558+0000 7fdc08c0a640 1 -- 172.21.15.57:0/3733448222 >> v1:172.21.15.110:6789/0 conn(0x7fdc04150f50 legacy=0x7fdc04071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.558+0000 7fdc08c0a640 1 -- 172.21.15.57:0/3733448222 >> v1:172.21.15.57:6789/0 conn(0x7fdc040c7c10 legacy=0x7fdc04156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.558+0000 7fdc08c0a640 1 -- 172.21.15.57:0/3733448222 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04069e80 con 0x7fdc040c77c0 2023-10-16T20:12:21.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.567+0000 7fdc08c0a640 1 --2- 172.21.15.57:0/3733448222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc040c77c0 0x7fdc040c4c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40097a0 tx=0x7fdbf402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce0cfd4635736cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:21.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.580+0000 7fdbfbfff640 1 -- 172.21.15.57:0/3733448222 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf402f810 con 0x7fdc040c77c0 2023-10-16T20:12:21.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.580+0000 7fdbfbfff640 1 -- 172.21.15.57:0/3733448222 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdbf402f970 con 0x7fdc040c77c0 2023-10-16T20:12:21.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.580+0000 7fdbfbfff640 1 -- 172.21.15.57:0/3733448222 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf402fd20 con 0x7fdc040c77c0 2023-10-16T20:12:21.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.582+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3733448222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc040c77c0 msgr2=0x7fdc040c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.582+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3733448222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc040c77c0 0x7fdc040c4c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40097a0 tx=0x7fdbf402b9f0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.582+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3733448222 shutdown_connections 2023-10-16T20:12:21.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.582+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3733448222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc040c77c0 0x7fdc040c4c40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.582+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3733448222 >> 172.21.15.57:0/3733448222 conn(0x7fdc0406e970 msgr2=0x7fdc0406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:21.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.583+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3733448222 shutdown_connections 2023-10-16T20:12:21.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.583+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3733448222 wait complete. 2023-10-16T20:12:21.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.586+0000 7fdc0b66f640 1 Processor -- start 2023-10-16T20:12:21.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.586+0000 7fdc0b66f640 1 -- start start 2023-10-16T20:12:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.588+0000 7fdc0b66f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040c77c0 0x7fdc041559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.588+0000 7fdc0b66f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc040c7c10 0x7fdc04157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.588+0000 7fdc0b66f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 0x7fdc04140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.588+0000 7fdc0b66f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04144f50 con 0x7fdc04150f50 2023-10-16T20:12:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.588+0000 7fdc0b66f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041f1ef0 con 0x7fdc040c77c0 2023-10-16T20:12:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.588+0000 7fdc0b66f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04151770 con 0x7fdc040c7c10 2023-10-16T20:12:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.589+0000 7fdc09c0c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 0x7fdc04140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.590+0000 7fdc09c0c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 0x7fdc04140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34398/0 (socket says 172.21.15.57:34398) 2023-10-16T20:12:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.590+0000 7fdc09c0c640 1 -- 172.21.15.57:0/3421153603 learned_addr learned my addr 172.21.15.57:0/3421153603 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.598+0000 7fdc09c0c640 1 -- 172.21.15.57:0/3421153603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc040c7c10 msgr2=0x7fdc04157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.598+0000 7fdc09c0c640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc040c7c10 0x7fdc04157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.598+0000 7fdc09c0c640 1 -- 172.21.15.57:0/3421153603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040c77c0 msgr2=0x7fdc041559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.598+0000 7fdc09c0c640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040c77c0 0x7fdc041559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.598+0000 7fdc09c0c640 1 -- 172.21.15.57:0/3421153603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009400 con 0x7fdc04150f50 2023-10-16T20:12:21.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.603+0000 7fdc09c0c640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 0x7fdc04140f00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00c7a0 tx=0x7fdbfc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:21.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.611+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc003b70 con 0x7fdc04150f50 2023-10-16T20:12:21.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.611+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdbfc003cf0 con 0x7fdc04150f50 2023-10-16T20:12:21.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.611+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc003ea0 con 0x7fdc04150f50 2023-10-16T20:12:21.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.611+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc04151a50 con 0x7fdc04150f50 2023-10-16T20:12:21.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.612+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc04152010 con 0x7fdc04150f50 2023-10-16T20:12:21.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.613+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0404e1d0 con 0x7fdc04150f50 2023-10-16T20:12:21.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.641+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdbfc00aab0 con 0x7fdc04150f50 2023-10-16T20:12:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.643+0000 7fdbf9ffb640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdbe806aec0 0x7fdbe806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:21.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.643+0000 7fdc0940b640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdbe806aec0 0x7fdbe806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.645+0000 7fdc0940b640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdbe806aec0 0x7fdbe806d380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc00001550 tx=0x7fdc00007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:21.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.981+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdbfc059390 con 0x7fdc04150f50 2023-10-16T20:12:21.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:21.982+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbfc054fd0 con 0x7fdc04150f50 2023-10-16T20:12:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.239+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc041f2030 con 0x7fdc04150f50 2023-10-16T20:12:22.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.331+0000 7fdbf9ffb640 1 -- 172.21.15.57:0/3421153603 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+6551 (secure 0 0 0) 0x7fdbfc0585f0 con 0x7fdc04150f50 2023-10-16T20:12:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:12:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":85,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/399256752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":399256752},{"type":"v1","addr":"172.21.15.110:6833","nonce":399256752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:40:59.056046+0000","modified":"2023-10-16T20:12:20.873659+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4250,"mds_1":4247,"mds_2":4244,"mds_3":4231,"mds_4":4224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4224":{"gid":4224,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6837/3832163679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3832163679},{"type":"v1","addr":"172.21.15.57:6837","nonce":3832163679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4231":{"gid":4231,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6839/465604076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":465604076},{"type":"v1","addr":"172.21.15.57:6839","nonce":465604076}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"f","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.110:6835/3004262175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3004262175},{"type":"v1","addr":"172.21.15.110:6835","nonce":3004262175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"d","rank":1,"incarnation":8,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6837/919279935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":919279935},{"type":"v1","addr":"172.21.15.110:6837","nonce":919279935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6835/1742562725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1742562725},{"type":"v1","addr":"172.21.15.57:6835","nonce":1742562725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:12:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 85 2023-10-16T20:12:22.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdbe806aec0 msgr2=0x7fdbe806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdbe806aec0 0x7fdbe806d380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc00001550 tx=0x7fdc00007a40 comp rx=0 tx=0).stop 2023-10-16T20:12:22.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 msgr2=0x7fdc04140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 0x7fdc04140f00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00c7a0 tx=0x7fdbfc00cc60 comp rx=0 tx=0).stop 2023-10-16T20:12:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 shutdown_connections 2023-10-16T20:12:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdbe806aec0 0x7fdbe806d380 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04150f50 0x7fdc04140f00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc040c7c10 0x7fdc04157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 --2- 172.21.15.57:0/3421153603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040c77c0 0x7fdc041559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 >> 172.21.15.57:0/3421153603 conn(0x7fdc0406e970 msgr2=0x7fdc04141c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 shutdown_connections 2023-10-16T20:12:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.335+0000 7fdc0b66f640 1 -- 172.21.15.57:0/3421153603 wait complete. 2023-10-16T20:12:22.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:12:22.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.583+0000 7fdb424a9640 1 Processor -- start 2023-10-16T20:12:22.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.583+0000 7fdb424a9640 1 -- start start 2023-10-16T20:12:22.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.585+0000 7fdb424a9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb3c151190 0x7fdb3c0c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:22.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.585+0000 7fdb424a9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3c151570 con 0x7fdb3c0c2aa0 2023-10-16T20:12:22.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.585+0000 7fdb424a9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3c0c5530 con 0x7fdb3c0c12f0 2023-10-16T20:12:22.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.585+0000 7fdb424a9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3c0c4010 con 0x7fdb3c151190 2023-10-16T20:12:22.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.586+0000 7fdb3bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb3c151190 0x7fdb3c0c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:22.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.586+0000 7fdb337fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdb3c0c12f0 0x7fdb3c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.57:43978/0 (socket says 172.21.15.57:43978) 2023-10-16T20:12:22.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.587+0000 7fdb337fe640 1 -- 172.21.15.57:0/2282032577 learned_addr learned my addr 172.21.15.57:0/2282032577 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-16T20:12:22.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.593+0000 7fdb3bfff640 1 -- 172.21.15.57:0/2282032577 >> v1:172.21.15.110:6789/0 conn(0x7fdb3c0c12f0 legacy=0x7fdb3c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.593+0000 7fdb3bfff640 1 -- 172.21.15.57:0/2282032577 >> v1:172.21.15.57:6789/0 conn(0x7fdb3c0c2aa0 legacy=0x7fdb3c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.593+0000 7fdb3bfff640 1 -- 172.21.15.57:0/2282032577 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c0c2f30 con 0x7fdb3c151190 2023-10-16T20:12:22.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.597+0000 7fdb3bfff640 1 --2- 172.21.15.57:0/2282032577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c0c2560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0097a0 tx=0x7fdb2c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76080e43bda2acf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:22.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.603+0000 7fdb3b7fe640 1 -- 172.21.15.57:0/2282032577 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c030610 con 0x7fdb3c151190 2023-10-16T20:12:22.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.603+0000 7fdb3b7fe640 1 -- 172.21.15.57:0/2282032577 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb2c030770 con 0x7fdb3c151190 2023-10-16T20:12:22.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.603+0000 7fdb3b7fe640 1 -- 172.21.15.57:0/2282032577 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c030b20 con 0x7fdb3c151190 2023-10-16T20:12:22.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 -- 172.21.15.57:0/2282032577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 msgr2=0x7fdb3c0c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2282032577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c0c2560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0097a0 tx=0x7fdb2c02b960 comp rx=0 tx=0).stop 2023-10-16T20:12:22.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 -- 172.21.15.57:0/2282032577 shutdown_connections 2023-10-16T20:12:22.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2282032577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c0c2560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 -- 172.21.15.57:0/2282032577 >> 172.21.15.57:0/2282032577 conn(0x7fdb3c06c430 msgr2=0x7fdb3c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:22.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 -- 172.21.15.57:0/2282032577 shutdown_connections 2023-10-16T20:12:22.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.604+0000 7fdb424a9640 1 -- 172.21.15.57:0/2282032577 wait complete. 2023-10-16T20:12:22.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.606+0000 7fdb424a9640 1 Processor -- start 2023-10-16T20:12:22.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.606+0000 7fdb424a9640 1 -- start start 2023-10-16T20:12:22.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.607+0000 7fdb424a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c0c12f0 0x7fdb3c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:22.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.607+0000 7fdb424a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c0c2aa0 0x7fdb3c0bd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:22.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.607+0000 7fdb424a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:22.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.607+0000 7fdb424a9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c1eeff0 con 0x7fdb3c151190 2023-10-16T20:12:22.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.607+0000 7fdb424a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c070920 con 0x7fdb3c0c12f0 2023-10-16T20:12:22.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.607+0000 7fdb424a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c070be0 con 0x7fdb3c0c2aa0 2023-10-16T20:12:22.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.608+0000 7fdb40a46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:22.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.608+0000 7fdb40a46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c14c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34418/0 (socket says 172.21.15.57:34418) 2023-10-16T20:12:22.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.608+0000 7fdb40a46640 1 -- 172.21.15.57:0/2774524036 learned_addr learned my addr 172.21.15.57:0/2774524036 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:22.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.609+0000 7fdb3bfff640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c0c12f0 0x7fdb3c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:22.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.612+0000 7fdb40a46640 1 -- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c0c2aa0 msgr2=0x7fdb3c0bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.612+0000 7fdb40a46640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c0c2aa0 0x7fdb3c0bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.612+0000 7fdb40a46640 1 -- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c0c12f0 msgr2=0x7fdb3c0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:22.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.612+0000 7fdb40a46640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c0c12f0 0x7fdb3c0700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:22.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.612+0000 7fdb40a46640 1 -- 172.21.15.57:0/2774524036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c009400 con 0x7fdb3c151190 2023-10-16T20:12:22.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.621+0000 7fdb40a46640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c14c100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb34001eb0 tx=0x7fdb3400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.626+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340052d0 con 0x7fdb3c151190 2023-10-16T20:12:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.626+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb34005430 con 0x7fdb3c151190 2023-10-16T20:12:22.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.626+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34003850 con 0x7fdb3c151190 2023-10-16T20:12:22.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.626+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3c1ee6c0 con 0x7fdb3c151190 2023-10-16T20:12:22.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.626+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c1eec80 con 0x7fdb3c151190 2023-10-16T20:12:22.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.628+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3c1eee40 con 0x7fdb3c151190 2023-10-16T20:12:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.655+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb340039b0 con 0x7fdb3c151190 2023-10-16T20:12:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.657+0000 7fdb397fa640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdb1c06aec0 0x7fdb1c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.657+0000 7fdb3bfff640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdb1c06aec0 0x7fdb1c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.659+0000 7fdb3bfff640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdb1c06aec0 0x7fdb1c06d380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c036000 tx=0x7fdb2c03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:22.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.959+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdb34057ef0 con 0x7fdb3c151190 2023-10-16T20:12:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:22.960+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb340541a0 con 0x7fdb3c151190 2023-10-16T20:12:23.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.172+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb3c04e1d0 con 0x7fdb3c151190 2023-10-16T20:12:23.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.275+0000 7fdb397fa640 1 -- 172.21.15.57:0/2774524036 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fdb34017020 con 0x7fdb3c151190 2023-10-16T20:12:23.280 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-16T20:12:23.280 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"ee1d7270-3118-4d78-b8fc-a1736155df58","created":"2023-10-16T19:40:15.510832+0000","modified":"2023-10-16T19:41:25.260005+0000","last_up_change":"2023-10-16T19:40:38.554307+0000","last_in_change":"2023-10-16T19:40:28.823925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:40:38.255594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:40:53.908842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:40:56.364727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"762285c5-2ff8-4f45-b0f8-10b8e78586c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6819","nonce":314169635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6821","nonce":314169635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6825","nonce":314169635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":314169635},{"type":"v1","addr":"172.21.15.57:6823","nonce":314169635}]},"public_addr":"172.21.15.57:6819/314169635","cluster_addr":"172.21.15.57:6821/314169635","heartbeat_back_addr":"172.21.15.57:6825/314169635","heartbeat_front_addr":"172.21.15.57:6823/314169635","state":["exists","up"]},{"osd":1,"uuid":"539d76b4-ff06-4b6c-8227-e959fa0a0c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6803","nonce":1525227707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6805","nonce":1525227707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6809","nonce":1525227707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1525227707},{"type":"v1","addr":"172.21.15.57:6807","nonce":1525227707}]},"public_addr":"172.21.15.57:6803/1525227707","cluster_addr":"172.21.15.57:6805/1525227707","heartbeat_back_addr":"172.21.15.57:6809/1525227707","heartbeat_front_addr":"172.21.15.57:6807/1525227707","state":["exists","up"]},{"osd":2,"uuid":"e331ee7e-ff19-4310-8f8a-dfb08faca3b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6811","nonce":3626764387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6813","nonce":3626764387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6817","nonce":3626764387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3626764387},{"type":"v1","addr":"172.21.15.57:6815","nonce":3626764387}]},"public_addr":"172.21.15.57:6811/3626764387","cluster_addr":"172.21.15.57:6813/3626764387","heartbeat_back_addr":"172.21.15.57:6817/3626764387","heartbeat_front_addr":"172.21.15.57:6815/3626764387","state":["exists","up"]},{"osd":3,"uuid":"984d0dec-e008-4711-b7ac-72ced09a9125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6827","nonce":1613164107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6829","nonce":1613164107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6833","nonce":1613164107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1613164107},{"type":"v1","addr":"172.21.15.57:6831","nonce":1613164107}]},"public_addr":"172.21.15.57:6827/1613164107","cluster_addr":"172.21.15.57:6829/1613164107","heartbeat_back_addr":"172.21.15.57:6833/1613164107","heartbeat_front_addr":"172.21.15.57:6831/1613164107","state":["exists","up"]},{"osd":4,"uuid":"c17b04f5-36fe-4505-be9c-dbacbdb01376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6801","nonce":1242957558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6803","nonce":1242957558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6807","nonce":1242957558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1242957558},{"type":"v1","addr":"172.21.15.110:6805","nonce":1242957558}]},"public_addr":"172.21.15.110:6801/1242957558","cluster_addr":"172.21.15.110:6803/1242957558","heartbeat_back_addr":"172.21.15.110:6807/1242957558","heartbeat_front_addr":"172.21.15.110:6805/1242957558","state":["exists","up"]},{"osd":5,"uuid":"3552ebce-4b2a-4228-bc88-d9a72abf1994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6809","nonce":3573598804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6813","nonce":3573598804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6825","nonce":3573598804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":3573598804},{"type":"v1","addr":"172.21.15.110:6818","nonce":3573598804}]},"public_addr":"172.21.15.110:6809/3573598804","cluster_addr":"172.21.15.110:6813/3573598804","heartbeat_back_addr":"172.21.15.110:6825/3573598804","heartbeat_front_addr":"172.21.15.110:6818/3573598804","state":["exists","up"]},{"osd":6,"uuid":"bce9b4db-90e0-44b0-942a-66d8019dd00b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6820","nonce":492622180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6826","nonce":492622180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6831","nonce":492622180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":492622180},{"type":"v1","addr":"172.21.15.110:6829","nonce":492622180}]},"public_addr":"172.21.15.110:6820/492622180","cluster_addr":"172.21.15.110:6826/492622180","heartbeat_back_addr":"172.21.15.110:6831/492622180","heartbeat_front_addr":"172.21.15.110:6829/492622180","state":["exists","up"]},{"osd":7,"uuid":"32e73410-d9ed-4c19-aba2-4e858be5f271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6812","nonce":3203439813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6817","nonce":3203439813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6827","nonce":3203439813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6819","nonce":3203439813},{"type":"v1","addr":"172.21.15.110:6821","nonce":3203439813}]},"public_addr":"172.21.15.110:6812/3203439813","cluster_addr":"172.21.15.110:6817/3203439813","heartbeat_back_addr":"172.21.15.110:6827/3203439813","heartbeat_front_addr":"172.21.15.110:6821/3203439813","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.499855+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.367111+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.644257+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.758727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.354743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.452209+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.482256+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:40:34.475573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:12:23.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdb1c06aec0 msgr2=0x7fdb1c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:23.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdb1c06aec0 0x7fdb1c06d380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c036000 tx=0x7fdb2c03b040 comp rx=0 tx=0).stop 2023-10-16T20:12:23.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 msgr2=0x7fdb3c14c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:23.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c14c100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb34001eb0 tx=0x7fdb3400c890 comp rx=0 tx=0).stop 2023-10-16T20:12:23.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 shutdown_connections 2023-10-16T20:12:23.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7fdb1c06aec0 0x7fdb1c06d380 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3c151190 0x7fdb3c14c100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb3c0c2aa0 0x7fdb3c0bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 --2- 172.21.15.57:0/2774524036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb3c0c12f0 0x7fdb3c0700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.279+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 >> 172.21.15.57:0/2774524036 conn(0x7fdb3c06c430 msgr2=0x7fdb3c157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:23.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.280+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 shutdown_connections 2023-10-16T20:12:23.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.280+0000 7fdb424a9640 1 -- 172.21.15.57:0/2774524036 wait complete. 2023-10-16T20:12:23.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T20:12:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.539+0000 7f01f6256640 1 Processor -- start 2023-10-16T20:12:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.539+0000 7f01f6256640 1 -- start start 2023-10-16T20:12:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.541+0000 7f01f6256640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01f0151080 0x7f01f006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.541+0000 7f01f6256640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01f00c8be0 0x7f01f00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.541+0000 7f01f6256640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f015a3c0 con 0x7f01f006f280 2023-10-16T20:12:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.541+0000 7f01f6256640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f00c7cc0 con 0x7f01f0151080 2023-10-16T20:12:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.541+0000 7f01f6256640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f00c2220 con 0x7f01f00c8be0 2023-10-16T20:12:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.543+0000 7f01effff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01f00c8be0 0x7f01f00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.544+0000 7f01ef7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01f0151080 0x7f01f006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.544+0000 7f01effff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01f00c8be0 0x7f01f00cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:53142/0 (socket says 172.21.15.57:53142) 2023-10-16T20:12:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.544+0000 7f01effff640 1 -- 172.21.15.57:0/599988729 learned_addr learned my addr 172.21.15.57:0/599988729 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:23.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.550+0000 7f01effff640 1 -- 172.21.15.57:0/599988729 >> v2:172.21.15.57:3300/0 conn(0x7f01f0151080 msgr2=0x7f01f006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:23.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.550+0000 7f01effff640 1 --2- 172.21.15.57:0/599988729 >> v2:172.21.15.57:3300/0 conn(0x7f01f0151080 0x7f01f006ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.550+0000 7f01effff640 1 -- 172.21.15.57:0/599988729 >> v1:172.21.15.57:6789/0 conn(0x7f01f006f280 legacy=0x7f01f00c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:23.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.550+0000 7f01effff640 1 -- 172.21.15.57:0/599988729 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00c7f10 con 0x7f01f00c8be0 2023-10-16T20:12:23.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.556+0000 7f01effff640 1 --2- 172.21.15.57:0/599988729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f00c8be0 0x7f01f00cc6e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01f00c3650 tx=0x7f01e802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbd806c677ecea76 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:23.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.567+0000 7f01eeffd640 1 -- 172.21.15.57:0/599988729 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e802c9f0 con 0x7f01f00c8be0 2023-10-16T20:12:23.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.567+0000 7f01eeffd640 1 -- 172.21.15.57:0/599988729 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01e802cb50 con 0x7f01f00c8be0 2023-10-16T20:12:23.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.567+0000 7f01eeffd640 1 -- 172.21.15.57:0/599988729 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e80343f0 con 0x7f01f00c8be0 2023-10-16T20:12:23.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.568+0000 7f01f6256640 1 -- 172.21.15.57:0/599988729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f00c8be0 msgr2=0x7f01f00cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:23.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.568+0000 7f01f6256640 1 --2- 172.21.15.57:0/599988729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f00c8be0 0x7f01f00cc6e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01f00c3650 tx=0x7f01e802be50 comp rx=0 tx=0).stop 2023-10-16T20:12:23.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.569+0000 7f01f6256640 1 -- 172.21.15.57:0/599988729 shutdown_connections 2023-10-16T20:12:23.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.569+0000 7f01f6256640 1 --2- 172.21.15.57:0/599988729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f00c8be0 0x7f01f00cc6e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.569+0000 7f01f6256640 1 --2- 172.21.15.57:0/599988729 >> v2:172.21.15.57:3300/0 conn(0x7f01f0151080 0x7f01f006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.569+0000 7f01f6256640 1 -- 172.21.15.57:0/599988729 >> 172.21.15.57:0/599988729 conn(0x7f01f00659d0 msgr2=0x7f01f0065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:23.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.569+0000 7f01f6256640 1 -- 172.21.15.57:0/599988729 shutdown_connections 2023-10-16T20:12:23.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.569+0000 7f01f6256640 1 -- 172.21.15.57:0/599988729 wait complete. 2023-10-16T20:12:23.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.572+0000 7f01f6256640 1 Processor -- start 2023-10-16T20:12:23.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.572+0000 7f01f6256640 1 -- start start 2023-10-16T20:12:23.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.574+0000 7f01f6256640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 0x7f01f01eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:23.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.574+0000 7f01f6256640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f00c8be0 0x7f01f014b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:23.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.574+0000 7f01f6256640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0151080 0x7f01f01537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:23.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.574+0000 7f01f6256640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01ef040 con 0x7f01f00c8be0 2023-10-16T20:12:23.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.574+0000 7f01f6256640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01ee670 con 0x7f01f0151080 2023-10-16T20:12:23.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.574+0000 7f01f6256640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01ee080 con 0x7f01f006f280 2023-10-16T20:12:23.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.575+0000 7f01ef7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 0x7f01f01eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:23.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.576+0000 7f01effff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0151080 0x7f01f01537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:23.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.577+0000 7f01effff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0151080 0x7f01f01537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:53154/0 (socket says 172.21.15.57:53154) 2023-10-16T20:12:23.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.577+0000 7f01effff640 1 -- 172.21.15.57:0/667779303 learned_addr learned my addr 172.21.15.57:0/667779303 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:23.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.577+0000 7f01ef7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 0x7f01f01eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45286/0 (socket says 172.21.15.57:45286) 2023-10-16T20:12:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.586+0000 7f01ef7fe640 1 -- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0151080 msgr2=0x7f01f01537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.586+0000 7f01ef7fe640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0151080 0x7f01f01537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.586+0000 7f01ef7fe640 1 -- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f00c8be0 msgr2=0x7f01f014b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.586+0000 7f01ef7fe640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f00c8be0 0x7f01f014b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.586+0000 7f01ef7fe640 1 -- 172.21.15.57:0/667779303 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8009b30 con 0x7f01f006f280 2023-10-16T20:12:23.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.593+0000 7f01ef7fe640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 0x7f01f01eeb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c5c0 tx=0x7f01e000ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.605+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0004220 con 0x7f01f006f280 2023-10-16T20:12:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.605+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01e0004380 con 0x7f01f006f280 2023-10-16T20:12:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.605+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f006c790 con 0x7f01f006f280 2023-10-16T20:12:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.605+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0003850 con 0x7f01f006f280 2023-10-16T20:12:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.606+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f006cd50 con 0x7f01f006f280 2023-10-16T20:12:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:23.607+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f006cf70 con 0x7f01f006f280 2023-10-16T20:12:24.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.010+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f01e00039b0 con 0x7f01f006f280 2023-10-16T20:12:24.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.013+0000 7f01ecff9640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01d006aec0 0x7f01d006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:24.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.014+0000 7f01e6ffd640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01d006aec0 0x7f01d006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:24.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.017+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f01e0058660 con 0x7f01f006f280 2023-10-16T20:12:24.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.017+0000 7f01e6ffd640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01d006aec0 0x7f01d006d380 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01f0070b40 tx=0x7f01d8007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.040+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01e00549a0 con 0x7f01f006f280 2023-10-16T20:12:24.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.295+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f01f004e1d0 con 0x7f01f006f280 2023-10-16T20:12:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.810+0000 7f01ecff9640 1 -- 172.21.15.57:0/667779303 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f01e001e030 con 0x7f01f006f280 2023-10-16T20:12:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T20:12:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01d006aec0 msgr2=0x7f01d006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01d006aec0 0x7f01d006d380 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01f0070b40 tx=0x7f01d8007990 comp rx=0 tx=0).stop 2023-10-16T20:12:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 msgr2=0x7f01f01eeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 0x7f01f01eeb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c5c0 tx=0x7f01e000ca80 comp rx=0 tx=0).stop 2023-10-16T20:12:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 shutdown_connections 2023-10-16T20:12:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f01d006aec0 0x7f01d006d380 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0151080 0x7f01f01537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f00c8be0 0x7f01f014b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.814+0000 7f01f6256640 1 --2- 172.21.15.57:0/667779303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01f006f280 0x7f01f01eeb00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.815+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 >> 172.21.15.57:0/667779303 conn(0x7f01f00659d0 msgr2=0x7f01f006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.815+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 shutdown_connections 2023-10-16T20:12:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:24.815+0000 7f01f6256640 1 -- 172.21.15.57:0/667779303 wait complete. 2023-10-16T20:12:24.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T20:12:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.042+0000 7f283711a640 1 Processor -- start 2023-10-16T20:12:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.042+0000 7f283711a640 1 -- start start 2023-10-16T20:12:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.044+0000 7f283711a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28300c4cc0 0x7f28300c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.045+0000 7f283711a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2830071310 0x7f2830069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.045+0000 7f283711a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2830159cf0 con 0x7f283006dea0 2023-10-16T20:12:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.045+0000 7f283711a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28300c63d0 con 0x7f2830071310 2023-10-16T20:12:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.045+0000 7f283711a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2830159100 con 0x7f28300c4cc0 2023-10-16T20:12:25.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.048+0000 7f2836118640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28300c4cc0 0x7f28300c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.049+0000 7f2836118640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28300c4cc0 0x7f28300c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.57:53156/0 (socket says 172.21.15.57:53156) 2023-10-16T20:12:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.049+0000 7f2836118640 1 -- 172.21.15.57:0/3043230920 learned_addr learned my addr 172.21.15.57:0/3043230920 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:25.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.054+0000 7f2836118640 1 -- 172.21.15.57:0/3043230920 >> v2:172.21.15.57:3300/0 conn(0x7f2830071310 msgr2=0x7f2830069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:25.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.054+0000 7f2836118640 1 --2- 172.21.15.57:0/3043230920 >> v2:172.21.15.57:3300/0 conn(0x7f2830071310 0x7f2830069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:25.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.054+0000 7f2836118640 1 -- 172.21.15.57:0/3043230920 >> v1:172.21.15.57:6789/0 conn(0x7f283006dea0 legacy=0x7f2830070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:25.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.054+0000 7f2836118640 1 -- 172.21.15.57:0/3043230920 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28301593c0 con 0x7f28300c4cc0 2023-10-16T20:12:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.059+0000 7f2836118640 1 --2- 172.21.15.57:0/3043230920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28300c4cc0 0x7f28300c7210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28300722a0 tx=0x7f282c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1794281ba1830c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.069+0000 7f2835116640 1 -- 172.21.15.57:0/3043230920 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c031870 con 0x7f28300c4cc0 2023-10-16T20:12:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.069+0000 7f2835116640 1 -- 172.21.15.57:0/3043230920 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f282c0319d0 con 0x7f28300c4cc0 2023-10-16T20:12:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.069+0000 7f2835116640 1 -- 172.21.15.57:0/3043230920 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c031d80 con 0x7f28300c4cc0 2023-10-16T20:12:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.069+0000 7f283711a640 1 -- 172.21.15.57:0/3043230920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28300c4cc0 msgr2=0x7f28300c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.069+0000 7f283711a640 1 --2- 172.21.15.57:0/3043230920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28300c4cc0 0x7f28300c7210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28300722a0 tx=0x7f282c02b910 comp rx=0 tx=0).stop 2023-10-16T20:12:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.070+0000 7f283711a640 1 -- 172.21.15.57:0/3043230920 shutdown_connections 2023-10-16T20:12:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.070+0000 7f283711a640 1 --2- 172.21.15.57:0/3043230920 >> v2:172.21.15.57:3300/0 conn(0x7f2830071310 0x7f2830069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.070+0000 7f283711a640 1 --2- 172.21.15.57:0/3043230920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28300c4cc0 0x7f28300c7210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.070+0000 7f283711a640 1 -- 172.21.15.57:0/3043230920 >> 172.21.15.57:0/3043230920 conn(0x7f28300cb470 msgr2=0x7f28300cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.070+0000 7f283711a640 1 -- 172.21.15.57:0/3043230920 shutdown_connections 2023-10-16T20:12:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.070+0000 7f283711a640 1 -- 172.21.15.57:0/3043230920 wait complete. 2023-10-16T20:12:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.073+0000 7f283711a640 1 Processor -- start 2023-10-16T20:12:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.073+0000 7f283711a640 1 -- start start 2023-10-16T20:12:25.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.075+0000 7f283711a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 0x7f28301f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:25.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.075+0000 7f283711a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2830071310 0x7f28301514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:25.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.075+0000 7f283711a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28300c4cc0 0x7f28300bc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:25.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.075+0000 7f283711a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28300be070 con 0x7f28300c4cc0 2023-10-16T20:12:25.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.075+0000 7f283711a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28300bc3e0 con 0x7f2830071310 2023-10-16T20:12:25.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.075+0000 7f283711a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28301f2830 con 0x7f283006dea0 2023-10-16T20:12:25.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.076+0000 7f2836118640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 0x7f28301f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:25.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.077+0000 7f2836118640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 0x7f28301f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:45300/0 (socket says 172.21.15.57:45300) 2023-10-16T20:12:25.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.077+0000 7f2836118640 1 -- 172.21.15.57:0/1044552276 learned_addr learned my addr 172.21.15.57:0/1044552276 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:25.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.077+0000 7f2835917640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2830071310 0x7f28301514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:25.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.083+0000 7f2836118640 1 -- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2830071310 msgr2=0x7f28301514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:25.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.083+0000 7f2836118640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2830071310 0x7f28301514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:25.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.083+0000 7f2836118640 1 -- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28300c4cc0 msgr2=0x7f28300bc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:25.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.083+0000 7f2836118640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28300c4cc0 0x7f28300bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:25.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.083+0000 7f2836118640 1 -- 172.21.15.57:0/1044552276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0094d0 con 0x7f283006dea0 2023-10-16T20:12:25.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.088+0000 7f2836118640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 0x7f28301f22f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:25.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.095+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0443f0 con 0x7f283006dea0 2023-10-16T20:12:25.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.095+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f282c044550 con 0x7f283006dea0 2023-10-16T20:12:25.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.095+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c044920 con 0x7f283006dea0 2023-10-16T20:12:25.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.095+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28300bb4d0 con 0x7f283006dea0 2023-10-16T20:12:25.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.095+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28300bba90 con 0x7f283006dea0 2023-10-16T20:12:25.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.097+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283006be00 con 0x7f283006dea0 2023-10-16T20:12:25.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.488+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f282c044a80 con 0x7f283006dea0 2023-10-16T20:12:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.489+0000 7f2826ffd640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f281406aec0 0x7f281406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:25.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.490+0000 7f2835917640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f281406aec0 0x7f281406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.491+0000 7f2835917640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f281406aec0 0x7f281406d380 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28300c3080 tx=0x7f2820009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.493+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f282c02d040 con 0x7f283006dea0 2023-10-16T20:12:25.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.510+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f282c0777b0 con 0x7f283006dea0 2023-10-16T20:12:25.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:25.755+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f283004e160 con 0x7f283006dea0 2023-10-16T20:12:26.045 INFO:tasks.ceph.mds.f.smithi110.stderr:==00:00:31:45.898 90984== 2023-10-16T20:12:26.045 INFO:tasks.ceph.mds.f.smithi110.stderr:==00:00:31:45.898 90984== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:12:26.046 INFO:tasks.ceph.mds.d.smithi110.stderr:==00:00:31:45.884 90986== 2023-10-16T20:12:26.046 INFO:tasks.ceph.mds.d.smithi110.stderr:==00:00:31:45.884 90986== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:12:26.074 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:12:26.081 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:12:26.087 INFO:tasks.ceph.mds.e.smithi057.stderr:==00:00:31:45.961 91063== 2023-10-16T20:12:26.087 INFO:tasks.ceph.mds.e.smithi057.stderr:==00:00:31:45.961 91063== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:12:26.097 INFO:tasks.ceph.mds.f.smithi110.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:12:26.098 INFO:tasks.ceph.mds.d.smithi110.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:12:26.112 INFO:tasks.ceph.mds.a.smithi057.stderr:==00:00:31:45.997 91061== 2023-10-16T20:12:26.112 INFO:tasks.ceph.mds.a.smithi057.stderr:==00:00:31:45.997 91061== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:12:26.262 INFO:tasks.ceph.mds.e.smithi057.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:12:26.263 INFO:tasks.ceph.mds.a.smithi057.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:12:26.334 INFO:tasks.ceph.mds.c.smithi057.stderr:==00:00:31:46.218 91062== 2023-10-16T20:12:26.334 INFO:tasks.ceph.mds.c.smithi057.stderr:==00:00:31:46.218 91062== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:12:26.463 INFO:tasks.ceph.mds.c.smithi057.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:12:27.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.057+0000 7f2826ffd640 1 -- 172.21.15.57:0/1044552276 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7f282c052020 con 0x7f283006dea0 2023-10-16T20:12:27.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f281406aec0 msgr2=0x7f281406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:27.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f281406aec0 0x7f281406d380 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28300c3080 tx=0x7f2820009040 comp rx=0 tx=0).stop 2023-10-16T20:12:27.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 msgr2=0x7f28301f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 0x7f28301f22f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c0046c0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 shutdown_connections 2023-10-16T20:12:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f281406aec0 0x7f281406d380 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28300c4cc0 0x7f28300bc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2830071310 0x7f28301514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 --2- 172.21.15.57:0/1044552276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f283006dea0 0x7f28301f22f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.059+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 >> 172.21.15.57:0/1044552276 conn(0x7f28300cb470 msgr2=0x7f28300717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.060+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 shutdown_connections 2023-10-16T20:12:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.060+0000 7f283711a640 1 -- 172.21.15.57:0/1044552276 wait complete. 2023-10-16T20:12:27.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T20:12:27.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.296+0000 7f54a7a46640 1 Processor -- start 2023-10-16T20:12:27.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.296+0000 7f54a7a46640 1 -- start start 2023-10-16T20:12:27.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.298+0000 7f54a7a46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a0151110 0x7f54a00c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.298+0000 7f54a7a46640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54a00c9f30 0x7f54a00c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.298+0000 7f54a7a46640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00c54a0 con 0x7f54a0150d30 2023-10-16T20:12:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.298+0000 7f54a7a46640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a00c4cd0 con 0x7f54a00c9f30 2023-10-16T20:12:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.298+0000 7f54a7a46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a006da50 con 0x7f54a0151110 2023-10-16T20:12:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.298+0000 7f54a5fe3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54a00c9f30 0x7f54a00c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.300+0000 7f54a5fe3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54a00c9f30 0x7f54a00c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34956/0 (socket says 172.21.15.57:34956) 2023-10-16T20:12:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.300+0000 7f54a5fe3640 1 -- 172.21.15.57:0/3322967487 learned_addr learned my addr 172.21.15.57:0/3322967487 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:27.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.300+0000 7f54a4fe1640 1 --2- 172.21.15.57:0/3322967487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a0151110 0x7f54a00c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:27.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.302+0000 7f54a5fe3640 1 -- 172.21.15.57:0/3322967487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a0151110 msgr2=0x7f54a00c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:27.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.302+0000 7f54a5fe3640 1 --2- 172.21.15.57:0/3322967487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a0151110 0x7f54a00c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.302+0000 7f54a5fe3640 1 -- 172.21.15.57:0/3322967487 >> v1:172.21.15.110:6789/0 conn(0x7f54a0150d30 legacy=0x7f54a00c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:27.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.302+0000 7f54a5fe3640 1 -- 172.21.15.57:0/3322967487 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00c4ee0 con 0x7f54a00c9f30 2023-10-16T20:12:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.305+0000 7f54a5fe3640 1 --2- 172.21.15.57:0/3322967487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a00c3ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54a00c4e10 tx=0x7f549802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a22966be12c343 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.309+0000 7f5497fff640 1 -- 172.21.15.57:0/3322967487 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549802cb70 con 0x7f54a00c9f30 2023-10-16T20:12:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f5497fff640 1 -- 172.21.15.57:0/3322967487 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f549802ccd0 con 0x7f54a00c9f30 2023-10-16T20:12:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f5497fff640 1 -- 172.21.15.57:0/3322967487 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498034630 con 0x7f54a00c9f30 2023-10-16T20:12:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 -- 172.21.15.57:0/3322967487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 msgr2=0x7f54a00c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 --2- 172.21.15.57:0/3322967487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a00c3ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54a00c4e10 tx=0x7f549802bfd0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 -- 172.21.15.57:0/3322967487 shutdown_connections 2023-10-16T20:12:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 --2- 172.21.15.57:0/3322967487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a00c3ea0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 --2- 172.21.15.57:0/3322967487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a0151110 0x7f54a00c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 -- 172.21.15.57:0/3322967487 >> 172.21.15.57:0/3322967487 conn(0x7f54a00ca350 msgr2=0x7f54a00ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 -- 172.21.15.57:0/3322967487 shutdown_connections 2023-10-16T20:12:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.310+0000 7f54a7a46640 1 -- 172.21.15.57:0/3322967487 wait complete. 2023-10-16T20:12:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.312+0000 7f54a7a46640 1 Processor -- start 2023-10-16T20:12:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.312+0000 7f54a7a46640 1 -- start start 2023-10-16T20:12:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a7a46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a0149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a7a46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0150d30 0x7f54a00c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a7a46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a014b0a0 0x7f54a014b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a7a46640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a014a590 con 0x7f54a00c9f30 2023-10-16T20:12:27.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a7a46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a014ba90 con 0x7f54a0150d30 2023-10-16T20:12:27.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a7a46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0071b70 con 0x7f54a014b0a0 2023-10-16T20:12:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a57e2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a0149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a57e2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a0149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34960/0 (socket says 172.21.15.57:34960) 2023-10-16T20:12:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a57e2640 1 -- 172.21.15.57:0/2574851643 learned_addr learned my addr 172.21.15.57:0/2574851643 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a4fe1640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0150d30 0x7f54a00c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.314+0000 7f54a5fe3640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a014b0a0 0x7f54a014b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.317+0000 7f54a57e2640 1 -- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a014b0a0 msgr2=0x7f54a014b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.317+0000 7f54a57e2640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a014b0a0 0x7f54a014b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.317+0000 7f54a57e2640 1 -- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0150d30 msgr2=0x7f54a00c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.317+0000 7f54a57e2640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0150d30 0x7f54a00c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.317+0000 7f54a57e2640 1 -- 172.21.15.57:0/2574851643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498009b30 con 0x7f54a00c9f30 2023-10-16T20:12:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.321+0000 7f54a57e2640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a0149550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c400 tx=0x7f549c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.324+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0052d0 con 0x7f54a00c9f30 2023-10-16T20:12:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.324+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a01551c0 con 0x7f54a00c9f30 2023-10-16T20:12:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.324+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a01eed40 con 0x7f54a00c9f30 2023-10-16T20:12:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.324+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f549c005430 con 0x7f54a00c9f30 2023-10-16T20:12:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.324+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c007240 con 0x7f54a00c9f30 2023-10-16T20:12:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.325+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5480005250 con 0x7f54a00c9f30 2023-10-16T20:12:27.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.349+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f549c0073a0 con 0x7f54a00c9f30 2023-10-16T20:12:27.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.350+0000 7f5495ffb640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f548406aea0 0x7f548406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:27.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.351+0000 7f54a4fe1640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f548406aea0 0x7f548406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:27.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.352+0000 7f54a4fe1640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f548406aea0 0x7f548406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54a0150840 tx=0x7f5490009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.675+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f549c058060 con 0x7f54a00c9f30 2023-10-16T20:12:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.676+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f549c0543a0 con 0x7f54a00c9f30 2023-10-16T20:12:27.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:27.893+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5480005500 con 0x7f54a00c9f30 2023-10-16T20:12:29.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.062+0000 7f5495ffb640 1 -- 172.21.15.57:0/2574851643 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f549c020070 con 0x7f54a00c9f30 2023-10-16T20:12:29.065 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-10-16T20:12:29.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.066+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f548406aea0 msgr2=0x7f548406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:29.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.066+0000 7f54a7a46640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f548406aea0 0x7f548406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54a0150840 tx=0x7f5490009190 comp rx=0 tx=0).stop 2023-10-16T20:12:29.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.066+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 msgr2=0x7f54a0149550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:29.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.066+0000 7f54a7a46640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a0149550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c400 tx=0x7f549c00c8c0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 shutdown_connections 2023-10-16T20:12:29.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f548406aea0 0x7f548406d360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a014b0a0 0x7f54a014b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0150d30 0x7f54a00c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 --2- 172.21.15.57:0/2574851643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54a00c9f30 0x7f54a0149550 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 >> 172.21.15.57:0/2574851643 conn(0x7f54a00ca350 msgr2=0x7f54a01559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:29.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 shutdown_connections 2023-10-16T20:12:29.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.067+0000 7f54a7a46640 1 -- 172.21.15.57:0/2574851643 wait complete. 2023-10-16T20:12:29.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T20:12:29.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.335+0000 7f59acf63640 1 Processor -- start 2023-10-16T20:12:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.336+0000 7f59acf63640 1 -- start start 2023-10-16T20:12:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.337+0000 7f59acf63640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59a806f920 0x7f59a80af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.337+0000 7f59acf63640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 0x7f59a8070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.337+0000 7f59acf63640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a8070600 con 0x7f59a806a050 2023-10-16T20:12:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.337+0000 7f59acf63640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a815e350 con 0x7f59a806f920 2023-10-16T20:12:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.337+0000 7f59acf63640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a806ab40 con 0x7f59a80afe50 2023-10-16T20:12:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.338+0000 7f599ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59a806f920 0x7f59a80af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.338+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 0x7f59a8070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.338+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 0x7f59a8070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.57:60872/0 (socket says 172.21.15.57:60872) 2023-10-16T20:12:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.338+0000 7f59a7fff640 1 -- 172.21.15.57:0/1206520511 learned_addr learned my addr 172.21.15.57:0/1206520511 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:29.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.341+0000 7f59a7fff640 1 -- 172.21.15.57:0/1206520511 >> v2:172.21.15.57:3300/0 conn(0x7f59a806f920 msgr2=0x7f59a80af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:12:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.341+0000 7f59a7fff640 1 --2- 172.21.15.57:0/1206520511 >> v2:172.21.15.57:3300/0 conn(0x7f59a806f920 0x7f59a80af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.341+0000 7f59a7fff640 1 -- 172.21.15.57:0/1206520511 >> v1:172.21.15.57:6789/0 conn(0x7f59a806a050 legacy=0x7f59a806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.341+0000 7f59a7fff640 1 -- 172.21.15.57:0/1206520511 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a815e070 con 0x7f59a80afe50 2023-10-16T20:12:29.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.344+0000 7f59a7fff640 1 --2- 172.21.15.57:0/1206520511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 0x7f59a8070a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009e50 tx=0x7f59a002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19888a844082b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:29.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.351+0000 7f59a6ffd640 1 -- 172.21.15.57:0/1206520511 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a002cb00 con 0x7f59a80afe50 2023-10-16T20:12:29.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.351+0000 7f59a6ffd640 1 -- 172.21.15.57:0/1206520511 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59a002cc60 con 0x7f59a80afe50 2023-10-16T20:12:29.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.351+0000 7f59a6ffd640 1 -- 172.21.15.57:0/1206520511 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a00343f0 con 0x7f59a80afe50 2023-10-16T20:12:29.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.351+0000 7f59acf63640 1 -- 172.21.15.57:0/1206520511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 msgr2=0x7f59a8070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:29.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.351+0000 7f59acf63640 1 --2- 172.21.15.57:0/1206520511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 0x7f59a8070a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009e50 tx=0x7f59a002bf60 comp rx=0 tx=0).stop 2023-10-16T20:12:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.352+0000 7f59acf63640 1 -- 172.21.15.57:0/1206520511 shutdown_connections 2023-10-16T20:12:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.352+0000 7f59acf63640 1 --2- 172.21.15.57:0/1206520511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a80afe50 0x7f59a8070a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.352+0000 7f59acf63640 1 --2- 172.21.15.57:0/1206520511 >> v2:172.21.15.57:3300/0 conn(0x7f59a806f920 0x7f59a80af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.352+0000 7f59acf63640 1 -- 172.21.15.57:0/1206520511 >> 172.21.15.57:0/1206520511 conn(0x7f59a806dd80 msgr2=0x7f59a806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.352+0000 7f59acf63640 1 -- 172.21.15.57:0/1206520511 shutdown_connections 2023-10-16T20:12:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.352+0000 7f59acf63640 1 -- 172.21.15.57:0/1206520511 wait complete. 2023-10-16T20:12:29.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.354+0000 7f59acf63640 1 Processor -- start 2023-10-16T20:12:29.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.354+0000 7f59acf63640 1 -- start start 2023-10-16T20:12:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59acf63640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 0x7f59a80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59acf63640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a806f920 0x7f59a80bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59acf63640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a80afe50 0x7f59a80c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59acf63640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80befb0 con 0x7f59a806a050 2023-10-16T20:12:29.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59acf63640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80bfdb0 con 0x7f59a80afe50 2023-10-16T20:12:29.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59acf63640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80c8170 con 0x7f59a806f920 2023-10-16T20:12:29.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.355+0000 7f59a77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 0x7f59a80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:29.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.356+0000 7f599ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a806f920 0x7f59a80bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:29.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.356+0000 7f59a77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 0x7f59a80c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34982/0 (socket says 172.21.15.57:34982) 2023-10-16T20:12:29.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.356+0000 7f59a77fe640 1 -- 172.21.15.57:0/4017075659 learned_addr learned my addr 172.21.15.57:0/4017075659 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-16T20:12:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.357+0000 7f59a7fff640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a80afe50 0x7f59a80c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.360+0000 7f59a77fe640 1 -- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a806f920 msgr2=0x7f59a80bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.360+0000 7f59a77fe640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a806f920 0x7f59a80bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.360+0000 7f59a77fe640 1 -- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a80afe50 msgr2=0x7f59a80c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.360+0000 7f59a77fe640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a80afe50 0x7f59a80c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.360+0000 7f59a77fe640 1 -- 172.21.15.57:0/4017075659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0009b30 con 0x7f59a806a050 2023-10-16T20:12:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.363+0000 7f59a77fe640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 0x7f59a80c8350 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f599800c400 tx=0x7f599800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:29.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.367+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59980052d0 con 0x7f59a806a050 2023-10-16T20:12:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.367+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5998005430 con 0x7f59a806a050 2023-10-16T20:12:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.367+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998003850 con 0x7f59a806a050 2023-10-16T20:12:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.367+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a81f2d40 con 0x7f59a806a050 2023-10-16T20:12:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.368+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a81f59b0 con 0x7f59a806a050 2023-10-16T20:12:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.369+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a80744a0 con 0x7f59a806a050 2023-10-16T20:12:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.392+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59980039b0 con 0x7f59a806a050 2023-10-16T20:12:29.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.394+0000 7f59a4ff9640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f598806aec0 0x7f598806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:12:29.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.395+0000 7f599ffff640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f598806aec0 0x7f598806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:12:29.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.395+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5817+0+0 (secure 0 0 0) 0x7f5998057dc0 con 0x7f59a806a050 2023-10-16T20:12:29.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.396+0000 7f599ffff640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f598806aec0 0x7f598806d380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59a80bd870 tx=0x7f5990009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:12:29.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.683+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5998054100 con 0x7f59a806a050 2023-10-16T20:12:29.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:29.880+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59a80c58c0 con 0x7f59a806a050 2023-10-16T20:12:29.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-16T20:12:29.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-16T20:12:29.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-10-16T20:12:29.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-16T20:12:29.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-10-16T20:12:30.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.508+0000 7f59a4ff9640 1 -- 172.21.15.57:0/4017075659 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5998057720 con 0x7f59a806a050 2023-10-16T20:12:30.511 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-10-16T20:12:30.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.511+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f598806aec0 msgr2=0x7f598806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.511+0000 7f59acf63640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f598806aec0 0x7f598806d380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59a80bd870 tx=0x7f5990009190 comp rx=0 tx=0).stop 2023-10-16T20:12:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.511+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 msgr2=0x7f59a80c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:12:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.511+0000 7f59acf63640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 0x7f59a80c8350 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f599800c400 tx=0x7f599800c8c0 comp rx=0 tx=0).stop 2023-10-16T20:12:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 shutdown_connections 2023-10-16T20:12:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:6800/32930157,v1:172.21.15.57:6801/32930157] conn(0x7f598806aec0 0x7f598806d380 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a80afe50 0x7f59a80c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a806f920 0x7f59a80bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 --2- 172.21.15.57:0/4017075659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59a806a050 0x7f59a80c8350 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:12:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 >> 172.21.15.57:0/4017075659 conn(0x7f59a806dd80 msgr2=0x7f59a8070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:12:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 shutdown_connections 2023-10-16T20:12:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-16T20:12:30.512+0000 7f59acf63640 1 -- 172.21.15.57:0/4017075659 wait complete. 2023-10-16T20:12:30.537 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T20:12:30.537 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T20:12:30.538 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:30.538 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:12:30.538 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2023-10-16T20:12:30.539 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T20:12:30.539 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T20:12:30.539 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:30.540 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:12:30.540 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2023-10-16T20:12:30.540 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T20:12:30.541 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-10-16T20:12:30.541 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:30.541 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:12:30.542 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2023-10-16T20:12:30.542 INFO:tasks.ceph.mds.e:Stopped 2023-10-16T20:12:30.542 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T20:12:30.543 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:30.579 INFO:tasks.ceph.mds.b.smithi110.stderr:2023-10-16T20:12:30.551+0000 b5ab640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 90978) UID: 0 2023-10-16T20:12:30.580 INFO:tasks.ceph.mds.b.smithi110.stderr:2023-10-16T20:12:30.556+0000 b5ab640 -1 mds.b *** got signal Terminated *** 2023-10-16T20:12:35.597 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:32:35.157 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.606 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:32:35.166 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.626 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:32:35.174 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.627 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:32:35.175 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.631 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:32:35.180 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.634 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:32:35.182 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.722 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:32:35.270 86854== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.723 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:32:35.271 86855== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:35.739 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:32:35.299 87034== Warning: unimplemented fcntl command: 1036 2023-10-16T20:12:36.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-16T20:12:36.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2023-10-16T20:12:36.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~6s 2023-10-16T20:12:36.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-16T20:12:36.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-16T20:12:36.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-10-16T20:12:36.644 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T20:12:36.644 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T20:12:36.645 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:36.645 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:12:36.645 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2023-10-16T20:12:36.646 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T20:12:36.646 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-10-16T20:12:36.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:36.647 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:12:36.647 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2023-10-16T20:12:36.647 INFO:tasks.ceph.mds.f:Stopped 2023-10-16T20:12:36.648 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T20:12:36.648 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T20:12:36.648 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:36.650 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-16T20:12:36.648+0000 7f4759537640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 87371) UID: 0 2023-10-16T20:12:36.650 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-16T20:12:36.648+0000 7f4759537640 -1 osd.0 29 *** Got signal Terminated *** 2023-10-16T20:12:42.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-16T20:12:42.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-16T20:12:42.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-10-16T20:12:42.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-16T20:12:42.751 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T20:12:42.752 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T20:12:42.752 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:42.753 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-16T20:12:42.751+0000 7f9705472640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 87373) UID: 0 2023-10-16T20:12:42.754 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-16T20:12:42.751+0000 7f9705472640 -1 osd.1 31 *** Got signal Terminated *** 2023-10-16T20:12:48.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-16T20:12:48.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-16T20:12:48.854 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T20:12:48.855 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T20:12:48.855 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:48.856 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-16T20:12:48.854+0000 7ff61caa2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 87383) UID: 0 2023-10-16T20:12:48.857 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-16T20:12:48.854+0000 7ff61caa2640 -1 osd.2 32 *** Got signal Terminated *** 2023-10-16T20:12:54.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-16T20:12:54.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-16T20:12:54.958 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T20:12:54.958 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T20:12:54.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:12:54.960 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-16T20:12:54.958+0000 7fad6938c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 87389) UID: 0 2023-10-16T20:12:54.960 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-16T20:12:54.958+0000 7fad6938c640 -1 osd.3 33 *** Got signal Terminated *** 2023-10-16T20:12:56.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:12:56.201 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:13:00.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-16T20:13:00.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-16T20:13:01.061 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T20:13:01.062 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T20:13:01.062 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:01.064 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-16T20:13:01.061+0000 7fc89c49b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 87457) UID: 0 2023-10-16T20:13:01.064 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-10-16T20:13:01.061+0000 7fc89c49b640 -1 osd.4 34 *** Got signal Terminated *** 2023-10-16T20:13:06.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-16T20:13:06.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-16T20:13:07.165 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T20:13:07.165 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T20:13:07.166 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:07.167 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-16T20:13:07.164+0000 7f13e6abd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 87460) UID: 0 2023-10-16T20:13:07.167 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-10-16T20:13:07.165+0000 7f13e6abd640 -1 osd.5 35 *** Got signal Terminated *** 2023-10-16T20:13:11.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-16T20:13:11.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-16T20:13:13.267 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T20:13:13.268 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T20:13:13.269 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:13.270 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-16T20:13:13.267+0000 7f74c5013640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 87462) UID: 0 2023-10-16T20:13:13.270 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-10-16T20:13:13.267+0000 7f74c5013640 -1 osd.6 36 *** Got signal Terminated *** 2023-10-16T20:13:17.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-16T20:13:17.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-16T20:13:19.370 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T20:13:19.371 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T20:13:19.372 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:19.373 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-16T20:13:19.370+0000 7f1624684640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 87463) UID: 0 2023-10-16T20:13:19.373 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-10-16T20:13:19.370+0000 7f1624684640 -1 osd.7 36 *** Got signal Terminated *** 2023-10-16T20:13:23.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-16T20:13:23.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-16T20:13:25.473 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T20:13:25.473 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T20:13:25.474 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T20:13:25.474 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:25.476 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T20:13:25.473+0000 7f2be92f5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 87030) UID: 0 2023-10-16T20:13:25.476 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-16T20:13:25.473+0000 7f2be92f5640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-16T20:13:25.556 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T20:13:25.556 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T20:13:25.557 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:25.629 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T20:13:25.630 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T20:13:25.630 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T20:13:25.630 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:25.673 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-16T20:13:25.638+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 87026) UID: 0 2023-10-16T20:13:25.674 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-16T20:13:25.643+0000 9f5c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-16T20:13:26.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:13:26.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:13:26.653 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:33:26.213 87034== 2023-10-16T20:13:26.653 INFO:tasks.ceph.mon.a.smithi057.stderr:==00:00:33:26.213 87034== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:13:26.701 INFO:tasks.ceph.mon.a.smithi057.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:13:28.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-16T20:13:28.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-16T20:13:31.732 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:13:31.732 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-10-16T20:13:31.733 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T20:13:31.733 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T20:13:31.734 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:31.776 INFO:tasks.ceph.mon.b.smithi110.stderr:2023-10-16T20:13:31.742+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 86847) UID: 0 2023-10-16T20:13:31.778 INFO:tasks.ceph.mon.b.smithi110.stderr:2023-10-16T20:13:31.746+0000 9f5c640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-16T20:13:32.543 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:33:32.091 86854== 2023-10-16T20:13:32.543 INFO:tasks.ceph.mon.b.smithi110.stderr:==00:00:33:32.091 86854== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:13:32.586 INFO:tasks.ceph.mon.b.smithi110.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:13:33.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-16T20:13:33.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-16T20:13:37.836 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:13:37.836 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-10-16T20:13:37.837 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T20:13:37.838 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T20:13:37.838 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:13:37.879 INFO:tasks.ceph.mon.c.smithi110.stderr:2023-10-16T20:13:37.846+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 86850) UID: 0 2023-10-16T20:13:37.885 INFO:tasks.ceph.mon.c.smithi110.stderr:2023-10-16T20:13:37.850+0000 9f5c640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-10-16T20:13:38.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-16T20:13:56.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:13:56.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:14:26.641 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:14:26.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:14:56.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:14:56.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:15:26.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:15:26.969 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:15:57.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:15:57.123 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:27.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:27.278 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:43.850 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:36:43.398 86855== 2023-10-16T20:16:43.851 INFO:tasks.ceph.mon.c.smithi110.stderr:==00:00:36:43.398 86855== Exit program on first error (--exit-on-first-error=yes) 2023-10-16T20:16:43.890 INFO:tasks.ceph.mon.c.smithi110.stderr:daemon-helper: command failed with exit status 42 2023-10-16T20:16:46.980 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-16T20:16:46.981 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-10-16T20:16:46.981 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T20:16:46.982 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T20:16:46.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-10-16T20:16:47.097 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T20:16:47.097 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T20:16:47.255 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T20:16:47.255 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-16T20:16:47.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T20:16:47.425 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-16T20:16:47.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T20:16:47.617 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-16T20:16:47.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T20:16:47.797 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-16T20:16:48.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T20:16:48.182 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-16T20:16:48.344 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T20:16:48.345 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-16T20:16:48.522 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T20:16:48.522 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-16T20:16:48.671 INFO:tasks.ceph:Archiving mon data... 2023-10-16T20:16:48.673 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/data/mon.a.tgz 2023-10-16T20:16:48.674 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-10-16T20:16:48.739 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.LJ5exfIiGR 2023-10-16T20:16:48.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LJ5exfIiGR 2023-10-16T20:16:48.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.LJ5exfIiGR 2023-10-16T20:16:49.112 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.LJ5exfIiGR is 324KB 2023-10-16T20:16:49.220 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.LJ5exfIiGR 2023-10-16T20:16:49.283 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/data/mon.b.tgz 2023-10-16T20:16:49.283 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-10-16T20:16:49.336 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.aOZ4pjJS99 2023-10-16T20:16:49.337 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aOZ4pjJS99 2023-10-16T20:16:49.496 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.aOZ4pjJS99 2023-10-16T20:16:49.625 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.aOZ4pjJS99 is 333KB 2023-10-16T20:16:49.725 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.aOZ4pjJS99 2023-10-16T20:16:49.779 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/data/mon.c.tgz 2023-10-16T20:16:49.780 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-10-16T20:16:49.824 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.XhQ6Besk3H 2023-10-16T20:16:49.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XhQ6Besk3H 2023-10-16T20:16:50.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.XhQ6Besk3H 2023-10-16T20:16:50.165 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.XhQ6Besk3H is 333KB 2023-10-16T20:16:50.271 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.XhQ6Besk3H 2023-10-16T20:16:50.332 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-16T20:16:50.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T20:16:50.341 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T20:16:50.442 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-16T20:16:50.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T20:16:50.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T20:16:50.593 INFO:teuthology.orchestra.run.smithi057.stdout:/var/log/ceph/valgrind/client.0.log: Leak_StillReachable 2023-10-16T20:16:50.594 INFO:teuthology.orchestra.run.smithi057.stdout:/var/log/ceph/valgrind/mds.a.log: Leak_PossiblyLost 2023-10-16T20:16:50.594 INFO:teuthology.orchestra.run.smithi057.stdout:/var/log/ceph/valgrind/mds.c.log: Leak_PossiblyLost 2023-10-16T20:16:50.594 INFO:teuthology.orchestra.run.smithi057.stdout:/var/log/ceph/valgrind/mds.e.log: Leak_PossiblyLost 2023-10-16T20:16:50.595 INFO:teuthology.orchestra.run.smithi057.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-10-16T20:16:50.596 INFO:teuthology.orchestra.run.smithi110.stdout:/var/log/ceph/valgrind/mds.d.log: Leak_PossiblyLost 2023-10-16T20:16:50.596 INFO:teuthology.orchestra.run.smithi110.stdout:/var/log/ceph/valgrind/mds.f.log: Leak_PossiblyLost 2023-10-16T20:16:50.597 INFO:teuthology.orchestra.run.smithi110.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-10-16T20:16:50.597 INFO:teuthology.orchestra.run.smithi110.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-10-16T20:16:50.597 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/client.0.log kind Leak_StillReachable 2023-10-16T20:16:50.597 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/client.0.log 2023-10-16T20:16:50.598 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.a.log kind Leak_PossiblyLost 2023-10-16T20:16:50.598 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.c.log kind Leak_PossiblyLost 2023-10-16T20:16:50.598 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.e.log kind Leak_PossiblyLost 2023-10-16T20:16:50.598 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-10-16T20:16:50.599 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-10-16T20:16:50.599 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.d.log kind Leak_PossiblyLost 2023-10-16T20:16:50.599 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.f.log kind Leak_PossiblyLost 2023-10-16T20:16:50.599 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-10-16T20:16:50.600 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-10-16T20:16:50.600 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-10-16T20:16:50.600 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-10-16T20:16:50.601 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T20:16:50.603 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/remote/smithi057/crash 2023-10-16T20:16:50.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T20:16:50.685 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/remote/smithi110/crash 2023-10-16T20:16:50.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T20:16:50.784 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T20:16:50.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:50.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:50.946 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:51.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T20:16:51.153 INFO:tasks.ceph:Compressing logs... 2023-10-16T20:16:51.154 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T20:16:51.163 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T20:16:51.257 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-16T20:16:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93583.log 2023-10-16T20:16:51.259 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92980.log 2023-10-16T20:16:51.259 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87247.log 2023-10-16T20:16:51.260 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93583.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93583.log.gz 2023-10-16T20:16:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93751.log 2023-10-16T20:16:51.261 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87367.log 2023-10-16T20:16:51.261 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87247.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-10-16T20:16:51.261 INFO:teuthology.orchestra.run.smithi110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87247.log.gz 2023-10-16T20:16:51.263 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92980.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-16T20:16:51.263 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92980.log.gz 2023-10-16T20:16:51.263 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93751.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93751.log.gz 2023-10-16T20:16:51.264 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94075.log 2023-10-16T20:16:51.265 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87367.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-10-16T20:16:51.265 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87367.log.gz 2023-10-16T20:16:51.265 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/valgrind/mon.c.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-10-16T20:16:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-10-16T20:16:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/valgrind/mds.f.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-10-16T20:16:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-10-16T20:16:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/valgrind/mds.b.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-10-16T20:16:51.266 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-10-16T20:16:51.269 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/valgrind/mon.b.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-10-16T20:16:51.269 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87076.log 2023-10-16T20:16:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/valgrind/mds.d.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-10-16T20:16:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T20:16:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87076.log.gz 2023-10-16T20:16:51.270 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-16T20:16:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93088.log 2023-10-16T20:16:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87407.log 2023-10-16T20:16:51.272 INFO:teuthology.orchestra.run.smithi057.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94075.log.gz 2023-10-16T20:16:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92367.log 2023-10-16T20:16:51.272 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93088.log.gz 2023-10-16T20:16:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.87407.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87407.log.gz 2023-10-16T20:16:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96862.log 2023-10-16T20:16:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92367.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92367.log.gz 2023-10-16T20:16:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98454.log 2023-10-16T20:16:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92358.log 2023-10-16T20:16:51.273 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96862.log.gz 2023-10-16T20:16:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98454.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98454.log.gz 2023-10-16T20:16:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97214.log 2023-10-16T20:16:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92368.log 2023-10-16T20:16:51.277 INFO:teuthology.orchestra.run.smithi057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.92358.log.gz 2023-10-16T20:16:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97214.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97214.log.gz 2023-10-16T20:16:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91909.log 2023-10-16T20:16:51.278 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-16T20:16:51.278 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.b.log: 93.9%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T20:16:51.278 INFO:teuthology.orchestra.run.smithi110.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-16T20:16:51.279 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-16T20:16:51.279 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-10-16T20:16:51.279 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87196.log 2023-10-16T20:16:51.279 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.f.log: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87327.log 2023-10-16T20:16:51.280 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-16T20:16:51.282 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98412.log 2023-10-16T20:16:51.282 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92368.log.gz 2023-10-16T20:16:51.282 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91909.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91909.log.gz 2023-10-16T20:16:51.282 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91437.log 2023-10-16T20:16:51.283 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98412.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98412.log.gz 2023-10-16T20:16:51.283 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94009.log 2023-10-16T20:16:51.283 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91437.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91437.log.gz 2023-10-16T20:16:51.283 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91867.log 2023-10-16T20:16:51.283 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94009.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-10-16T20:16:51.285 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87196.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-16T20:16:51.285 INFO:teuthology.orchestra.run.smithi110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87196.log.gz 2023-10-16T20:16:51.285 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87327.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T20:16:51.286 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87327.log.gz 2023-10-16T20:16:51.286 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87287.log 2023-10-16T20:16:51.287 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91867.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94009.log.gz 2023-10-16T20:16:51.287 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91867.log.gz 2023-10-16T20:16:51.287 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-10-16T20:16:51.287 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/valgrind/mds.c.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-10-16T20:16:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-10-16T20:16:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/valgrind/mds.a.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-10-16T20:16:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-10-16T20:16:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-10-16T20:16:51.288 INFO:teuthology.orchestra.run.smithi057.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-10-16T20:16:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/valgrind/mon.a.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-10-16T20:16:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97856.log 2023-10-16T20:16:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/valgrind/mds.e.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-10-16T20:16:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92691.log 2023-10-16T20:16:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98246.log 2023-10-16T20:16:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.87287.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-16T20:16:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.87287.log.gz 2023-10-16T20:16:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87156.log 2023-10-16T20:16:51.293 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T20:16:51.293 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87116.log 2023-10-16T20:16:51.294 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-16T20:16:51.296 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97856.log.gz 2023-10-16T20:16:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96618.log 2023-10-16T20:16:51.296 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92691.log.gz 2023-10-16T20:16:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98246.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98246.log.gz 2023-10-16T20:16:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98370.log 2023-10-16T20:16:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97520.log 2023-10-16T20:16:51.297 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96618.log.gz 2023-10-16T20:16:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92179.log 2023-10-16T20:16:51.297 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.98370.log.gz 2023-10-16T20:16:51.300 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87116.log: /var/log/ceph/ceph-client.admin.87156.log: 86.8% 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-16T20:16:51.300 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph-client.admin.87116.log.gz 2023-10-16T20:16:51.300 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87156.log.gz 2023-10-16T20:16:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93877.log 2023-10-16T20:16:51.301 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97520.log.gz 2023-10-16T20:16:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92179.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92179.log.gz 2023-10-16T20:16:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91825.log 2023-10-16T20:16:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93159.log 2023-10-16T20:16:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91825.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.93877.log.gz 2023-10-16T20:16:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96660.log 2023-10-16T20:16:51.303 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91825.log.gz 2023-10-16T20:16:51.303 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98144.log 2023-10-16T20:16:51.303 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93159.log.gz 2023-10-16T20:16:51.304 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96660.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96660.log.gz 2023-10-16T20:16:51.305 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96947.log 2023-10-16T20:16:51.305 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96762.log 2023-10-16T20:16:51.305 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98144.log.gz 2023-10-16T20:16:51.306 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97940.log 2023-10-16T20:16:51.307 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96947.log.gz 2023-10-16T20:16:51.307 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96762.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96762.log.gz 2023-10-16T20:16:51.307 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98598.log 2023-10-16T20:16:51.308 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91479.log 2023-10-16T20:16:51.308 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97940.log.gz 2023-10-16T20:16:51.309 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97352.log 2023-10-16T20:16:51.309 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98598.log.gz 2023-10-16T20:16:51.310 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91479.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91479.log.gz 2023-10-16T20:16:51.310 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91060.log 2023-10-16T20:16:51.311 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92361.log 2023-10-16T20:16:51.311 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97352.log.gz 2023-10-16T20:16:51.312 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-16T20:16:51.312 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91060.log: gzip -5 87.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.91060.log.gz -- 2023-10-16T20:16:51.312 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph.tmp-client.admin.81003.log 2023-10-16T20:16:51.313 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97730.log 2023-10-16T20:16:51.313 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92361.log.gz 2023-10-16T20:16:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.81003.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81003.log.gz 2023-10-16T20:16:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91395.log 2023-10-16T20:16:51.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93010.log 2023-10-16T20:16:51.316 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97730.log.gz 2023-10-16T20:16:51.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91563.log 2023-10-16T20:16:51.317 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91395.log.gz 2023-10-16T20:16:51.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93010.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93010.log.gz 2023-10-16T20:16:51.318 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91105.log 2023-10-16T20:16:51.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91563.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.91563.log.gz 2023-10-16T20:16:51.319 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96804.log 2023-10-16T20:16:51.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97436.log 2023-10-16T20:16:51.320 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91105.log.gz 2023-10-16T20:16:51.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92645.log 2023-10-16T20:16:51.321 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96804.log.gz 2023-10-16T20:16:51.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93625.log 2023-10-16T20:16:51.323 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97436.log.gz 2023-10-16T20:16:51.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92645.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92645.log.gz 2023-10-16T20:16:51.324 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T20:16:51.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92693.log 2023-10-16T20:16:51.325 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93625.log.gz 2023-10-16T20:16:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92929.log 2023-10-16T20:16:51.326 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T20:16:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92693.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92693.log.gz 2023-10-16T20:16:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97982.log 2023-10-16T20:16:51.328 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93289.log 2023-10-16T20:16:51.329 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92929.log.gz 2023-10-16T20:16:51.329 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92369.log 2023-10-16T20:16:51.330 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97982.log.gz 2023-10-16T20:16:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93289.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.93289.log.gz 2023-10-16T20:16:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97394.log 2023-10-16T20:16:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97031.log 2023-10-16T20:16:51.332 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92369.log.gz 2023-10-16T20:16:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93247.log 2023-10-16T20:16:51.333 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97394.log.gz 2023-10-16T20:16:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91251.log 2023-10-16T20:16:51.334 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97031.log.gz 2023-10-16T20:16:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93247.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93247.log.gz 2023-10-16T20:16:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91951.log 2023-10-16T20:16:51.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92137.log 2023-10-16T20:16:51.337 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91251.log.gz 2023-10-16T20:16:51.337 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91951.log: gzip -5 --verbose 87.3% -- -- replaced with /var/log/ceph/ceph-client.admin.91951.log.gz 2023-10-16T20:16:51.337 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.97562.log 2023-10-16T20:16:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92137.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92137.log.gz 2023-10-16T20:16:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91169.log 2023-10-16T20:16:51.340 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97562.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97562.log.gz 2023-10-16T20:16:51.340 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-16T20:16:51.341 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97772.log 2023-10-16T20:16:51.341 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91169.log.gz 2023-10-16T20:16:51.342 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93129.log 2023-10-16T20:16:51.343 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97772.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97772.log.gz 2023-10-16T20:16:51.343 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98496.log 2023-10-16T20:16:51.344 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93793.log 2023-10-16T20:16:51.345 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93129.log.gz 2023-10-16T20:16:51.346 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98496.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98496.log.gz 2023-10-16T20:16:51.346 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97604.log 2023-10-16T20:16:51.347 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92095.log 2023-10-16T20:16:51.347 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93793.log.gz 2023-10-16T20:16:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97604.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97604.log.gz 2023-10-16T20:16:51.348 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98286.log 2023-10-16T20:16:51.349 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91648.log 2023-10-16T20:16:51.350 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92095.log.gz 2023-10-16T20:16:51.351 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98286.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98286.log.gz 2023-10-16T20:16:51.351 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91697.log 2023-10-16T20:16:51.352 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93835.log 2023-10-16T20:16:51.352 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91648.log.gz 2023-10-16T20:16:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91697.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91697.log.gz 2023-10-16T20:16:51.353 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94243.log 2023-10-16T20:16:51.354 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93835.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-16T20:16:51.354 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93835.log.gz 2023-10-16T20:16:51.355 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94243.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94243.log.gz 2023-10-16T20:16:51.356 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92357.log 2023-10-16T20:16:51.356 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93080.log 2023-10-16T20:16:51.358 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92357.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92357.log.gz 2023-10-16T20:16:51.358 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92773.log 2023-10-16T20:16:51.359 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98328.log 2023-10-16T20:16:51.360 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92773.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93080.log.gz 2023-10-16T20:16:51.361 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92773.log.gz 2023-10-16T20:16:51.361 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93943.log 2023-10-16T20:16:51.362 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98328.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.98328.log.gz 2023-10-16T20:16:51.363 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91783.log 2023-10-16T20:16:51.364 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92603.log 2023-10-16T20:16:51.365 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91783.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93943.log.gz 2023-10-16T20:16:51.366 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91783.log.gz 2023-10-16T20:16:51.366 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91521.log 2023-10-16T20:16:51.366 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92603.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92603.log.gz 2023-10-16T20:16:51.367 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96702.log 2023-10-16T20:16:51.368 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91521.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-10-16T20:16:51.369 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96702.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91521.log.gz 2023-10-16T20:16:51.370 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96702.log.gz 2023-10-16T20:16:51.370 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94141.log 2023-10-16T20:16:51.371 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-16T20:16:51.373 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92359.log 2023-10-16T20:16:51.374 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.94141.log.gz 2023-10-16T20:16:51.374 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94693.log 2023-10-16T20:16:51.376 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97309.log 2023-10-16T20:16:51.376 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92359.log.gz 2023-10-16T20:16:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.94693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97478.log 2023-10-16T20:16:51.379 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97309.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97309.log.gz 2023-10-16T20:16:51.380 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97478.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97478.log.gz 2023-10-16T20:16:51.381 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91605.log 2023-10-16T20:16:51.383 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92764.log 2023-10-16T20:16:51.384 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91605.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91605.log.gz 2023-10-16T20:16:51.386 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92764.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92764.log.gz 2023-10-16T20:16:51.386 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96904.log 2023-10-16T20:16:51.388 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97814.log 2023-10-16T20:16:51.389 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96904.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96904.log.gz 2023-10-16T20:16:51.391 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97814.log.gz 2023-10-16T20:16:51.391 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91993.log 2023-10-16T20:16:51.393 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-16T20:16:51.395 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91993.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91993.log.gz 2023-10-16T20:16:51.397 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91350.log 2023-10-16T20:16:51.401 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93499.log 2023-10-16T20:16:51.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97898.log 2023-10-16T20:16:51.401 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91350.log.gz 2023-10-16T20:16:51.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98024.log 2023-10-16T20:16:51.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97898.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93499.log.gz 2023-10-16T20:16:51.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98024.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98084.log 2023-10-16T20:16:51.408 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97898.log.gz 2023-10-16T20:16:51.409 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98556.log 2023-10-16T20:16:51.410 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98024.log.gz 2023-10-16T20:16:51.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98084.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98084.log.gz 2023-10-16T20:16:51.413 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93331.log 2023-10-16T20:16:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98556.log: /var/log/ceph/ceph-client.admin.93331.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98556.log.gz 2023-10-16T20:16:51.418 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T20:16:51.421 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93331.log.gz 2023-10-16T20:16:51.422 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91739.log 2023-10-16T20:16:51.427 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.91739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93709.log 2023-10-16T20:16:51.432 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3%/var/log/ceph/ceph-client.admin.93709.log: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T20:16:51.432 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91739.log.gz 2023-10-16T20:16:51.433 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96989.log 2023-10-16T20:16:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92053.log 2023-10-16T20:16:51.436 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96989.log: -- replaced with /var/log/ceph/ceph-client.admin.93709.log.gz 2023-10-16T20:16:51.437 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97257.log 2023-10-16T20:16:51.439 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4%/var/log/ceph/ceph-client.admin.97257.log: -- replaced with /var/log/ceph/ceph-client.admin.96989.log.gz 2023-10-16T20:16:51.440 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97257.log.gz 2023-10-16T20:16:51.442 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-16T20:16:51.442 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92053.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92053.log.gz 2023-10-16T20:16:51.444 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92580.log 2023-10-16T20:16:51.449 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87032.log 2023-10-16T20:16:51.450 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92580.log.gz 2023-10-16T20:16:51.451 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-16T20:16:51.457 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98204.log 2023-10-16T20:16:51.457 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.87032.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.87032.log.gz 2023-10-16T20:16:51.459 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92617.log 2023-10-16T20:16:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.98204.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98204.log.gz 2023-10-16T20:16:51.465 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92617.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92617.log.gz 2023-10-16T20:16:51.466 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93667.log 2023-10-16T20:16:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93541.log 2023-10-16T20:16:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87514.log 2023-10-16T20:16:51.472 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6%/var/log/ceph/ceph-client.admin.93541.log: -- replaced with /var/log/ceph/ceph-client.admin.93667.log.gz 2023-10-16T20:16:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92908.log 2023-10-16T20:16:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.87514.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93541.log.gz 2023-10-16T20:16:51.477 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87514.log.gz 2023-10-16T20:16:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90945.log 2023-10-16T20:16:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92908.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92908.log.gz 2023-10-16T20:16:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.90945.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90945.log.gz 2023-10-16T20:16:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97688.log 2023-10-16T20:16:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97646.log 2023-10-16T20:16:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97688.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97688.log.gz -5 2023-10-16T20:16:51.486 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.92349.log 2023-10-16T20:16:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97646.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97646.log.gz 2023-10-16T20:16:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93457.log 2023-10-16T20:16:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.92349.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92349.log.gz 2023-10-16T20:16:51.498 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93457.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93457.log.gz 2023-10-16T20:16:51.499 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93415.log 2023-10-16T20:16:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97172.log 2023-10-16T20:16:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93415.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93415.log.gz 2023-10-16T20:16:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-16T20:16:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97172.log: /var/log/ceph/ceph-mds.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97172.log.gz 2023-10-16T20:16:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93373.log 2023-10-16T20:16:51.517 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93373.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93373.log.gz 2023-10-16T20:16:51.715 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-16T20:16:51.981 INFO:teuthology.orchestra.run.smithi110.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-16T20:16:52.106 INFO:teuthology.orchestra.run.smithi110.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-16T20:16:53.186 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-16T20:16:53.646 INFO:teuthology.orchestra.run.smithi110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-16T20:16:53.666 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-16T20:16:53.896 INFO:teuthology.orchestra.run.smithi110.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-16T20:16:53.974 INFO:teuthology.orchestra.run.smithi110.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-10-16T20:16:54.116 INFO:teuthology.orchestra.run.smithi057.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-16T20:16:54.155 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-16T20:16:54.179 INFO:teuthology.orchestra.run.smithi110.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-16T20:16:54.193 INFO:teuthology.orchestra.run.smithi057.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-16T20:16:54.221 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-16T20:16:54.277 INFO:teuthology.orchestra.run.smithi057.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-16T20:16:54.489 INFO:teuthology.orchestra.run.smithi110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-16T20:16:54.493 INFO:teuthology.orchestra.run.smithi110.stderr: 2023-10-16T20:16:54.494 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m3.277s 2023-10-16T20:16:54.494 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m17.058s 2023-10-16T20:16:54.494 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m1.260s 2023-10-16T20:16:55.755 INFO:teuthology.orchestra.run.smithi057.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-16T20:16:56.750 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-10-16T20:16:57.556 INFO:teuthology.orchestra.run.smithi057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.94693.log.gz 2023-10-16T20:16:57.560 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-10-16T20:16:57.561 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m6.347s 2023-10-16T20:16:57.561 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m27.641s 2023-10-16T20:16:57.561 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m2.385s 2023-10-16T20:16:57.562 INFO:tasks.ceph:Archiving logs... 2023-10-16T20:16:57.563 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/remote/smithi057/log 2023-10-16T20:16:57.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T20:17:00.859 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/remote/smithi110/log 2023-10-16T20:17:00.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T20:17:03.173 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-16T20:17:03.173 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T20:17:03.182 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-16T20:17:03.183 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T20:17:03.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T20:17:03.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T20:17:03.348 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T20:17:03.361 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T20:17:03.362 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T20:17:03.371 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T20:17:03.421 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2023-10-16T20:17:03.430 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2023-10-16T20:17:03.432 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T20:17:03.432 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-10-16T20:17:03.432 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 +92us[ +92us] +/- 86ms 2023-10-16T20:17:03.432 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 7 377 105 -1917us[-1900us] +/- 46ms 2023-10-16T20:17:03.432 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +4401us[+4401us] +/- 112ms 2023-10-16T20:17:03.433 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:17:03.440 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T20:17:03.440 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2023-10-16T20:17:03.440 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +59us[ +59us] +/- 86ms 2023-10-16T20:17:03.441 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -1944us[-1980us] +/- 47ms 2023-10-16T20:17:03.441 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +4345us[+4345us] +/- 112ms 2023-10-16T20:17:03.441 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:17:03.442 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T20:17:03.452 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T20:17:03.452 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T20:17:03.460 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T20:17:03.743 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T20:17:03.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T20:17:04.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:17:04.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T20:17:04.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:17:04.212 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T20:17:04.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T20:17:04.239 INFO:teuthology.task.internal:Duration was 3445.736726 seconds 2023-10-16T20:17:04.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T20:17:04.249 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T20:17:04.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T20:17:04.259 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T20:17:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T20:17:04.434 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T20:17:04.730 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T20:17:04.730 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2023-10-16T20:17:04.731 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T20:17:04.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2023-10-16T20:17:04.802 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T20:17:04.882 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T20:17:04.882 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T20:17:04.891 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T20:17:04.995 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T20:17:04.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T20:17:05.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T20:17:05.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T20:17:05.212 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T20:17:05.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T20:17:05.318 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T20:17:05.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T20:17:05.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:17:05.439 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:17:05.551 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2023-10-16T20:17:05.553 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2023-10-16T20:17:05.630 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:17:05.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:17:05.687 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:17:05.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:17:05.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T20:17:05.755 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T20:17:05.756 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/remote/smithi057 2023-10-16T20:17:05.756 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T20:17:05.873 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061/remote/smithi110 2023-10-16T20:17:05.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T20:17:05.985 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T20:17:05.986 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T20:17:05.995 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T20:17:06.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T20:17:06.066 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T20:17:06.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T20:17:06.111 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T20:17:06.111 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T20:17:06.121 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T20:17:06.176 INFO:teuthology.orchestra.run.smithi057.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 20:17 /home/ubuntu/cephtest 2023-10-16T20:17:06.180 INFO:teuthology.orchestra.run.smithi110.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 20:17 /home/ubuntu/cephtest 2023-10-16T20:17:06.183 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T20:17:06.198 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T20:17:06.211 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-10-16T20:17:06.212 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T20:17:06.238 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-16T20:17:06.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T20:17:06.262 DEBUG:teuthology.nuke:shortname: smithi110 2023-10-16T20:17:06.263 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T20:17:06.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:09:37.669957', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2zusky+XBRcCSZzHYHFmLoRFcxSn8E5NGKEAsqcPkd3RWzrXWZ/UENhfaQ/IVdYDBN0rdhcEliONWfbnIvHb4='} 2023-10-16T20:17:06.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:09:37.667930', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyv10wTIhXE0Wp2+/pnLwD0VllAIiMrvMNwpE9DceocyJdBs8b6tCs+fOlHkaKfpGuV2PeuurBhsdCKBoq0bqY='} 2023-10-16T20:17:06.318 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-16T20:17:06.319 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T20:17:06.344 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-16T20:17:06.344 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:17:06.358 INFO:teuthology.orchestra.console.smithi110:Power off 2023-10-16T20:17:06.359 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T20:17:06.366 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-16T20:17:06.381 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-10-16T20:17:06.381 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:17:06.403 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-16T20:17:10.369 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:17:10.405 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:17:10.479 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-16T20:17:10.515 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-10-16T20:17:14.482 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:17:14.516 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:17:14.592 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-16T20:17:14.626 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-10-16T20:17:14.694 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-16T20:17:14.727 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-10-16T20:17:14.832 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 3445.73672580719 failure_reason: saw valgrind issues flavor: default mon.a-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 mon.b-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 owner: scheduled_rishabh@teuthology status: fail success: false 2023-10-16T20:17:14.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:17:14.905 INFO:teuthology.run:FAIL